Experiential Design - Task 1: Trending Experience

on

22.4.2025 - 13.5.2025 ( Week 1- Week 4)
Gam Jze Shin / 0353154
Experiential Design / Bachelor of Design in Creative Media
Task 1: Trending Experience

Index

1. Instructions
2. Task 1: Trending Experience
3. Feedback
4. Reflection

Instructions

fig 1.1  Experiential Design MIB

Task 1

In this initial task, we are required to complete three main activities to deepen our understanding of the technology involved:

  • Complete all exercises to demonstrate our grasp of the development platform fundamentals.
  • Write a short reflective blog post based on our findings.
  • Propose three potential ideas for our project.

Week 1

This week, our lecturer Mr. Razif introduced the module and shared examples of impressive AR projects created by previous students. I was truly inspired by their work—some developed AR learning apps that teach children about animals or help secondary students perform science experiments through AR. Others created creative concepts like interactive drawings in museums that respond to user interaction. Mr. Razif encouraged us to reflect on these ideas and consider which direction interests us most for our own project.

fig 2.1  Experiential Design GPT Assitant

Additionally, he introduced an AI-powered Experiential Design Assistant GPT, designed to guide us through each stage of the project—from research to the final AR app. This assistant will support us with Unity and Vuforia, proposal writing, and prototyping. It also offers feedback, resources, and reminders while helping us stay focused on our main goal: creating a compelling mobile AR experience.

fig 2.2 Finding Outcome

I asked the assistant GPT for some inspiration. Initially, the ideas it suggested were quite common and lacked originality or interactivity—such as a furniture AR app that shows how items look in real spaces, which has already been done many times. So, I rephrased my question in hopes of getting a more unique concept. After a few attempts, I received a more interesting suggestion: an AR experience for safety sign symbols. This sparked a further idea—an AR app for learning and recognizing road signs, which could be both educational and engaging. 

Week 2

Week 2 Lecture Slide
Week 2 Exercise in Miro

fig 2.3 Week 2 Slide

This week, we learned about designing experiences. What impressed me most was the difference between user mapping and journey mapping. User mapping focuses on understanding user behavior, needs, and motivations, while journey mapping outlines the steps a user takes when interacting with a product or service.

fig 2.4 Week 2 Group Exercise

For the class activity, each group created a journey map for a specific location (Current Journey Map). My group chose Sunway Lagoon Theme Park. We outlined the entire user journey using Miro, identifying the pain points, gain points, and proposing solutions for each step.

We also explored how AR elements could enhance the experience. Our ideas included:

  • An AR map with arrow guidance and voice-over directions to help visitors navigate the park.
  • A mobile app check-in system where users scan themed section boards.
  • When visitors scan a specific station’s image, AR animations and descriptions would appear, giving a preview of the attraction.
  • The check-in feature would help visitors track which areas they’ve explored.

Week 3

Week 3 Exercise in Figma: https://shorturl.at/DY0HP


fig 2.5 Week 3 Slide

In Week 3, we learned about AR (Augmented Reality), MR (Mixed Reality), and VR (Virtual Reality).

  • AR adds digital elements to the real world through devices like phones or tablets.
  • MR blends the real and digital worlds, allowing interaction between both.
  • VR creates a fully immersive virtual environment, replacing the real world.

In class, we categorized images under AR, MR, and VR, which helped me better understand what AR really is.


fig 2.6 - 2.7 3D Animals on Google

After explaining, Mr. Razif gave us another exercise—to search for a Google animal and view it in 3D. I searched for a rabbit and viewed the 3D rabbit in my real-world space during class.

fig 2.8 Week 3 Group Exercise

Today’s group activity was to choose a place, identify problem, and create an AR mockup as a solution. In my group, I suggested using a hospital as the setting. The problem we focused on was that patients often struggle to navigate the hospital and may not fully understand or explain their symptoms to doctors. After discussing, the group agreed with this idea. One member suggested creating an AR human model to help patients better understand their symptoms and communicate more clearly with doctors.

fig 2.9 Week 3 Group Exercise

Based on the idea, we listed down the possible user feelings if such a feature existed. After that, we created a mockup and presented it in class.


Marker-based AR experience (Tutorial)

Tutorial in Youtube: https://youtu.be/TL15tmg8Jag

I followed the instructions provided by Mr. Razif to learn the basics of AR using Unity.

fig 2.10 Upload Image in Vuforia Engine

Before starting the process in Unity, we had to log in to the Vuforia Engine and upload the image we wanted to use. I noticed that when I added a real-world image, it only received a one-star rating. Mr. Razif explained that higher-rated images are easier for the system to detect in AR. So, I experimented with other images and found one that received a five-star rating. In the end, I chose to use the image with the highest rating for better detection.

fig 2.11 Week 3 Learning Outcome in Unity

After inserting the image into Unity, I placed a square box on top of it. When I scanned the image using my laptop’s camera, the square appeared correctly on the image in the AR view.


Week 4

This week, we continued learning about marker-based AR in Unity. We focused on adjusting the resolution settings for mobile devices and creating a simple button that connects and interacts with an animation.

fig 2.12 Resolution in Unity

After adding Canvas, make sure the Event System is there and next should edit the resolution size and Canva Scaler based on the phone resolution.

  • Canva Scaler > UI Scale Mode > Scale With Screen Size > Change Reference Resolution X
fig 2.13 Week 4 Learning Outcome in Unity (Button)
  • Right Click > UI > Button- TextMeshPro > Import
  • Change Button Name > Text > Size > Position 

fig 2.14 Week 4 Learning Outcome in Unity (Animation)

During class, I faced issues where my target image disappeared, and the OnClick function didn’t show the Animator when trying to link the animation. Mr. Razif suggested restarting Unity, as it sometimes needs time to refresh. So, I redid the entire process at home. In the final outcome, clicking the Play button makes the cube move up and down, while clicking Stop pauses the animation. This reflects what I successfully learned from this week’s class.

Reflective Report Based on AR Research

fig 2.15 - 2.16 Research


fig 2.17 Research and Reflective

Task 1 Idea

For this task, we are required to propose three potential ideas for developing an AR app. Once the ideas are finalized, we need to decide which one to move forward with for the next task.

fig 2.18 Online Consultation

In Week 2, I booked an online consultation with Mr. Razif. Before the session, I searched for ideas online, brainstormed, and organized 4 ideas in a Google Doc. During the consultation, I shared my ideas with him and asked for his suggestions. 

Google Docs


fig 2.19 AR Ideas

After discussing with Mr. Razif, I decided to proceed with my first idea — the AR road sign symbol. During my research on existing apps with similar concepts, I came across RoadAR. This app provides an interactive learning experience by showcasing 3D models of road signs in AR. It categorizes the signs into warning, mandatory, priority, and prohibited types, allowing users to explore each category with detailed visualizations and explanations.

fig 2.20 - 2.21 RoadAR
This is the layout I found in RoadAR. It simulates real road situations, giving users a sense of being in a car and enhancing the feeling of realism. The layout for answering questions can also serve as a useful reference for me when designing my own version.

Feedback

Week 2

Group Exercise in Class
Due to time constraints, our group didn’t get the chance to present. However, I noticed another group chose the same location—Sunway Lagoon. Based on the feedback Mr. Razif gave them, I learned that we should avoid suggesting simple solutions like “adding more lockers” to solve problems. Instead, we’re encouraged to think of more innovative and suitable alternatives.

AR Task Idea
Mr. Razif reviewed my four ideas and provided feedback for each:

  • First idea (driving sign symbol AR): He found it interesting, especially the potential to animate the signs and make them interactive.
  • Second idea (plants): He said it had a clear five-step process and was similar to a previous senior's project, making it an acceptable option.
  • Third idea (color mixing): He pointed out that it would be difficult to implement since mixing and changing colors accurately in AR is quite challenging.
  • Fourth idea (baking tutorial): Although similar to furniture step-by-step tutorials, he mentioned it would be hard to create due to the need for a fixed animated outcome for each baking step.

Week 3

Group Exercise in Class
Some groups missed including the mockup, but fortunately, our group prepared lots that showed how a doctor could use AR to display organ parts to the patient. Mr. Razif didn’t have many comments on our content or mockup, but he did remind us to present the mockup with clear visual explanations instead of displaying too much text at once, as too much text can distract the audience during a presentation.


Reflection

Experience
Through this task and the exercises we have done over the past few weeks, I have gained hands-on experience with Augmented Reality (AR) for the first time. Before this, I had never personally used AR technology, although I was familiar with it through the game Pokémon Go. Initially, I felt both excited and nervous when I learned that we would be working on an AR project. I was unsure of my ability to complete it successfully. Fortunately, our lecturer, Mr. Razif, provided clear guidance through exercises such as user journey mapping, AR fundamentals, and Unity tutorials. This structured support helped me feel more prepared. It was also my first time using Unity, and I managed to connect it with the Vuforia engine and explore adding UI components.

Observation
As I explored AR more deeply, I noticed how seamlessly it integrates into real-life applications beyond gaming. AR enhances everyday tasks by making them more intuitive and engaging. I also observed that many people find AR appealing because of its interactive and immersive experience. During this project, I realized that AR is not just a futuristic concept—it’s already being adopted in many fields such as retail, education, and navigation.

Findings
From this journey, I developed the TGCS lifelong learning skill by taking initiative to research AR technologies on my own. I learned that as technology evolves, AR will likely become even more common in daily life. My understanding of AR has grown from a vague concept into something more practical and tangible. I’ve also recognized the importance of building foundational skills like using Unity and Vuforia, which are essential tools in AR development. While I’m still at the beginning of my AR learning path, I now feel motivated to continue exploring and improving my skills.


Comments

Post a Comment