Moon Adventure

Look As Input:

Augmenting How We See

Moon Adventure is an XR exercise that involves developing a Unity scene for mobile interactions, with a focus on the use of gaze as input. Users utilize their mobile phones as 'magic lenses' to discover new perspectives within a moon-themed adventure. By wearing the cardboard wing with a phone trigger, users can activate interactions within the scene, turning the act of looking into an interactive experience. This exercise explores the intricacies of visual engagement, from brief glances to in-depth scrutiny, to offer a varied and immersive exploration of sight and perception.

Timeline

Sep 2023 (1.5 Days)

Role

XR Prototyping, Physical Object Prototyping

Tool

Unity, Meta XR SDK, Cinema 4D, Meta Quest 2

Teammate

Kangning Tang

Instructor

Jenny Rodenhouse, John Brumley

Looking through a magical lens, we enter a mysterious realm on the moon. Let's illuminate the stars, dispel the clouds, and journey to a beautiful forest in search of celestial peaches and the moon.

Live Demo Recording

(This demo video includes an audio explanation.)

Physical Object: Wings

To create the wings, we utilized rubber bands threaded through the player's arm and holes in the cardboard, allowing the player to control the opening and closing of the wings through the swinging motion of their arm.

Subsequently, we secured a phone inside the sleeve to serve as a trigger mechanism, enabling the player to interact with various elements within the scene.

Reflection

Reflection

Reflection

What I Learned

Learned to use a Virtual Camera for mobile-Unity connection and interaction.

Learned to use a Virtual Camera for mobile-Unity connection and interaction.

Learned to use a Virtual Camera for mobile-Unity connection and interaction.

Practiced using tags for interactive objects.

Practiced using tags for interactive objects.

Practiced using tags for interactive objects.

Reflection

Reflection

Reflection

Next Step

Implement faster wing swinging for higher flight.

Implement faster wing swinging for higher flight.

Implement faster wing swinging for higher flight.

Experiment with attaching phone to feet for forward movement tracking.

Experiment with attaching phone to feet for forward movement tracking.

Experiment with attaching phone to feet for forward movement tracking.

Add sound effects for successful actions.

Add sound effects for successful actions.

Add sound effects for successful actions.