Pastry Making

Seeing as Input

Utilizes Unity for low-fidelity prototyping, focusing on the input of seeing - such as discerning, perceiving, and recognizing - to interact with virtual objects. This prototype involves designing a set of gestures that correspond with objects in the scene, triggering specific actions.

The demo features a culinary adventure where the user virtually prepares a lotus pastry, with the process including lighting a fire, heating oil, and frying the dough. The exercise encourages users to experiment with different gestures and interactions, offering a unique, hands-on experience in pastry making simulation.

Timeline

Oct 2023 (2 Days)

Role

XR Prototyping

Tool

Unity, Meta XR SDK, Meta Quest 2

Teammate

/

Instructor

Jenny Rodenhouse, John Brumley

Lighting a fire and heating oil, we drop the kneaded dough into the hot oil to fry until it blossoms into a lotus pastry. Hmm... It seems a bit overfried. No worries, let's discard it and make another!

‍

(This demo video includes an audio explanation.)

Design Process

Design Process

Design Process

Behind The Scene

Reflection

Reflection

Reflection

What I Learned

Learned that we need to create a closed loop (where fingers touch each other or the palm) when recording gestures or using them to grab objects; otherwise, the gesture cannot be recorded or used to pick up objects.


Learned that we need to create a closed loop (where fingers touch each other or the palm) when recording gestures or using them to grab objects; otherwise, the gesture cannot be recorded or used to pick up objects.


Learned that we need to create a closed loop (where fingers touch each other or the palm) when recording gestures or using them to grab objects; otherwise, the gesture cannot be recorded or used to pick up objects.


Explored more natural ways of interacting with objects by using different gestures to grab and interact with objects of various shapes.

Explored more natural ways of interacting with objects by using different gestures to grab and interact with objects of various shapes.

Explored more natural ways of interacting with objects by using different gestures to grab and interact with objects of various shapes.

Practiced creating animations with VFX and C# code.

Practiced creating animations with VFX and C# code.

Practiced creating animations with VFX and C# code.

Reflection

Reflection

Reflection

Next Step

Add sound first to provide auditory feedback for lightning fire, pouring oil, boiling oil, frying pastry, etc.

Add sound first to provide auditory feedback for lightning fire, pouring oil, boiling oil, frying pastry, etc.

Add sound first to provide auditory feedback for lightning fire, pouring oil, boiling oil, frying pastry, etc.

Utilize an iterative design process for material, lighting, VFX, and animation variations.

Utilize an iterative design process for material, lighting, VFX, and animation variations.

Utilize an iterative design process for material, lighting, VFX, and animation variations.