Responsive Tale

Reality Hack 2023, Winner of Hardware Hack Impact

2022 January

TOOLS

Quest Pro

Arduino

C#

Vibration Motors

Maya

Unity

Github

Figma

Responsive Tale is a multimodal augmented reading experience to improve engagement and provide an immersive storytelling experience.

The project uses Oculus Quest Pro's pass-through AR functionality to display a digital layer on top of stories and books. Using text analysis and image recognition, haptic feedback and audio-visuals are generated to guide the user through key scenes and important elements of the story.

Augmented World Expo 2023 Exhibition

Museum of Moving Images Exhibition

MIT Reality Hack 2023

Videos