BACKGROUND
Overview
/ My Role
- Conducted design research for a spatial navigation solution, developing storylines and user flows.
- Studied the visualization of geographic data to inform design decisions for a 3D map interface.
- Created a pipeline for multi-character virtual meetings, including the design and visualization of virtual avatars.
- Designed CID (Cockpit Information Display) screens for AI-assisted driving experience scenarios, creating high-fidelity prototypes in Figma to visualize intuitive, user-centered interfaces that enhance driver interaction with AI features.
- Developed an AR Glasses application in Unity, integrating spatial navigation and virtual meeting features.
- Worked extensively with VFX graph (Unity), Niagara (Unreal Engine), and Particle Systems (Blender) as well as built custom shaders to prototype novel effects that translate across multiple platforms
RESEARCH
/ Advantages of BMW AR Glasses over in-car displays
Display Content where you want
Personalized content for everyone
Immersive experience
AR glasses have a huge field of view compared to in-car displays. Content can be placed anywhere in the environment.
Customized content for everyone in the car, transforming every ride into a unique experience
Virtual elements blend seamlessly with the real world to create fully immersive experiences.
Existing Car Concepts Utilizing AR Glasses
How might we improve driving experience with AR Glasses?
- How might AR can help to enhance safety?
- How might AR can help to enhance driving autonomy?
- How might AR can help to enhance driving autonomy?
/ BMW AR Glasses Use Case
Spatial Navigation
- AR glasses provide real-time, on-road navigation overlays, ensuring drivers keep their eyes on the road.
- Key route guidance, lane change prompts, and turn-by-turn directions are seamlessly integrated into the driver's field of view.
- Key route guidance, lane change prompts, and turn-by-turn directions are seamlessly integrated into the driver's field of view.
Signs & Hazard Warnings
- AR-enhanced hazard detection alerts drivers about pedestrians, cyclists, and unexpected obstacles.
- Real-time traffic sign recognition displays speed limits, stop signs, and warnings directly in the driver’s line of sight.
- Adaptive alerts for potential collisions, blind-spot monitoring, and lane departure warnings.
- Real-time traffic sign recognition displays speed limits, stop signs, and warnings directly in the driver’s line of sight.
- Adaptive alerts for potential collisions, blind-spot monitoring, and lane departure warnings.
Parking
- Visualized parking distance alerts helps drivers park precisely with augmented parking guidelines.
- 360-degree AR overlays enhance spatial awareness by integrating vehicle cameras and sensors.
- 360-degree AR overlays enhance spatial awareness by integrating vehicle cameras and sensors.
Entertainment
- AR glasses offer immersive media experiences, allowing passengers to watch movies, play AR-enhanced games, or browse interactive content.
- Multi-screen capability enables personalized entertainment without interfering with the driver’s focus.
- Multi-screen capability enables personalized entertainment without interfering with the driver’s focus.
Image resource: https://wayray.com/deep-reality-display
/ Use Case Data Transition
/ How to place virtual content in the environment
Collaborated Innovation on HMI Design
My role necessitated extensive collaboration across multidisciplinary teams, including CMF design, audio systems, machine learning, and ergonomics research. This collaborative environment fostered a holistic approach to design and innovation, allowing us to integrate technology and aesthetics in a user-centered manner. The development of an interactable map prototype exemplified our commitment to creating intuitive and engaging experiences, tailored through user research and feedback to meet the evolving needs and preferences of our users.
Design
/ In-glasses recordings
