BACKGROUND
Overview
/ My Role
- Conducted design research for a spatial navigation solution, developing storylines and user flows.
- Studied the visualization of geographic data to inform design decisions for a 3D map interface.
- Created a pipeline for multi-character virtual meetings, including the design and visualization of virtual avatars.
- Designed CID (Cockpit Information Display) screens for AI-assisted driving experience scenarios, creating high-fidelity prototypes in Figma to visualize intuitive, user-centered interfaces that enhance driver interaction with AI features.
- Developed an AR Glasses application in Unity, integrating spatial navigation and virtual meeting features.
- Worked extensively with VFX graph (Unity), Niagara (Unreal Engine), and Particle Systems (Blender) as well as built custom shaders to prototype novel effects that translate across multiple platforms
RESEARCH
/ Advantages of BMW AR Glasses over in-car displays
Display Content where you want
Personalized content for everyone
Immersive experience
AR glasses have a huge field of view compared to in-car displays. Content can be placed anywhere in the environment.
Customized content for everyone in the car, transforming every ride into a unique experience
Virtual elements blend seamlessly with the real world to create fully immersive experiences.
Existing Car Concepts Utilizing AR Glasses
How might we improve driving experience with AR Glasses?
- How might AR can help to enhance safety?
- How might AR can help to enhance driving autonomy?
- How might we overcome the constraints of AR in in-car environment?
/ BMW AR Glasses Use Case
Spatial Navigation
- AR glasses provide real-time, on-road navigation overlays, ensuring drivers keep their eyes on the road.
- Key route guidance, lane change prompts, and turn-by-turn directions are seamlessly integrated into the driver's field of view.
- Key route guidance, lane change prompts, and turn-by-turn directions are seamlessly integrated into the driver's field of view.
Signs & Hazard Warnings
- AR-enhanced hazard detection alerts drivers about pedestrians, cyclists, and unexpected obstacles.
- Real-time traffic sign recognition displays speed limits, stop signs, and warnings directly in the driver’s line of sight.
- Adaptive alerts for potential collisions, blind-spot monitoring, and lane departure warnings.
- Real-time traffic sign recognition displays speed limits, stop signs, and warnings directly in the driver’s line of sight.
- Adaptive alerts for potential collisions, blind-spot monitoring, and lane departure warnings.
Parking
- Visualized parking distance alerts helps drivers park precisely with augmented parking guidelines.
- 360-degree AR overlays enhance spatial awareness by integrating vehicle cameras and sensors.
- 360-degree AR overlays enhance spatial awareness by integrating vehicle cameras and sensors.
Entertainment
- AR glasses offer immersive media experiences, allowing passengers to watch movies, play AR-enhanced games, or browse interactive content.
- Multi-screen capability enables personalized entertainment without interfering with the driver’s focus.
- Multi-screen capability enables personalized entertainment without interfering with the driver’s focus.
Image resource: https://wayray.com/deep-reality-display
/ Use Case Data Transition
/ How to place virtual content in the environment
View
What You See
What It Appears
Best For
Close-Up View
Head & Face
Dashboard, Windshield
Emotional expression, eye contact
Bust View
Head & Shoulders
Dashboard, Windshield
Video calls, virtual meetings
Full-Body View
Full Avatar
Inside the car
Social interaction, gaming
Long - Distance
Full Avatar (Far Away)
Outside the car
Not well integrated with environment
Design
/ In-glasses recordings
