Doctor's office Mixed Reality

AR Kit SLAM Tracking | Hololens | Developed Tool for Facial Animation Recording | Voice Command AI

Originally developed for HoloLens, this project leveraged its spatial mapping capabilities and was showcased at a trade show with Johnson & Johnson. Users could experience spatial mixed reality (MR) and interact through voice command AI or finger gestures.

The project was later adapted into an iOS AR application utilizing Apple's ARKit SLAM tracking to integrate visuals and interactions into real-world spaces. Designed with a modular structure, the product was successfully adopted by multiple clients.

• Act as the lead designer, programmer, and technical artist for this project, overseeing SLAM tracking system setup and core interactions.

• Developed an application using iOS ARKit to efficiently record facial expressions and lip-sync for character animation.

• Conducted rapid research and integration of emerging technologies, including mixed reality and AI voice commands.

Muse Creative Award, "Gold" in "Experiential and Immersive AR", 2021

Hermes Creative Awards, "Platinum" in "Electronic, Social, and Interactive Media", 2021

Copyright © Tipping Point Media