Google Arts & Culture · Masked Reality
Cultural Tech · AI · Immersive Experience
The Challenge
Indian classical dance art needed an immersive, accessible way for global audiences to experience and learn cultural traditions beyond static content.
What we built
Built an interactive web experience using ML facial expression detection and 3D transformation to apply dance-form face paint in real time — users mimic expressions and download performances.
Deep Dive
Why it was difficult
Real-time ML face detection running in-browser with smooth 3D transformation overlays. Performance had to be flawless on mobile browsers — no native app, no second chances.
How design helped
Designed the interaction flow so non-technical users could intuitively mimic dance expressions and see live face paint applied. Made cultural content feel playful, not academic.
How engineering helped
Custom React rendering pipeline syncing ML face mesh output with 3D CSS transforms at 60fps. Progressive enhancement for devices with varying GPU capabilities.
Where AI helped
ML facial expression detection identifies user expressions in real-time and maps them to classical dance face paint overlays with sub-100ms latency.
Impact
Immersive cultural learning experience published on Google Arts & Culture — promoting Indian classical dance globally.
Built with
More projects
Building a serious platform?
Let's engineer it properly.
Start a conversation about your next digital platform.