[FAQ] How does the virtual try-on for shoes work technically?

Our virtual try-on solution uses augmented reality (AR) to place a 3D shoe model on the user’s feet in real time, using the smartphone camera. The core system relies on two machine learning models running in parallel: 

• One model detects key foot landmarks and computes real-time positioning and orientation of the shoe. 

• A second model segments the video stream and computes dynamic occlusion masks several times per second. 

Virtual shoes are automatically scaled to match the user's real foot dimensions — no manual adjustment is needed. The system adapts seamlessly to two modes of usage: 

• Top-down mode: when filming your own feet directly. 

• Mirror mode: when pointing the camera at your reflection. 

The detection mode is fully automatic, ensuring a smooth user experience with no setup.