Spatial Web
An experimental interface controlled by hand gestures, where webcam tracking turns the browser into a physical-feeling spatial canvas.
The challenge
Most web interfaces assume a mouse or touch surface. Spatial Web explores what happens when the user’s hand becomes the cursor and interface objects respond with weight, proximity, and momentum.
The approach
MediaPipe HandLandmarker tracks a camera stream while a requestAnimationFrame loop handles cursor mapping, pinch-to-grab interactions, collision checks, spring motion, and release velocity. The experience includes graceful camera-permission fallbacks and a mirrored immersive background.
What I learned
High-frequency interaction state belongs outside Vue reactivity; keeping the physics loop imperative makes gesture feedback smoother and easier to tune.
Role
Creative technologist
Outcome
A browser-based interaction study combining MediaPipe hand landmarks, gesture recognition, spring physics, inertia, and an immersive camera mode.