A movement-reactive music experiment. Dance, and the music mirrors your emotional state.
Your body is tracked by AI pose detection — 33 points, 30 times per second.
Movement primitives map to emotional states — flow, anger, stillness, fear, craving.
Music transforms in real-time to reflect your state. The system adapts to your range.
| Metric | How It's Measured |
|---|---|
| Velocity | Average joint speed, frame to frame |
| Jerkiness | 3rd derivative of position — abrupt speed changes |
| Contraction | Limb distance from center of mass |
| Verticality | Head/shoulder height relative to hips |
| Symmetry | Positional match of left vs right limbs |
| Coherence | Timing match of left vs right velocity |
| Ankle Spread | Horizontal distance between ankles |
| Wrist Spread | Horizontal distance between wrists |
| State | Recipe | Response |
|---|---|---|
| Flow | Smooth + open + upright | Jazz chords, kalimba, blue-teal |
| Anger | Jerky + incoherent | Distorted pad, chromatic stabs, red |
| Stillness | Slow + contracted + slumped | Drone, oppressive bass, white |
| Fear | High jerk relative to speed | Tremolo stabs, yellow-green |
| Craving | Moderate + reaching + smooth | Warm amber tones |