Overview
A complete hardware + software lighting platform: a React + PixiJS desktop studio with a bird's eye room canvas and live each LED preview, a FastAPI backend running a live music-analysis engine and 60fps render loop, and native C++ firmware for ESP8266/ESP32 nodes. The engine phase-locks a beat grid to the music and fires light changes early by the measured pipeline latency, so LEDs land exactly on the audible beat.
Challenge
Turning any room into a synchronised, music reactive light canvas demands subframe timing across audio capture, analysis, network transport, and dozens of independent LED nodes, without perceptible lag or drift.
Solution
Engineered a almost instant pipeline (WASAPI loopback capture, 60fps render loop, UDP pixel transport, adaptive predictive beat scheduler) paired with production quality clock synced node firmware.
Outcome
A room sized lighting rig where an ML DJ automatic mode reads BPM, genre, and energy live and drives 25 club effects across the strip like a real fixture rig, landing changes on the beat with <2ms between nodes skew.
Key Highlights
- •almost instant path, native WASAPI loopback capture, 60fps render loop, UDP pixel transport, and an adaptive predictive beat scheduler
- •ML DJ automatic mode detects BPM, genre, and energy live, switching between 25 included club effects on downbeats across the room one strip at a time
- •production quality node firmware: <2ms between nodes skew, streaming SHA-256-verified OTA updates, current limiting, watchdog, and a captive portal setup wizard
Tech Stack