UWB tracking in space
Realtime 3D positioning. Coordinates of a person or object drive lighting, video, spatial audio and interactive zones.
Sergey Korneev
Multimedia systems engineer / creative technologist
I design and commission multimedia systems where video, lighting, tracking, kinetics and spatial audio run as one show. I write the software that is missing, integrate the hardware, and get the system into production.
[ What the work did ]
Concrete changes for clients after the projects.
- Turned a showroom into a sales tool. The client sees a full AV system working, not a slide deck. Showroom piece →
- Turn “we want a modern space” into something you can build. A vague request becomes a media scenario that then drives design, procurement and install.
- Close the gap between design, engineering and delivery. The original idea survives until commissioning.
- Cut crew size on a multi-camera show. Cameras cut on the speaker’s head turn — you still get live directing with fewer people. Camera cuts from head turn →
- Cut graphics prep time for live. Captions with translation, background replacement and privacy masks happen in realtime. No pre-render, no post-fix. GFX Engine →
- Gave an exhibition stand a reason to stop. Non-repeating generative graphics pull people in and give them something to look at. Generative graphics →
- Kept the guest in contact with the brand after the event. Visitors got a personal song with their name, which they could keep and send on. Festival stand →
- Automated live captions. Accessibility without a dedicated stenographer and manual cleanup. RULLZ Subtitler →
- Made the speaker’s job in frame easier. The text follows speech rate — no prompter operator. Speech-following teleprompter →
[ Selected work ]
Click a card for details, all clips and stills.
AVStream Spatial
Spatial logic for AV infrastructure: person tracking and cue-based control of lighting, video, audio, PTZ cameras and devices.
Showroom piece for Hi-Tech Media
A three-minute audiovisual show in the integrator’s showroom. It explains and demonstrates the installed equipment.
AVStream Spatial Panner
Software for moving sound objects in 3D: trajectories, keyframes, loops, and Holophonix control.
Head tracking for video perspective
The viewer’s head tracking drives the video in the showroom. Perspective and framing follow the head turn.
Auto-follow for any VISCA PTZ camera
Turns any PTZ camera with VISCA and RTSP into a follow-cam. Python, FFmpeg and YOLOv8 keep the speaker in frame.
[ Interactive systems and tracking ]
Drive an Unreal Engine object from UWB
Moves an object in an Unreal Engine scene from live UWB tracking coordinates.
Camera cuts from head turn (vMix)
Camera switching from the speaker’s head turn. vMix picks the input without an operator.
Tracking and show control over OSC
Tracking data goes into media systems over OSC: zones, triggers and show-control logic.
Theremin: gesture to MIDI
A concept where movement in space becomes a control signal for audio and media.
UWB tracking — more clips
Tracking 2
Tracking 3
Lights follow the tag
[ Show systems and spatial audio ]
AVStream Spatial Controller
Operator UI for spatial-audio show control: OSC routes, sound objects and live scene control. The video is a Holophonix integration.
Spatial audio processor (TouchDesigner)
A spatial audio processor in TouchDesigner. It moves sources across speakers in any room, using Ti-Max logic.
Show audio control UI
A UI for the audio parameters that matter during a show — without breaking the scene logic.
GFX Engine
Realtime effects engine: background replacement, live captions with translation, waveform overlays, image generation and speaker privacy masks.
[ Realtime graphics and projection ]
Generative graphics and projection mapping
Realtime generative graphics and projection mapping as a technical layer of a visual system.
Layered realtime video
Layered video compositing in realtime as part of a live media cue.
[ Concepts and experiments ]
Water show concept
A water-show concept with media, lighting and kinetics in sync.
WooHoo — interactive space concept
A space concept where the visitor is part of the media cue.
Song booth — Youth Day
A festival stand that generates a personal song with the guest’s name in a chosen style and sends it to Telegram.
SNYATO! — group filming app
A consumer app for group filming on phones, editing and rendering finished clips.
[ Broadcast software and media infrastructure ]
Live automation, realtime graphics, speech processing and low-latency video transport — including RULLZ: captions, vMix scheduling and a speech-following teleprompter.
vMix · OBS · WebRTC · SRT · NDI · FFmpeg · Node.js · WebSocket
RULLZ Subtitler — live captions
Automatic captions on live streams: speech recognition and profanity cut in the live path.
RULLZ vMix Commander
Remote vMix control: time-based schedules, automatic cuts and quick commands from a browser.
RULLZ — speech-following teleprompter
A teleprompter that follows speech rate and scrolls the text itself. Separate window for the speaker.
CloudMix — cloud video production
A cloud tool for online production — conferences, sport, concerts, webinars — with a familiar broadcast UI.
Streamometr — restream with drop protection
Watches the incoming stream by bitrate and FPS, restreams to four destinations, records to disk, and inserts a slate while production fixes the feed.
Low-latency video transport
Studio and remote video paths with low latency on NDI, WebRTC, SRT, RTMP, WHEP, FFmpeg and MediaMTX.
SRTMiniServer, NTRStreamer, WinDeskCam Pro
Commercial ingest and distribution products, plus WinDeskCam Pro — turns a Windows PC into an RTSP/ONVIF camera for CCTV systems.
[ Systems architecture ]
Multimedia systems architecture
End-to-end object architecture: video, Dante audio, OSC, MIDI and Art-Net, media servers, tracking and redundancy.
Theatre AV infrastructure
Led the audio department and built a theatre AV infrastructure from scratch through commissioning.
[ Project notes ]
Write-ups are in Russian. Titles below are in English so you know what each one is about.
- CloudMix — cloud video production — mixer, replay, captions, audio matrix.
- SNYATO! — group filming app — UX flows, screens, one-handed use.
- Music generation stand (Youth Day) — text and music generation, service screens.
- Artist tracking on stage (PTZ, DMX, audio) — UWB tags, TouchDesigner, GitHub notes.
- Camera cuts from head turn
- Captions in vMix and a text log of the show
- Showroom piece (Hi-Tech Media)
- Spatial audio processor
- Auto-follow for any VISCA PTZ
- WebRTC → SRT mixer
- Cloud WebRTC–SRT mixer
- RTMP box: record, restream, monitor
[ What I can take on ]
- multimedia concept and scenario;
- AV system architecture;
- show control and integration;
- prototyping the missing software;
- selecting and supervising external contractors;
- follow-through from idea to commissioning.
[ Example projects ]
- turnkey design of an interactive show for a large integrator’s showroom (video, audio, lighting, Crestron);
- a reputation-monitoring system that analyses media and social content in realtime with large language models;
- MVP of a cloud video mixer and a mobile filming app;
- UWB target tracking;
- Streamometr — RTMP/SRT record and restream with protection against an incoming feed drop.
[ Contact ]
Open to work on multimedia systems, creative technology, show control and interactive installations.