rooms, sound and audiovisual systems
A public layer for the technical and cultural questions behind SoundSol: how spaces listen, how sound becomes image, how browsers become instruments, and how audiovisual culture can be mapped without losing provenance.
i · published notes
05 entries
Stem-Separated Music Visuals
A SoundSol browser AV lab with realtime mic features plus local uploaded-audio splitting into playable drums, bass, vocals and other stems.
Spatial Audio as Room Practice
A SoundSol branch for spatial audio as artistic practice: room response, HRTF, open tools, installation systems and current artist labs.
Creative Agents Are Becoming Cultural Infrastructure
Notes from the Hermes Agent Creative Hackathon and what it suggests for artists, curators and audiovisual systems.
Rooms That Listen Back
A SoundSol research note on responsive rooms: spaces that sense speech, bodies, reverberation and attention, then return audiovisual behaviour rather than static atmosphere.
Resonance and Shared Neural Rooms
A SoundSol note on a SIGGRAPH 2026 Art Paper that turns meditative neural rhythms into collective spatial light, vibration and sound.
ii · research lanes
six platesbrowser audiovisual systems
WebGPU, Web Audio, WebCodecs and WebXR as the technical base for sound reactive visuals, public sketches and lightweight cultural tools.
spatial audio and presence
HRTF, room modelling, auralisation and immersive audio research for installations, venue maps and sound led spatial work.
generative and procedural media
Audio generation, music visualisation, neural media and shader based systems that can become rights safe soundsol visual language.
cultural maps and 3D spaces
glTF, NeRF, Gaussian splatting and cultural heritage data methods for persistent maps of venues, scenes and sound spaces.
provenance and rights safe media
Content credentials, watermarking, source trails and correction posture for credible AI assisted curation.
voice and realtime audio infrastructure
Realtime speech, agents, audio compression and voice infrastructure signals that overlap with cultural discovery and ai-coustics context.
iii · working references
source-led, original synthesis only- [01]standard · W3C Audio Working GroupW3C Web Audio APIBase layer for sound analysis, reactive graphics, audio previews and browser based listening sketches.
- [02]standard · MDN Web DocsMDN WebGPU APIFoundation for browser native visual instruments, city map effects and realtime shader work.
- [03]standard · MDN Web DocsMDN WebXR Device APIUseful for future spatial city guides, installation previews and venue specific XR sketches.
- [04]tool · LiveKitLiveKit AgentsReference for possible voice guided event discovery, research briefings and cultural assistant interfaces.
- [05]standard · MIT Media LabMIT Media LabInstitutional watch source for responsive rooms, creative AI, spatial media, speculative interfaces and audiovisual research signals.
- [06]paper · arXiv:2309.04509The Power of Sound: Audio Reactive Video Generation with Stable DiffusionInforms future event visuals, sound reactive reels and installation previews.
- [07]paper · arXiv:2208.09579Learning in Audio Visual Context: A Review, Analysis, and New PerspectiveResearch backbone for how sound and image can be coupled in future recommendation or visual systems.
iv · opportunity radar
open calls →Current artist calls now sit in a dedicated board for spatial audio, live AV, media art, installation and artist research opportunities.