AES Europe 2026

This paper presents the production of a fully volumetric
audiovisual music composition with six degrees of
freedom, featuring a dance performance. The project
realizes the artistic potential enabled by recent
technological
advancements in volumetric video capture; spatial audio
rendering. The interdisciplinary production team
consisted of music composers, dancers, sound engineers,;
experts in 4D Gaussian Splats. An existing 3D body
scanner consisting of 112 cameras was used to capture a
dance performance in high definition video. For the
visual scene, custom 4D Gaussian Splat algorithms were
developed; employed to create the dynamic model.
Additional static 3D Gaussian Splats were captured with the
same scanner; integrated into the scene in Unity.
The acoustic scene is dynamically binauralized via SPAT
Revolution, depending on the position of the listener
in the virtual space. Audio; video scenes are run on
separate PCs, synchronized via OSC; presented via
commercially available head-mounted displays (HMDs).
Audiences report a high level of immersion at the initial
presentation at an exhibition event. A detailed evaluation
is planned in the near future. Furthermore, a unified
application for both visual; audio scenes is planned in
order to reach a wider audience.