6DoF technology in VR/AR enables the user to experience 3D audio/video content in the virtual space by introducing an unlimited number of listening and vantage points. 6DoF gives users the opportunity to navigate through three-dimensional spaces freely by rotating or translating their position. However, to experience the feeling of full immersion in the virtual world, a high-level image must be followed by a realistic sound. Until now, image-related technologies have been developing much faster, leaving the sound far behind. Zylia has made the first attempt to show that 6DoF with an immersive sound experience can be achieved.
"Synthetic 6 Degrees of Freedom audio, combining separate sound recordings into a single simulated sonic space, is very common in video games. What we will present at Mobile World Congress is a novel approach which enables not synthetic, but live recorded navigable 6DoF sound from an actual physical space," explains Tomasz Zernicki, co-founder and chief technology officer of Zylia.
In order to prepare its 6DoF demonstration, Zylia used multiple simultaneous and synchronized Higher Order Ambisonics recordings made with nine ZYLIA ZM-1 microphones evenly spaced in the room. Zylia's work resulted in creating a Unity-based audiovisual system, enabling users to navigate within a simulated 3D space and listen to the 6DoF recordings from different perspectives.
For the purpose of audio recording for 6DoF demonstration, Zylia provided a new product — 6DoF Development Kit, which the company says it will be "an exceptional tool for people experimenting with spatial sound solutions, which could unite audio and video for immersive content."
A single ZYLIA ZM-1 is a 19-capsule microphone array with high-end 24-bit recording resolution, which allows users to record entire sound scenes with just one microphone. Equipped with Infineon's class-leading 69-decibel SNR digital XENSIV MEMS microphones, the microphone array delivers high-fidelity and far-field audio recording. In addition, the array provides multiple microphone noise- and distortion-free audio signals for advanced audio signal processing.
Zylia and Infineon can be found at the Mobile World Congress, Hall 6, Stand 6C41.
www.zylia.co | www.infineon.com
