Head tracking senses the rotation of the listener's head — via sensors in headphones, earbuds, or a VR headset — and counter-rotates the rendered sound field so that virtual sources stay fixed in the room rather than turning with the head. It is what makes spatial audio feel anchored and believable: turn to look at a character and their voice stays put in front of you, exactly as real sound would. It pairs naturally with scene-based (Ambisonics) audio, which rotates cheaply, and with binaural rendering over headphones. Apple's spatial audio on AirPods popularized it for music and film, and it is essential to convincing VR and AR, where a static soundscape would instantly break the illusion.
The book · Volume 5 of 7
Audio for Video: A Complete Guide to Sound in Video Products: From Jitter Buffers and Lip Sync to Atmos, Quality Metrics, and Neural Codecs
Head tracking is what keeps spatial sound pinned to the room, and latency in the tracking loop is what breaks the illusion. This volume covers head tracking in detail with HRTF, binaural rendering, Ambisonics and Atmos, so you can design spatial audio for VR, AR and headphones that stays anchored. Written by Nikolay Sapunov, CEO at Fora Soft.
Building spatial audio with head tracking for VR, AR or headphones and fighting latency?
Tell us your devices and content and we will propose a head tracking and binaural rendering architecture with a latency budget you can test. 250+ video products shipped since 2005.
