Masking is the perceptual effect that lossy compression depends on: a loud sound makes nearby quieter sounds inaudible, either in frequency (a strong tone hides softer tones close to it) or in time (a loud transient hides sounds just before and after it). The ear simply doesn't register the masked components, so a codec can quantize them coarsely or discard them entirely without audible loss. Every psychoacoustic model is essentially a masking calculator, estimating a moment-by-moment threshold below which detail can be thrown away. Understanding masking explains why lossy codecs can drop the majority of the data yet sound transparent — they remove what was already inaudible.
The book · Volume 4 of 7
Audio for Video: A Complete Guide to Sound in Video Products: From PCM and Codecs to Loudness, Accessibility, and Real-Time Voice Processing
Auditory masking is the reason lossy codecs can drop most of the data without most listeners noticing. Volume 4 explains masking where codecs use it: psychoacoustic models, frequency and temporal masking, MDCT coding and the AAC and Opus decisions that follow from them. Written by Nikolay Sapunov, CEO at Fora Soft.
Hearing artifacts at low bitrates and want to know where masking runs out?
We will listen to your encodes, find where the codec's masking model breaks down and give you encoder settings that remove the artifacts. 250+ video products shipped since 2005.
