Sampling is the process of turning a continuous real-world signal into discrete values that a computer can store. Light hits a sensor; the sensor samples its brightness at a grid of millions of points; those values become a frame. Time keeps flowing; the camera samples the scene 24 or 30 or 60 times per second; those frames become a video. Every digital video is fundamentally the result of sampling reality at finite resolution in space and in time.

The fundamental constraint on sampling is the nyquist-theorem: you need to sample at least twice as fast as the finest detail you want to capture. Sample slower and the details collapse into aliasing — strange moire patterns, jagged edges, "wagon wheels spinning backwards". This is the root reason 4K cameras don't just produce "more pixels" than 1080p ones; they let you faithfully capture finer real-world details that 1080p sampling would mangle.

For a product team, sampling shows up in three places. Resolution is spatial sampling — more pixels means finer detail capturable. Frame rate is temporal sampling — more frames per second means faster motion capturable cleanly. Chroma subsampling (4:2:0, 4:2:2, 4:4:4) is under-sampling the colour part deliberately, taking advantage of the eye's lower sensitivity to colour detail to save data. All three are about deciding how aggressively to sample reality and where to spend your bandwidth budget. Get the sampling decisions right at capture and the rest of the pipeline is doing fine work; get them wrong and no amount of bitrate later will fix the resulting artefacts.

Book cover: Video Encoding, Volume 1 of the Fora Soft Video Engineering Handbook

The book · Volume 1 of 7

Video Encoding: A Complete Guide to Video Compression — From Pixels and Color to H.264, HEVC, AV1, Quality Metrics, and AI

Sampling sets the frame rate and resolution of everything downstream, and poor sampling choices cannot be fixed later by the encoder. Volume 1 explains sampling in detail: temporal and spatial sampling, the Nyquist limit, aliasing and anti-alias filtering, and chroma subsampling such as 4:2:0 and 4:2:2. Written by Nikolay Sapunov, CEO at Fora Soft.

Read it on Amazon →Kindle & paperback · Fora Soft Video Engineering Handbook

Choosing frame rate, resolution and chroma sampling for a new capture pipeline?

Share your sources and target devices: we recommend sampling settings for capture and encode and show the bitrate and quality impact of each. 250+ video products shipped since 2005.

Book a 30-min call →WhatsApp →Email us →