Golden-reference regression suite tool

A dependency-free (pure standard-library) Python tool that runs the golden-reference regression SUITE this article describes — distinct from 5.5's single-build gate. It loads a FROZEN baseline (the golden master: per-clip, per-rendition VMAF mean and 5th percentile blessed when the suite was created) and a candidate build, and for each reference clip it (1) compares the candidate to the frozen baseline within a NOISE-SIZED tolerance band computed per clip — margin = z * sqrt(model_sigma^2 + run_

Download free PDF
Book cover: Video Streaming, Volume 3 of the Fora Soft Video Engineering HandbookBook cover: Video Encoding, Volume 1 of the Fora Soft Video Engineering HandbookBook cover: AI for Video, Volume 6 of the Fora Soft Video Engineering Handbook

The handbook · 7 volumes

Fora Soft Video Engineering Handbook

This golden-reference regression suite compares each new encoder build against a frozen baseline per clip and rendition, flagging mean and 5th-percentile drops. Our seven-volume handbook covers the video stack; Volume 1 is the place to start for quality metrics, encoder settings and artifacts, with Volume 3 on ABR and QoE and Volume 6 on AI models. Written by Nikolay Sapunov, CEO at Fora Soft.

Browse the handbook on Amazon →7 volumes · 9,000+ pages · Kindle & paperback

Worried a new encoder build will quietly lower quality in production?

Share your encoding pipeline and test clips, and we will set up a regression suite and thresholds your CI can run on every build. 250+ video products shipped since 2005.

Book a 30-min call →WhatsApp →Email us →