Harmonic-mean pooling collapses per-frame scores into one number by averaging their reciprocals, which mathematically drags the result toward the low values and so weights bad frames more heavily than the arithmetic mean. For a clip of 270 frames at VMAF 95 and 30 frames at VMAF 30, the arithmetic mean reads 88.5 while the harmonic mean reads 78.1, more than ten points lower, because the bad second now counts for more. It is a gentle correction rather than a worst-case alarm: the score still reflects the whole clip, but the low frames get a louder vote, which better matches the human tendency to weight the worst moments. The sharp edge to know is zero scores. Because the method sums reciprocals, a single frame at exactly zero makes one term 1/0 and the pool blows up, so implementations quietly shift zero and near-zero scores to a small positive value; when much of a clip is broken, prefer percentile pooling or the minimum, which have no division to break.

Book cover: Video Streaming, Volume 3 of the Fora Soft Video Engineering HandbookBook cover: Video Encoding, Volume 1 of the Fora Soft Video Engineering HandbookBook cover: AI for Video, Volume 6 of the Fora Soft Video Engineering Handbook

The handbook · 7 volumes

Fora Soft Video Engineering Handbook

Harmonic-mean pooling lets a few bad seconds pull the overall score down, which is closer to how viewers remember a session than a plain average. We wrote seven volumes covering the whole video stack, and for pooling start with Volume 1: VMAF and per-frame metrics, rate control and the scenes that break encodes, with Volume 3 on QoE monitoring. Written by Nikolay Sapunov, CEO at Fora Soft.

Browse the handbook on Amazon →7 volumes · 9,000+ pages · Kindle & paperback

Your average VMAF looks good, but are short quality dips hiding inside it?

Share per-frame scores from a few encodes: we compare harmonic-mean pooling with your current summary and set thresholds that catch the bad seconds. 250+ video products shipped since 2005.

Book a 30-min call →WhatsApp →Email us →