A dependency-light Python script (standard library only) that turns a ratings matrix into a defensible result. It computes (1) each clip's MOS with its 95% confidence interval both ways — the ITU-R BT.500-15 normal multiplier 1.96 and the ITU-T P.910 Student's-t multiplier correct for small panels; (2) the SOS-hypothesis parameter a (Hossfeld/Schatz/Egger 2011) as a sanity check on subject disagreement; (3) a significance test between two conditions, paired (same subjects) or two-sample, reporti
Download free PDF

The handbook · 7 volumes
Fora Soft Video Engineering Handbook
This subjective-statistics calculator turns a ratings matrix into MOS with confidence intervals, an SOS sanity check and significance tests between conditions. Our seven-volume handbook covers where those scores are used: Volume 1 on quality metrics and how codecs are compared, Volume 3 on QoE in delivery, and Volume 6 on the ML basics behind AI quality models trained on such ratings. Written by Nikolay Sapunov, CEO at Fora Soft.
Running a subjective video quality study and need defensible statistics?
Send us your ratings data or test plan: we return the MOS analysis, confidence intervals and a clear verdict on which condition wins. 250+ video products shipped since 2005.