Live captions transcribe speech as it happens and display it with minimal delay, often fanned out from the SFU so everyone shares one transcription. Accuracy, latency, and speaker labelling determine whether they help or distract.
The book · Volume 7 of 7
AI for Video: A Complete Guide to Intelligence in Video Products: From Real-Time Pipelines and Agents to Serving, Cost, Compliance, and Verticals
Live captions help only when they keep pace with speech and label speakers correctly. This volume covers live captions in depth: SFU-side ASR fan-out, live translation, call latency budgets, where AI plugs into a WebRTC pipeline, and cost per stream-hour. Written by Nikolay Sapunov, CEO at Fora Soft.
Adding live captions to calls or broadcasts?
Tell us your languages and audience size, and we will design the live captions pipeline with ASR choice, caption delay targets and cost per hour. 250+ video products shipped since 2005.