One-page planner: the fixed pipeline stages with their typical millisecond costs (capture, codec, network, relay/SFU, jitter buffer, decode, render), the AI-inference reference numbers (on-device segmentation, streaming ASR, streaming TTS, voice-to-voice), the speed-of-light geography tax (~10 ms RTT per 1,000 km), the ITU-T G.114 perception zones, and the on-device / edge / cloud placement rule.
Download free PDF
The book · Volume 7 of 7
AI for Video: A Complete Guide to Intelligence in Video Products: From Real-Time Pipelines and Agents to Serving, Cost, Compliance, and Verticals
This real-time AI latency budget worksheet lists fixed pipeline stage costs, AI inference reference numbers, the geography tax and the ITU-T G.114 perception zones in one planner. Volume 7 covers this topic in depth: call latency and where AI fits in a WebRTC pipeline, live captions and translation, serving with vLLM, Triton and TensorRT, and cost per stream-hour. Written by Nikolay Sapunov, CEO at Fora Soft.
Need your real-time AI feature to fit inside a conversational latency budget?
Share your pipeline and regions, and we will build the latency budget with you and point to the stages worth optimizing first. 250+ video products shipped since 2005.