Insertable Streams (with Encoded Transform) exposes raw frames in the WebRTC pipeline so a web app can run a model on them before they are sent or shown. It is how background blur, virtual backgrounds, and AR effects integrate client-side into a live call.
The book · Volume 7 of 7
AI for Video: A Complete Guide to Intelligence in Video Products: From Real-Time Pipelines and Agents to Serving, Cost, Compliance, and Verticals
Insertable Streams is how a web app runs a model on every frame of a live call, and each millisecond spent there adds to call latency. This volume covers Insertable Streams in context: where AI plugs into a WebRTC pipeline, call latency budgets, client-side effects, and serving trade-offs. Written by Nikolay Sapunov, CEO at Fora Soft.
Building in-call AI effects with Insertable Streams in the browser?
Tell us the effect and target browsers, and we will design the Insertable Streams pipeline with a frame-time budget and device performance targets. 250+ video products shipped since 2005.