Instance segmentation gives each separate object its own pixel mask, so two overlapping people get two distinct silhouettes. It is detection and segmentation at once, used where you must isolate and act on each object individually.
The book · Volume 6 of 7
AI for Video: A Complete Guide to Intelligence in Video Products: From Models and Inference to Computer Vision, Speech, Search, and Generative Video
Instance segmentation separates each person or object into its own mask, which is what rotoscoping and per-object effects need. This volume covers instance segmentation in detail: segmentation models including SAM 2, detection and tracking, mask propagation across frames, and deployment topologies. Written by Nikolay Sapunov, CEO at Fora Soft.
Need instance segmentation that stays stable across video frames?
Send us sample clips, and we will benchmark instance segmentation models for mask quality, temporal stability and speed on your hardware. 250+ video products shipped since 2005.
