A GPU performs the many simultaneous multiplications neural networks need, far faster than a CPU. Whether you rent GPUs in the cloud or buy them, their cost and scarcity are usually the largest line item in an AI video budget.
Definition
Graphics Processing Unit — the parallel chip that runs almost all modern AI. GPU availability and price dominate the cost of self-hosting models.
A GPU performs the many simultaneous multiplications neural networks need, far faster than a CPU. Whether you rent GPUs in the cloud or buy them, their cost and scarcity are usually the largest line item in an AI video budget.
Also known as
accelerator, graphics card
Specialist software house for video, real-time and AI products. Founded 2005. 50 in-house engineers.
