Map/Product Operations and Governance/Production Infrastructure and AI Economics/Inference Infrastructure/Model Serving
Concept lesson

Inference Serving Architecture

How routing batching caching autoscaling and accelerators serve model workloads.

mappedpublicFreshness: current
This branch is mapped for curriculum coverage. Research, lesson, and lab depth will be added in a reviewed release.