Distributed Systems

Kubernetes Is Turning Into the Resource Operating System for AI Clusters

Kubernetes v1.37 schedules devices, gangs, quotas and inference requests, not just Pods. A walkthrough of DRA, PodGroup, Kueue, JobSet, LWS and the inference gateway.