Skip to content
Yuvraj 🧢
Github - yindiaGithub - tqindiaContact

Most of these posts were written to be read in order. Below are the reading paths I would follow to go from the basics to the deep end of each topic. Each one links the posts in the sequence that builds on itself.

Kubernetes scheduling and batch

How pods get placed, and how batch and machine-learning jobs get their all-or-nothing guarantees. Start here if you run training jobs or GPU workloads on a shared cluster.

  1. Kubernetes architecture deep dive: the control plane, the data plane, and the reconcile loop that ties them together.
  2. Writing a kube-scheduler plugin: one scheduling cycle, and where you can hook into it.
  3. Writing a DRA driver: how dynamic resource allocation hands devices to pods.
  4. DRA versus device plugins: the two GPU models, and when to move.
  5. Gang scheduling in 1.35 and 1.36: why a half-placed job deadlocks, and the three ways to get all-or-nothing.
  6. JobSet for distributed training: the job shape a multi-node training run actually needs.
  7. Kueue deep dive: the queue, quota, and fair sharing Kubernetes never had.

Control plane at scale

What happens between a pod being scheduled and a pod running, and how the API server survives a large cluster. Start here if you operate clusters and chase latency or outages.

  1. How the kubelet actually starts a pod: the exact order from scheduled to running.
  2. API server survival guide at scale: the failure loop, and the features that broke it.
  3. API Priority and Fairness: keeping critical requests flowing when the API server is overloaded.

GPU inference on Kubernetes

Serving large models when one GPU, or one node, is not enough. Start here if you deploy inference.

  1. vLLM on Kubernetes: why vLLM is fast, and how to serve it.
  2. LeaderWorkerSet for multi-node inference: running one model across many nodes.

Go, release by release

Each Go release, read for what actually changes in production code.

  1. Go 1.24 deep dive
  2. Go 1.25 deep dive
  3. Go 1.26 deep dive
  4. Go 1.27 deep dive