https://evalsocket.devGatsbyJSSun, 06 Sep 2026 16:22:07 GMThttps://evalsocket.dev/blog/kueue-deep-divehttps://evalsocket.dev/blog/kueue-deep-diveWed, 02 Sep 2026 00:00:00 GMT<p>Kubernetes has a scheduler, but it has no queue. Submit more jobs than the cluster can run and it does not line them up; it admits them all,…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/kueue-deep-dive">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/k8s137https://evalsocket.dev/blog/k8s137Wed, 26 Aug 2026 00:00:00 GMT<p>Kubernetes 1.37, named after the Garhwal Himalaya, is a housekeeping release with one clear specialty: device management. Dynamic Resource…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/k8s137">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/go-1-27-deep-divehttps://evalsocket.dev/blog/go-1-27-deep-diveWed, 19 Aug 2026 00:00:00 GMT<p>Go 1.27 is a bigger language release than most. After years of the restriction standing, methods can now declare their own type parameters…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/go-1-27-deep-dive">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/gang-scheduling-1-35-1-36https://evalsocket.dev/blog/gang-scheduling-1-35-1-36Tue, 04 Aug 2026 00:00:00 GMT<p>A distributed training job needs all its pods or none. If the scheduler places half a gang and the rest cannot fit, those pods sit idle…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/gang-scheduling-1-35-1-36">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/api-priority-and-fairnesshttps://evalsocket.dev/blog/api-priority-and-fairnessThu, 16 Jul 2026 00:00:00 GMT<p>When the API server is overloaded, the question is not just how many requests it drops but which ones. If a runaway controller's list…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/api-priority-and-fairness">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/jobset-distributed-traininghttps://evalsocket.dev/blog/jobset-distributed-trainingTue, 30 Jun 2026 00:00:00 GMT<p>Distributed training runs many pods that must find each other, start together, and be treated as one job. A plain Kubernetes Job does not…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/jobset-distributed-training">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/apiserver-at-scalehttps://evalsocket.dev/blog/apiserver-at-scaleTue, 26 May 2026 00:00:00 GMT<p>The kube-apiserver is the one component everything else talks to, and on a large cluster it is usually the first thing to fall over. It goes…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/apiserver-at-scale">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/dra-vs-device-pluginshttps://evalsocket.dev/blog/dra-vs-device-pluginsWed, 06 May 2026 00:00:00 GMT<p>If you run GPUs on Kubernetes, you have two ways to expose them: the device plugin API, which has been around for years, and Dynamic…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/dra-vs-device-plugins">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/k8s136https://evalsocket.dev/blog/k8s136Wed, 22 Apr 2026 00:00:00 GMT<p>Kubernetes 1.36 is a cleanup and maturation release with two genuinely useful graduations: Pressure Stall Information (PSI) metrics and user…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/k8s136">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/lws-multi-node-inferencehttps://evalsocket.dev/blog/lws-multi-node-inferenceTue, 24 Mar 2026 00:00:00 GMT<p>Some models no longer fit on one machine. Llama 3.1 405B needs on the order of 800 GB of GPU memory, which is more than a single 8-GPU node…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/lws-multi-node-inference">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/kubelet-pod-startuphttps://evalsocket.dev/blog/kubelet-pod-startupWed, 11 Mar 2026 00:00:00 GMT<p>A pod is Scheduled, then it sits in ContainerCreating for a while, then it runs. What happens in that gap is the kubelet's job, and when a…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/kubelet-pod-startup">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/kube-scheduler-pluginhttps://evalsocket.dev/blog/kube-scheduler-pluginWed, 18 Feb 2026 00:00:00 GMT<p>The default scheduler is good, but sometimes you need placement logic it does not have: prefer nodes with a warm cache, avoid nodes running…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/kube-scheduler-plugin">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/go-1-26-deep-divehttps://evalsocket.dev/blog/go-1-26-deep-diveTue, 10 Feb 2026 00:00:00 GMT<p>Picture the version bump landing on a production Go service you own: an allocation-heavy API that burns real CPU inside the garbage…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/go-1-26-deep-dive">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/writing-a-dra-driverhttps://evalsocket.dev/blog/writing-a-dra-driverTue, 27 Jan 2026 00:00:00 GMT<p>Dynamic Resource Allocation (DRA) is how Kubernetes now handles GPUs and other specialized devices. Instead of a fixed integer count like nv…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/writing-a-dra-driver">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/k8s135https://evalsocket.dev/blog/k8s135Wed, 17 Dec 2025 00:00:00 GMT<p>The question that matters for Kubernetes 1.35 is simple: should you take the upgrade now? The case for yes is one clearly useful feature. In…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/k8s135">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/k8s134https://evalsocket.dev/blog/k8s134Wed, 27 Aug 2025 00:00:00 GMT<p>Kubernetes 1.34 is a consolidation release. The headline is that Dynamic Resource Allocation (DRA), the new way to request GPUs and other…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/k8s134">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/go125https://evalsocket.dev/blog/go125Wed, 13 Aug 2025 00:00:00 GMT<p>Go 1.25 shipped on August 12, 2025. There is almost nothing new in the language, and that is the point. The interesting work is in the…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/go125">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/k8s133https://evalsocket.dev/blog/k8s133Tue, 12 Aug 2025 00:00:00 GMT<p>Kubernetes v1.33, named "Octarine" after Terry Pratchett's Discworld, shipped on April 23, 2025 with 64 enhancements: 18 to stable, 20 to…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/k8s133">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/rayiohttps://evalsocket.dev/rayioFri, 01 Aug 2025 00:00:00 GMT<p>Python is the language of machine learning, but the Global Interpreter Lock (GIL) and a single-node design cap how far a plain Python…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/rayio">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/go-124-deep-divehttps://evalsocket.dev/blog/go-124-deep-diveTue, 11 Feb 2025 00:00:00 GMT<p>Go 1.24 shipped on February 11, 2025. It is a small language release and a large standard-library and tooling release, which is the shape of…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/go-124-deep-dive">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/eks-okta-oidchttps://evalsocket.dev/blog/eks-okta-oidcTue, 14 Jan 2025 00:00:00 GMT<p>Your team runs several EKS clusters. Engineers share IAM credentials or assume the same role, audit logs show generic principals, and when…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/eks-okta-oidc">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/golang-generics-deep-divehttps://evalsocket.dev/blog/golang-generics-deep-diveTue, 14 Jan 2025 00:00:00 GMT<p>Go added generics in 1.18, after years of debate about whether it should at all. If you are newer to Go, generics can look intimidating, so…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/golang-generics-deep-dive">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/kubernetes-architecture-deep-divehttps://evalsocket.dev/blog/kubernetes-architecture-deep-diveTue, 14 Jan 2025 00:00:00 GMT<p>Most people learn Kubernetes as a set of YAML recipes. This post is about the machine underneath: what each control-plane component does…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/kubernetes-architecture-deep-dive">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/blog/vllm-kubernetes-deep-divehttps://evalsocket.dev/blog/vllm-kubernetes-deep-diveTue, 14 Jan 2025 00:00:00 GMT<p>vLLM is the most widely used engine for serving open large language models (LLMs), because it makes GPU memory go much further and keeps the…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/blog/vllm-kubernetes-deep-dive">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/bufhttps://evalsocket.dev/bufWed, 21 Feb 2024 00:00:00 GMT<p>I have maintained Protocol Buffers at Flyte and consumed them across services at Union. The schema was never the hard part. The hard part…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/buf">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/kyverno-generate-policy-part-2https://evalsocket.dev/kyverno-generate-policy-part-2Mon, 28 Sep 2020 00:00:00 GMT<p>Part 1 covered the basics of Kyverno generate rules: creating and synchronizing resources across namespaces. This part covers a more…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/kyverno-generate-policy-part-2">Keep reading</a>.</strong></div><br /> <br />https://evalsocket.dev/kyverno-generate-policyhttps://evalsocket.dev/kyverno-generate-policyFri, 24 Jul 2020 00:00:00 GMT<p>Kyverno is a policy engine built for Kubernetes. It runs as an admission controller that validates and mutates incoming resources, and it…</p><div style="margin-top: 50px; font-style: italic;"><strong><a href="https://evalsocket.dev/kyverno-generate-policy">Keep reading</a>.</strong></div><br /> <br />