DRA vs Device Plugins: When to Migrate and What You Gain
— kubernetes, dra, device-plugins, gpu, scheduling
LeaderWorkerSet: Serving Models Too Big for One Node
— kubernetes, lws, llm, inference, gpu, distributed
— kubernetes, dra, device-plugins, gpu, scheduling
— kubernetes, lws, llm, inference, gpu, distributed