Skip to main content

One post tagged with "Debugging"

Root cause analysis and debugging techniques

View all tags

Finding a Regression in NVIDIA Container Toolkit 1.20.0

· 5 min read
Tanmay Mohan
Cloud Physicist

GPU workloads on our EKS clusters started failing after a routine node group upgrade. The error was cryptic: nvidia.com/gpu resource not found on nodes that clearly had GPUs. Every GPU pod stuck in Pending. This is the story of finding and reproducing a regression in NVIDIA Container Toolkit 1.20.0 that shipped in the EKS NVIDIA AMI v20260818.