Build and scale software infrastructure for GPU asset provisioning, data center management, monitoring, lifecycle automation, and distributed system testing. Develop reliable platforms across hardware, networking, cloud providers, and AI training applications. Work with GPU diagnostics, cluster and network telemetry, Kubernetes or SLURM, fault tolerance, state management, and system architecture to support large-scale machine learning infrastructure.
Join a team of engineers at NVIDIA dedicated to scaling the AI infrastructure that powers cutting-edge data science applications. Our team solves complex challenges across datacenter hardware, networking, distributed systems, and software deployment. We collaborate closely to design and deliver leading infrastructure solutions. We value strong technical foundations paired with creative thinking and a bias toward execution. Together, we continuously push boundaries, grow our skills, and advance NVIDIA’s capacity to build and deploy AI-based infrastructure at scale.
What you will be doing:
- Contribute to a comprehensive platform that automates GPU asset provisioning, configuration, and lifecycle management across cloud providers.
- Build end-to-end automation of data center management, break/fix, and the full span of system upkeep for large-scale Machine Learning systems.
- Implement monitoring and health management capabilities that enable industry-leading reliability, availability, and scalability of GPU assets.
- Harness multiple data streams, ranging from GPU hardware diagnostics to cluster and network telemetry.
- Build automated test infrastructure that we use to qualify distributed systems for operation.
- Partner with engineering teams across NVIDIA to ensure the software integrates seamlessly from the hardware all the way up to the AI training applications.
What we need to see:
- 5+ years of experience in a similar role working on large-scale production systems.
- BS in Computer Science/Engineering/Physics/Mathematics or other comparable degree, or equivalent experience.
- Expert level knowledge of a systems programming language (Go, Python, and/or Rust) and a solid understanding of Data Structures and Algorithms.
- Strong background in Linux system administration and management.
- Deep knowledge of container orchestration platforms such as Kubernetes and/or SLURM.
- Understanding of performance, security, and reliability in complex distributed systems.
- Familiarity with system level architecture, data synchronization, fault tolerance, and state management.
Ways to stand out from the crowd:
- Proficiency in designing and building widespread distributed networks.
- Experience managing large-scale distributed systems independently of cloud providers.
- Extensive expertise in datacenter operations and GPU hardware.
- Hands-on experience working with RDMA networking.
- Advanced hands-on experience and deep understanding of cluster management systems (Kubernetes, SLURM).
You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
Similar Jobs
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Build and operate automation and tooling for large-scale NVIDIA GPU infrastructure. Responsibilities include bare-metal provisioning, hardware validation, firmware and software upgrades, cluster lifecycle management, BMC and Redfish integration, failure diagnosis, automated recovery, production handoff, on-call support, incident response, and root-cause analysis across hardware, networking, Linux, Kubernetes, and distributed services.
Top Skills:
Argo CdBluefield-3 DpuBmcFirmware ManagementGitopsGoInfinibandKubernetesLinuxNetwork BootNvidia Nvl72NvlinkPythonRedfishSlosSpectrum-X
Artificial Intelligence • Cloud • Consumer Web • Productivity • Software • App development • Data Privacy
Own scalable customer programs from planning and recruitment through launch, engagement, measurement, closeout, and handoff. Coordinate Product, Design, Research, Marketing, Customer Success, Sales, and Analytics teams. Lead pre-PMF product testing, relaunch the Customer Advisory Board, integrate customer testing into launch-readiness processes, and establish repeatable customer insight loops and operating playbooks.
Big Data • Fintech • Mobile • Payments • Financial Services
Build and maintain scalable backend platforms for capital orchestration, including transaction reconciliation, data pipelines, cash movement workflows, and business-user experiences. Collaborate with product, design, analytics, and engineering partners to deliver tested, extensible systems. Support code quality, monitoring, operational availability, on-call activities, and phased project delivery while developing expertise in Affirm’s capital systems.
Top Skills:
AirflowHorizon PortalJavaScriptPythonReactSparkSQL
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
