NVIDIACloud Services Software Engineer
NVIDIA is hiring a Cloud Services Software Engineer in Santa Clara, United States. It pays $152k-$242k a year and Level rates it ; you can apply on NVIDIA.
Level's read on this job
- Builds AI ●●●● is how Level rates this software engineer role: the job is building AI systems.
- Tools and skills the posting cites include PyTorch, TensorFlow and JAX.
- Level classifies it as a senior role.
- Level lists 2,700+ other open roles at NVIDIA.
- The role was posted in the last few days.
AI in this role
Develop and optimize infrastructure software, APIs, and microservices to power large-scale AI training workflows on NVIDIA DGX Cloud.
Joining NVIDIA's DGX Cloud Team means contributing to the infrastructure that powers our innovative AI research. This team focuses on optimizing efficiency and resiliency of ML workloads, as well as developing scalable AI infrastructure tools and services. Our objective is to deliver a stable, scalable environment for AI researchers, providing them with the vital resources and scale to champion innovation.
We are seeking a distributed software engineer to join our team! As a Senior engineer, you'll be instrumental in developing and optimizing AI infrastructure services to bring peak AI performance and high resiliency for DGX Cloud. Your expertise in cloud services software architecture that drives the full resilience stack that will deliver an AI platform that redefines what is possible. This is an exceptional opportunity to push the boundaries of technology and shape the future of AI and the Cloud, and work with a world-class team of like-minded engineers.
What You Will Be Doing:
As a software engineer specializing in backend development, you'll work in a dedicated team to enhance the infrastructure and products that underpin NVIDIA's AI platforms. Your work will be essential in enabling innovative AI research, focusing on:
Developing solutions at the intersection of machine learning, distributed systems, and high-performance computing, supplying to the advancement of AI technologies.
Designing, developing, and optimizing (micro-)services orchestrated by Kubernetes to provide large-scale AI training workflows on AI training supercomputers located at major CSPs, with resiliency and efficiency.
Co-designing and implementing the APIs that allow these services to integrate vertically with NVIDIA's resiliency stacks, ranging from tier-0 telemetry services to break/fix automation services to checkpoint and execution systems.
Crafting a submission abstraction that enables model engineers and training platforms/frameworks to seamlessly submit long-running training jobs while hiding the complexity of handling infrastructure failures, running job lifecycles with auto-restarts on failure, ensuring full efficiency, and promptly advising users.
Crafting these services to be modular, enabling them to be coordinated with and deployed onto on-premises AI clusters that apply NVIDIA Hardware and Cloud services.
What We Need To See:
A Bachelor's degree or higher in Computer Science or a related technical field (or equivalent experience).
5+ years of hands-on experience in backend development, preferably with Python, Go, C/C++, or similar high-performance languages.
Consistent track record of building and scaling large-scale distributed systems.
Experience with cloud computing platforms such as AWS, Azure, and GCP, as well as container technologies like Docker and Kubernetes, and HPC/AI platforms such as Slurm.
Ways to stand out from the crowd:
Real world experience in DL frameworks, orchestrators like PyTorch, TensorFlow, JAX, and Ray
Experience in developing a framework plugin architecture that allows the framework to be integrated with the cluster scheduler visibly to the users
Strong understanding of NVIDIA GPUs, network technologies, and their failure patterns.
Experience with AI models and AI based tools.
Provide references to your code contributions.
NVIDIA leads the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing, and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions, from artificial intelligence to autonomous cars. NVIDIA is looking for exceptional people like you to help us accelerate the next wave of artificial intelligence!
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until October 25, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.How we rate this
Cloud Services Software Engineer at NVIDIA rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in software engineer jobs at this level
Pay
- This job starts at
- $152k
- Typical software engineer job
- $168k
This posting starts 10% below the typical software engineer job. See software engineer jobs
Questions you could be asked
- Tell me about a research question you investigated. What did you find?
- Tell me about a project where distributed systems was part of your work. What did you do?
- Tell me about a project where cloud services was part of your work. What did you do?
- Tell me about a project where high performance computing was part of your work. What did you do?
- Tell me about a project where machine learning infrastructure was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: AI Research, Distributed Systems, Cloud Services, High Performance Computing, and Machine Learning Infrastructure. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new software engineer jobs (Builds AI ●●●●) by email
One email a week with the new software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step