Principal Site Reliability Engineer
NVIDIA is hiring a Principal Site Reliability Engineer in Santa Clara, United States. It pays $248k-$397k a year and Level rates it ; you can apply on NVIDIA.
Level's read on this job
- Level rates this role Works on AI ●●●○: the daily work is on AI products, without building the model.
- Tools and skills the posting cites include AI agents and AI automation.
- Level classifies it as a lead role.
- Level lists 2,700+ other open roles at NVIDIA.
AI in this role
Site Reliability Engineering (SRE) at NVIDIA is an engineering discipline focused on designing, building, and operating large-scale production systems with exceptional efficiency, resilience, and availability. It combines software and systems engineering practices with deep expertise across distributed systems, networking, cloud infrastructure, Kubernetes, databases, capacity management, continuous delivery, and observability. SRE at NVIDIA ensures that our internal and external services achieve their reliability and performance objectives while enabling developers to deliver changes safely and rapidly. Our engineers automate repetitive operational work, improve system performance, build scalable platforms, and continuously strengthen the reliability of production environments.
As a Principal SRE, you will shape the technical direction of NVIDIA’s AI Platform Runtime and lead reliability engineering initiatives spanning multiple organizations. You will solve complex, ambiguous problems at enterprise scale, establish architectural standards, and influence how teams design and operate critical AI-powered services. You will also advance the use of AI agents and skills to transform platform operations and developer productivity. Our SRE culture values intellectual curiosity, diversity of thought, collaboration, and learning through blameless analysis. We encourage engineers to think boldly, take thoughtful risks, and lead meaningful improvements across organizational boundaries.
What you’ll be doing:
Define and drive the long-term technical vision, architecture, and roadmap for reliability across NVIDIA’s AI Platform Runtime and related enterprise systems.
Architect highly available, resilient, secure, and scalable distributed platforms that power NVIDIA’s next-generation AI-driven products and services.
Lead the design and development of AI agents, AI skills, and intelligent automation that accelerate platform operations, incident response, troubleshooting, and remediation.
Establish platform-wide reliability standards, including service-level objectives, error budgets, capacity models, resilience patterns, and operational readiness requirements.
Identify systemic risks and lead cross-functional programs that improve availability, scalability, performance, security, and developer productivity.
Advance observability across complex distributed environments through OpenTelemetry, metrics, logs, traces, profiling, analytics, and automated anomaly detection.
Partner with senior leaders and engineers across Cloud, Platform, Security, Networking, and AI/ML organizations to make high-impact architectural and investment decisions.
Provide technical leadership during critical incidents and ensure that lessons from incidents translate into durable engineering and organizational improvements.
Develop reference architectures, shared platform capabilities, and automation frameworks that can be adopted across multiple engineering organizations.
Influence, mentor, and raise the technical bar for senior engineers and technical leaders throughout the company.
What we need to see:
15+ years of experience in Site Reliability Engineering, Platform Engineering, Distributed Systems, Cloud Architecture, or related infrastructure engineering roles.
BS or MS degree in Computer Science or a related technical field involving significant software development, or equivalent experience.
Demonstrated experience setting technical strategy and leading large-scale engineering initiatives across multiple teams or organizations.
Deep expertise in distributed systems architecture, networking, Linux, Kubernetes, and public cloud platforms such as AWS, Azure, or GCP.
Strong proficiency in one or more programming languages such as Python, Go, TypeScript, JavaScript, or Java, with experience building production-grade automation and platform software.
Extensive experience with infrastructure-as-code and platform automation technologies such as Terraform, Crossplane, AWS CDK, AWS CloudFormation, or equivalent tools.
Deep understanding of observability at scale, including OpenTelemetry and modern metrics, logging, tracing, profiling, and analytics platforms.
Expertise in reliability engineering practices, including service-level objectives, error budgets, capacity planning, fault tolerance, disaster recovery, incident management, and blameless postmortems.
A track record of delivering measurable improvements in availability, performance, operational efficiency, or engineering productivity within complex environments.
Outstanding technical judgment, communication, and collaboration skills, with the ability to influence senior stakeholders across technical and organizational boundaries.
Ways to stand out from the crowd:
Experience designing or operating large-scale AI/ML platforms, GPU infrastructure, inference systems, training environments, or high-performance computing platforms.
Hands-on experience building AI agents, agentic workflows, or intelligent automation for infrastructure and production operations.
Demonstrated success establishing reliability architecture and engineering standards adopted across a large enterprise.
Experience applying machine learning, analytics, or advanced automation to capacity management, anomaly detection, incident response, or autonomous remediation.
Recognized technical leadership through patents, publications, open-source contributions, industry standards, conference presentations, or widely adopted internal platforms.
NVIDIA is leading groundbreaking developments in Artificial Intelligence, High-Performance Computing, and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work creates new possibilities for exploration, creativity, and discovery, powering innovations that once belonged to science fiction—from artificial intelligence to autonomous vehicles. NVIDIA is looking for exceptional technical leaders like you to help architect the reliable platforms that will accelerate the next wave of artificial intelligence.
#LI-Hybrid
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 248,000 USD – 396,750 USD.You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 3, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.How we rate this
Principal Site Reliability Engineer at NVIDIA rates 64 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Tell me about a workflow you automated with AI tools, end to end.
- Describe a typical day in a role like this one: which parts run through AI directly?
- If you removed AI from this role, what would be left, and how do you decide what still needs a human?
Adapt your resume
- List these exact terms on your resume: AI agents and AI Automation. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. You get your review by email within 24 hours.
Get new software engineering jobs (Works on AI ●●●○ or higher) by email
One email a week with the new software engineering jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step