Senior Software Engineer, AIOps
NVIDIA is hiring a Senior Software Engineer, AIOps. Level rates it ; you can apply on NVIDIA.
Level's read on this job
- Level rates this software engineer role Builds AI ●●●●: the job is building AI systems.
- The posting mentions Go, C and Rust among its tools and skills.
- Level classes it as a senior role.
- NVIDIA has 2,600+ other open roles on Level.
AI in this role
Build high-scale distributed observability systems and operationalize predictive AI models for NVIDIA's AIOps platform.
NVIDIA is powering the world's most advanced AI Factories. To ensure their seamless operation, we are building a mission-critical Observability and Prediction platform - delivered as both a high-scale SaaS solution and a robust on-premises deployment for our largest enterprise customers.
We are looking for a Senior Software Engineer to join the AIOps platform team and help build the core distributed systems that ingest massive telemetry streams from GPU clusters and operationalize predictive AI models at scale. You will work at the intersection of high-performance data engineering and production ML, turning research algorithms into reliable, mission-critical software.
What you'll be doing:
Architect and build an agentic AIOps system that autonomously monitors GPU fleet health, aggregates and correlates massive telemetry streams, surfaces intelligent alerts, and orchestrates multi-step diagnostic workflows and corrective actions - powering real-time dashboards, automated root-cause analysis, and proactive incident response.
Research, evaluate, and prototype data storage strategies and data representations across diverse database technologies and modalities, ensuring AI models are trained on high-quality, well-structured data that improves predictive accuracy and generalization.
High-Scale Engineering: Design distributed systems to handle the extreme telemetry density of large-scale AI clusters, ensuring efficient data ingestion, processing, and real-time analysis.
Instrument services with deep observability (metrics, logs, traces) to support rapid debugging and continuous performance improvement.
Build and own the model-serving infrastructure that operationalizes predictive algorithms at scale - packaging, versioning, deploying, and monitoring AI models in both SaaS and on-premises environments.
Contribute to the platform's core libraries and abstractions that accelerate development across the broader AIOps engineering team.
What we need to see:
B.Sc./M.Sc. in Computer Science, Computer Engineering, or a related technical field.
8+ years of software engineering experience building production distributed systems.
Core Systems Programming: Expert-level proficiency in languages such as Go, C++, or Rust, with a focus on high-performance, concurrent architectures.
Solid understanding of Kubernetes and container-based deployments for production services.
Experience deploying, monitoring, and maintaining ML models or data-intensive services in a production environment.
Comfort working in ambiguous, fast-moving environments where the product is still being shaped.
Ways to stand out from the crowd:
Experience building ML model-serving platforms or MLOps tooling (model registries, A/B rollout frameworks, feature stores) at scale.
A track record of taking systems from prototype to stable, production-grade platform serving real enterprise customers.
A "Systems" Thinker: You don't just write software; you understand the full stack, from how data moves across the wire to how it’s processed in a distributed cluster.
Practical Innovation: The ability to simplify complex problems and build internal tools or frameworks that empower other engineering teams to move faster.
With competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you are passionate about building mission-critical systems at the frontier of AI infrastructure, we want to hear from you.
How we rate this
Senior Software Engineer, AIOps at NVIDIA rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in software engineer jobs at this level
Pay
- Typical software engineer job
- $167k
This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs
Questions you could be asked
- How do you monitor a model once it's live, and how do you know it needs retraining?
- Walk me through how you've used Go in your day-to-day work.
- What are the limits of C that you've run into, and how did you work around them?
- What's a project where you used Rust hands-on?
- Walk me through how you've used Kubernetes in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: ML Ops, Go, C, Rust, and Kubernetes. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new software engineer jobs (Builds AI ●●●●) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step