NVIDIAPosted 3w ago
Senior MLOps Engineer - DSX Enablement at NVIDIA scores 90 out of 100 on AI centrality, which makes it AI Level 4 of 4 (Builds AI) on this board. The level measures how much of the work is AI, not seniority.
AI in this role
Develop advanced AI infrastructure, distributed training pipelines, and optimization tools for large-scale production workloads.
NVIDIA is seeking a Senior MLOps Engineer to join our DSX Enablement team, collaborating closely with strategic customers to implement and enhance groundbreaking AI workloads. We partner with the world's most innovative AI companies and open-source communities to address their most challenging technical problems.
What you will be doing:
In this role, you will develop innovative solutions that advance AI infrastructure capabilities, advise infrastructure experts on the demands of ML workloads, help practitioners diagnose and solve full-stack AI and ML system problems, and work on a team with direct responsibility for the success of internal and external customers’ AI and ML initiatives, including LLM performance evaluation and supporting new hardware in open-source frameworks. You will:
Build and deploy custom AI solutions on NeoCloud platforms and NVIDIA Cloud Partners (NCPs), including distributed training, inference optimization, and MLOps pipelines,
Act as a primary technical contact for internal and external customers and partners, guiding joint engagements, ensuring the success of initiatives on DGX Cloud, and solving complex problems in production,
Work closely with the teams building the infrastructure software and accelerated frameworks that support today’s most compelling AI applications,
Profile and tune large-scale training and inference workloads on NCP platforms, leading efforts to reduce latency, cost, and operational risk, and
Develop open-source tools and reference architectures to make it easier to build and manage machine learning and AI workloads, pipelines, and systems at scale.
What we need to see:
BS, MS, or Ph.D. in Computer Science, Computer/Electrical Engineering, or a related technical field, or equivalent experience.
8+ years of experience in technical roles such as data science, data engineering, or ML engineering, ideally targeting large‑scale production systems.
Demonstrated AI/ML experience across multiple phases of the machine learning lifecycle, from exploratory analysis to production systems.
Facility with systems topics including Linux, batch schedulers, Kubernetes, distributed filesystems, and advanced networking at datacenter scale.
Solid scripting and programming skills in languages like bash and Python and solid systems programming skills in a language like C++, Go, or Rust.
Experience using machine learning or deep learning frameworks for training and inference.
Excellent communication and technical presentation skills, with the ability to clearly articulate architectures, trade‑offs, and recommendations to both engineering and leadership audiences.
A clear record of engineering discipline and execution on interesting projects, whether you’re working alone or collaborating on a team.
Ways to stand out from the crowd:
Experience contributing to and working in open-source communities.
Experience with the NVIDIA ecosystem, including DGX systems, CUDA, NeMo, RAPIDS, Triton, NIM, and NVIDIA networking technologies such as InfiniBand, NVLink, and RoCE.
Experience and familiarity building machine learning systems in a security-critical environment and distributed training and inference frameworks.
Familiarity with MLOps practices in a cloud‑native context: containerization, CI/CD pipelines, workflow automation, observability stacks, and GitOps workflows.
Direct experience drawing on deep systems knowledge to diagnose and fix performance or correctness problems that span multiple layers of the application stack, like hardware, networking, accelerator, hypervisor or OS, compilers or runtimes, application code, and libraries.
NVIDIA offers competitive salaries and a generous benefits package. It is recognized as one of the technology world’s most desirable employers. We have some of the most innovative and dedicated people working here. Due to rapid growth, our outstanding teams are expanding quickly. Join us to make a lasting impact on the world!
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- How do you monitor a model once it's live, and how do you know it needs retraining?
- Tell me about a project where mlops was part of your work. What did you do?
- Tell me about a project where distributed training was part of your work. What did you do?
- Tell me about a project where inference optimization was part of your work. What did you do?
- Tell me about a project where llm evaluation was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: Ml Ops, Mlops, Distributed Training, Inference Optimization, and Llm Evaluation. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.
Want your resume actually rewritten for this job?
The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.
Similar roles
Software Engineering roles rated AI Level 4 at other companies.
DatabricksNew York City, New York$200k-$265k4h ago
MercorSan Francisco$250k-$500k4h ago
WaymoMountain View, CA, USA$85/hr4h ago
Anduril IndustriesCosta Mesa, California, United States; Seattle, Washington, United States; Washington, District of Columbia, United States$191k-$253k6h ago
TuringHyderabad, Telangana, India11h ago
Sword HealthRemote · Remote - Portugal€50k-€72k14h ago
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step





