Director, Engineering – Software Engineering and AI Inferencing Platforms

NVIDIA is hiring a Director, Engineering – Software Engineering and AI Inferencing Platforms in Hanoi, Vietnam. Level rates it ; you can apply on NVIDIA.

Level's read on this job

Builds AI ●●●● is how Level rates this role: the job is building AI systems.
The posting mentions RAG among its tools and skills.
Level classes it as an executive role.
NVIDIA has 2,700+ other open roles on Level.

AI in this role

rag

NVIDIA is widely recognized as one of the world’s most desirable employers, leading groundbreaking innovation in Artificial Intelligence (AI), High-Performance Computing (HPC), and Visualization. Our technologies, including the GPU, have transformed industries—from AI Inferencing and AI factory Optimization, and design to data science. Due to continued growth, NVIDIA Vietnam R&D Center (VRDC) is expanding its engineering leadership to accelerate our AI data and factory platform initiatives.

What You’ll Be Doing:

Build, lead and scale world-class engineering teams in Vietnam, collaborating with global counterparts across system software, data science, and AI platforms.
Drive the design, architecture, and delivery of high-performance system software platforms that power NVIDIA’s AI products and services.
Partner with global teams across Machine Learning, Inference Services, and Hardware/Software integration to ensure performance, reliability, and scalability.
Oversee the development and optimization of AI delivery platforms in Vietnam, including NIMs, Blueprints, and other flagship NVIDIA services.
Engage with open-source and enterprise data and workflow ecosystems (e.g., Temporal, Gitlab DevOps Platform, RAPIDS, NeMo Curator, Morpheus) to advance accelerated AI factory, data science and data engineering workloads.
Champion continuous integration, continuous delivery, and engineering best practices across multi-site R&D Centers.
Collaborate with product management and cross-functional stakeholders to ensure enterprise readiness and customer impact.
Develop and deploy standard processes for large-scale, distributed system testing, encompassing stress, scale, failover, and resiliency testing.
Ensure security and compliance testing aligns with industry standards for cloud and data center products.
Mentor and develop talent within the organization, fostering a culture of quality and continuous improvement.

What We Need to See:

Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, or related field.
15+ overall years of software engineering experience with 6+ years in senior leadership roles.
Proven record of managing large, high-performing software teams and delivering complex AI/ML or data-driven products.
Expertise in cloud, data, and accelerated computing technologies (e.g., Spark, Kubernetes, Dask, Python ecosystem, CUDA).
Experience collaborating with open-source communities and enterprise partners.
Strong leadership, communication, and cross-functional coordination skills.
Strategic mindset with hands-on technical depth in AI, system software, or large-scale data platforms.

Ways to Stand Out from the Crowd:

Experience building and scaling AI/ML Inferencing platforms from concept to production.
Background in GPU programming, CUDA optimization, or system performance engineering.
Deep understanding of microservices, distributed systems, and high-performance data architectures.
Contributions to open-source projects or developer ecosystems.
Knowledge of deep learning, RAG, embeddings, or modern text search frameworks.

At NVIDIA, you’ll join a team of world-class innovators shaping the future of computing. Our Vietnam R&D Center is a key part of NVIDIA’s global AI and Software Engineering ecosystem—collaborating across continents to deliver groundbreaking products that redefine what’s possible. If you’re a creative, driven engineering leader passionate about building technology that changes the world, we’d love to hear from you.

How we rate this

Director, Engineering – Software Engineering and AI Inferencing Platforms at NVIDIA rates 92 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Director, Engineering – Software Engineering and AI Inferencing Platforms is an open job at NVIDIA.
Level rates this role AI Level 4 of 4: Builds AI.
The role is based in Vietnam, Hanoi.
The job was posted on November 5, 2025.
Seniority: executive.
Applications are handled by NVIDIA. Apply on NVIDIA

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

RAG

Questions you could be asked

How would you design a retrieval step so the model answers from real data instead of guessing?
How would you decide a model or AI system is ready to ship?
Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

List these exact terms on your resume: RAG. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email within 3 days.

Get a free CV review Check your resume with the ATS resume checker