Senior Systems Software Engineer - NV Cloud Functions

AI in this role

vllm

NVIDIA Cloud Functions team is looking for a motivated, product-minded AI/ML Engineer with domain expertise in AI platform engineering at scale. Our team builds and operates a serverless deployment platform for enabling AI applications. Our product enables and scales AI inferencing workloads using globally distributed orchestration of workloads on GPU-backed cloud-agnostic Kubernetes clusters. You will be working with a team of passionate and skilled engineers that are continuously innovating at the speed of light to provide the best product possible, for both external customers and internal NVIDIA teams. We are looking for someone to join us at the forefront of defining cloud engineering paradigms for AI at scale.

What You'll be Doing:

Becoming a trusted subject matter expert by understanding user challenges and constraints. Translate this into product requirements and solutions, accelerating delivery of AI models and inference hosted on the NVCF platform.
Leading implementation of key features. Conducting user-acceptance testing, load testing and performance evaluations. Emphasis on customer experience, performance optimization and platform reliability.
Mentoring and embedding with other engineering teams building products on top of our platform on best practices for AI/ML workloads at scale with excellent performance, including ML reliability engineering at scale.
Producing reference architectures to guide customer use cases, applying the newest NVCF product features with the latest AI technologies.
Shepherding customer issues to resolution and providing timely warning of issues and risks.
Evaluating new and innovative technologies and tooling as the AI-at-scale landscape evolves to ensure we have a competitive product and forward-looking roadmap.

What We Need to See:

Masters, PhD, or equivalent experience in Computer Science, Artificial Intelligence, Applied Math, or related field
At least 2 years work experience with Python, Rust, Golang, Linux or Bash.
Experience in Deep Learning and Machine Learning; expertise in using AI/DL frameworks and inferencing software such as SGLang, vLLM, TensorRT-LLM, or Dynamo.
Knowledge of CPU and GPU architecture.
Excellent interpersonal skills including ability to explain sophisticated technical topics to non-experts.
Experience in the design, implementation, and release of AI/ML products to market. A flexible technologist familiar with all aspects of the software development lifecycle.

Ways to stand out from the crowd:

Demonstrate a strong desire to share knowledge with clients, partners and co-workers, able to show this through previous work.
Demonstrate expertise through projects or Open Source contributions in HPC, Data Analytics, Machine Learning, Deep Learning, Cloud Native Projects, Kubernetes, Slurm, or enabling GPU workloads.
Show a willingness and ability to dig into unfamiliar territories to tackle complex problems through examples in previous work.
Prior experience in building distributed systems.

NVIDIA offers highly competitive salaries and a comprehensive benefits package. NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and talented people in the world working for us. Are you a creative engineer with a drive for advancing the state of AI and bringing it to the cloud? If you love to tackle problems and advocate for continuous, innovative improvement, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 10, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

How we rate this

Senior Systems Software Engineer - NV Cloud Functions at NVIDIA rates 62 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Key facts

Senior Systems Software Engineer - NV Cloud Functions is an open job at NVIDIA.
Level rates this role AI Level 3 of 4: Works on AI.
The listed salary is $152k-$242k a year.
The role is based in US, CA, Santa Clara.
The job was posted on October 6, 2026.
Seniority: senior.
Applications are handled by NVIDIA. Apply on NVIDIA

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

vLLM

Questions you could be asked

What's a project where you used vLLM hands-on?
Describe a typical day in a role like this one: which parts run through AI directly?
If you removed AI from this role, what would be left, and how do you decide what still needs a human?

Adapt your resume

List these exact terms on your resume: vLLM. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
Show where AI is part of your daily process, not a one-off project — this role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review

Get new software engineer jobs (Works on AI ●●●○ or higher) by email

One email a week with the new software engineer jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Also alert me for new jobs at NVIDIA

Free. One email a week. Unsubscribe in one click.