Senior Technical Product Manager – AI Agents

NVIDIA is hiring a Senior Technical Product Manager – AI Agents in Santa Clara, United States. It pays $168k-$259k a year and Level rates it ; you can apply on NVIDIA.

Level's read on this job

Works on AI ●●●○ is how Level rates this AI product manager role: the daily work is on AI products, without building the model.
The posting mentions AI agents and MLOps among its tools and skills.
Level classes it as a senior role.
NVIDIA has 2,800+ other open roles on Level.
Posted in the last few days.

AI in this role

ai-agentsml-ops

NVIDIA is the defining technology company of the AI era. We are looking for a Senior Technical Product Manager to lead NeMo Relay, an open-source library that helps developers observe and control what happens inside agent runs, without replacing the frameworks, models, or tools they already use.

Our team builds open-source libraries and reference architectures for agentic AI, including NeMo Relay, NeMo Fabric, and NemoClaw. We go to market through the ecosystem: our software is composed to be embedded into agent frameworks, developer tools, observability platforms, and third-party solutions, helping customers build agents that are safer, more observable, and more efficient on NVIDIA’s stack.

What you'll be doing:

Take charge of the vision, strategy, and multi-release roadmap for NeMo Relay as a framework-neutral library partners can embed, addressing lifecycle events, middleware, plugins, policy, observability, and adaptive performance tuning.
Drive adoption through integrations with agent frameworks, coding-agent harnesses, observability vendors, and ISVs, and build the examples that show developers how to use Relay in real systems.
Partner with the teams behind NeMo Guardrails, NeMo Fabric, NeMo Compass and OpenShell to make Relay work seamlessly with their components.
Turn open-source community and ecosystem feedback into prioritized product decisions.
Work with engineering and program management to plan releases and keep roadmap communications accurate.
Become a recognized voice in agent observability, safety, and optimization through talks, content, and community engagement.

What we need to see:

Deep familiarity with the AI agent landscape: open-source frameworks, coding agents and harnesses, and commercial agent platforms.
Proven understanding of agent execution, including LLM calls, tool calls, and multi-agent workflows.
Understanding of what developers need to operate agents in production: tracing, evaluation, guardrails, and cost and performance tuning.
Product management background on developer-facing libraries, SDKs, or infrastructure that other companies build on.
Proven track record to lead product direction in ambiguous, fast paced areas and to influence engineering, ecosystem, and leadership partners without direct authority.
BS or MS in Computer Science, Electrical Engineering, or equivalent experience.
8+ years of combined work in software development, ML ops, and/or technical product management, including 5+ years shipping enterprise software or infrastructure.

Ways to stand out from the crowd:

History of taking an open-source project from early releases to broad ecosystem adoption.
Track record of ecosystem-led go-to-market, such as integrations, co-engineering, or embedding into third-party products.
Hands-on familiarity with OpenTelemetry, OpenInference, or agent tracing and evaluation tools.
Ability to make exceptional runtime concepts simple for both developers and executives.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
168,000 USD – 258,750 USD for Level 4; and 208,000 USD – 327,750 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 13, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

How we rate this

Senior Technical Product Manager – AI Agents at NVIDIA rates 69 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Senior Technical Product Manager – AI Agents is an open job at NVIDIA.
Level rates this role AI Level 3 of 4: Works on AI.
The listed salary is $168k-$259k a year.
The role is based in US, CA, Santa Clara.
The job was posted on November 9, 2026.
Seniority: senior.
Applications are handled by NVIDIA. Apply on NVIDIA

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI agentsML Ops

Also common in AI product manager jobs at this level

Generative AI Machine learning AWS SQL Azure RAG

Pay

This job starts at: $168k
Typical AI product manager job: $178k

This posting starts 5% below the typical AI product manager job. See AI product manager jobs

Questions you could be asked

How do you decide when an AI agent can act on its own versus asking for approval first?
How do you monitor a model once it's live, and how do you know it needs retraining?
Describe a typical day in a role like this one: which parts run through AI directly?
If you removed AI from this role, what would be left, and how do you decide what still needs a human?

Adapt your resume

List these exact terms on your resume: AI agents and ML Ops. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email within 3 days.

Get a free CV review Check your resume with the ATS resume checker