Principal Product Manager, AI Frameworks
NVIDIA is hiring a Principal Product Manager, AI Frameworks in Santa Clara, United States. It pays $240k-$380k a year and Level rates it ; you can apply on NVIDIA.
Level's read on this job
- On Level's scale, this AI product manager role is Works on AI ●●●○: the daily work is on AI products, without building the model.
- Pay on this posting starts 33% higher than the typical AI product manager posting on Level.
- The posting mentions PyTorch among its tools and skills.
- Level classes it as a lead role.
- NVIDIA has 2,600+ other open roles on Level.
AI in this role
At Nvidia we meet customers where they are on their AI journey on our GPUs - this means we build best in class frameworks in OSS and support a robust eco system of other OSS frameworks. and As a Product Manager for AI Platform training you will be responsible for building the tools, SDKs, and libraries which enable model builders to get the best large scale performance, resilience and experience on NVIDIA GPUs.
As NVIDIA Product Managers, our goal is to enable researchers and operators to be successful on the NVIDIA Platform, and push the boundaries of what is possible in their research and research-to-production! As Product Managers, we are the champions inside NVIDIA for frontier model builders looking to push the bounds of scale and resilience for current and emerging modeling paradigms on GPUs. We work directly with customers inside and outside of the company to identify key improvements, create roadmaps, and stay alert on the training/post training landscape. We also work with NVIDIA leaders to define clear product strategy, and marketing team teams to build go-to-market plans. The Product Management organization at NVIDIA is a small, strong, and impactful group. We focus on enabling deep learning across all GPU use cases and providing great products for our users. We are seeking a rare blend of product skills, technical depth, and passion to make NVIDIA great. Does that sounds familiar? If so, we would love to hear from you!
What you'll be doing:
Create products to help researchers and production model builders
Develop product strategy, roadmaps, and go-to-market plans
Collaborate with internal and external customers to build product-based roadmaps for training/post training software
Work with leadership to align with and drive company strategy
What we need to see:
Experience with training/post training and optimization software (ex. PyTorch distributed, torchtitan, VeRL, Nemo Framework, etc.)
Demonstrable knowledge of GenAI or machine learning concepts, particularly around model training, performance optimization, and software development and delivery
Experience with large scale distributed systems
BS or MS degree in Computer Science, Computer Engineering, or similar experience (or equivalent experience)
15+ years of technical product management, or similar, experience at a technology company
Strong communication and interpersonal skills
Ways to Stand Out from the crowd:
Experience leading GenAI/RecSys research to production at scale
Working on Open Source & Github-first developer products with deep customer interactions
Knowledge of GPU architecture, HW/SW co-design, and performance profiling
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 3, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.How we rate this
Principal Product Manager, AI Frameworks at NVIDIA rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Pay
- This job starts at
- $240k
- Typical AI product manager job
- $180k
This posting starts 33% above the typical AI product manager job. See AI product manager jobs
Questions you could be asked
- What's a project where you used PyTorch hands-on?
- Describe a typical day in a role like this one: which parts run through AI directly?
- If you removed AI from this role, what would be left, and how do you decide what still needs a human?
Adapt your resume
- List these exact terms on your resume: PyTorch. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. You get your review by email within 24 hours.
Get new AI product manager jobs (Works on AI ●●●○ or higher) by email
One email a week with the new AI product manager jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Product roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step