Senior Technical Program Manager - Nemotron
NVIDIA is hiring a Senior Technical Program Manager - Nemotron in Munich, Germany. Level rates it ; you can apply on NVIDIA.
Level's read on this job
- Level rates this role Works on AI ●●●○: the daily work is on AI products, without building the model.
- Tools and skills the posting cites include technical program management, vendor management and data governance.
- Level classifies it as a senior role.
- Level lists 2,700+ other open roles at NVIDIA.
- The role was posted in the last few days.
AI in this role
Oversee massive-scale dataset collection, vendor management, and data operations for LLM and agentic AI training programs.
The Nemotron Edge PMO organization seeks a Technical Program Manager to oversee the collection, curation, and release of massive-scale datasets. In this position, the TPgM will build the data foundation that enables NVIDIA’s models to lead in enterprise and agentic AI, delivering premier language understanding and synthetic data generation optimized for NVIDIA infrastructure.
What you will be doing:
- Drive execution for sourcing, curating, and maintaining high‑quality data used to train and evaluate Robotics/LLM programs
- Identify, evaluate, and onboard external data/annotation vendors aligned with LLM use cases, quality needs, and compliance constraints.
- Negotiate contracts, pricing, SLAs, and KPIs with vendors; track performance and drive continuous improvement and cost efficiency.
- Partner with Legal, Privacy, and Security to ensure data contracts, access, and usage comply with regulatory and internal policies.
- Dashboards and reporting to monitor data quality, vendor throughput, turnaround time, and budget utilization.
- Create and maintain documentation, playbooks, and processes for repeatable, scalable LLM data and vendor operations.
What we need to see:
- 8+ years of experience in data operations, vendor management, or technical program management—preferably supporting AI/ML or LLM initiatives.
- Bachelors degree or equivalent experience
- Exceptional skills in prioritizing and building alignment.
- Consistent track record of leading and successfully delivering medium to large organizational-wide programs and projects.
- Experience with AI/ML data vendors (annotation, eval, labeling platforms)
- Comfort working with research teams who have fast-changing requirements
- AI-native mindset — uses tooling to automate vendor reporting, tracking, and communication
- Ability to operate in ambiguity and rapid pivots — vendor scopes change fast in GenAI.
Ways to stand out from the crowd:
- Strong understanding of data governance, data quality, and compliance frameworks.
- Proven experience managing external data vendors, setting KPIs, SLAs, and performance metrics.
- Working knowledge of LLM training data pipelines, annotation workflows, and synthetic data generation.
- Proven track record of driving measurable cost savings or quality improvements directly tied to how you structured and managed vendor relationships
- Built vendor scorecards, playbooks, or tracking tools that were adopted as well as being comfortable working with research teams in fast-moving GenAI environments where vendor scope changes frequently and pivots are the norm
With competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most forward-thinking and versatile people in the world working with us, and our engineering teams are growing fast in some of the most impactful fields of our generation: AI, Data Engineering, and Data Science. If you're a creative engineer who enjoys autonomy and shares our passion for technology, we want to hear from you.
How we rate this
Senior Technical Program Manager - Nemotron at NVIDIA rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where technical program management was part of your work. What did you do?
- Tell me about a project where vendor management was part of your work. What did you do?
- Tell me about a project where data governance was part of your work. What did you do?
- Tell me about a project where llm pipelines was part of your work. What did you do?
- Describe a typical day in a role like this one: which parts run through AI directly?
Adapt your resume
- List these exact terms on your resume: Technical Program Management, Vendor Management, Data Governance, and LLM Pipelines. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new product jobs (Works on AI ●●●○ or higher) by email
One email a week with the new product jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Product roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step