Level

NVIDIA

Senior C++ Software Engineer – AI Developer Tools

AI in this role

ragai-agentsai-evaluation

The NVIDIA PerfTech team is looking for an outstanding Senior C++ Software Engineer to build the next generation of AI-powered developer tools. You will apply deep expertise in modern C++, systems architecture, performance, and debugging to extend our developer-tools ecosystem into the emerging world of agentic software. In this role, you will help develop Genie, NVIDIA’s company-wide AI knowledge and developer-productivity service. You will build production-quality C++ components and integrations while contributing to agentic workflows and retrieval systems that help engineers find information, understand complex systems, and work more effectively.


What You’ll Be Doing:

  • Architect and develop production-quality C++ components, APIs, and integrations for NVIDIA’s AI-powered developer-tools ecosystem.
  • Build reliable, performance-sensitive systems connecting native C++ tools with Genie’s retrieval and agentic capabilities.
  • Design maintainable interfaces between C++ applications and AI services exposed through Python, MCP, REST APIs, and structured tool calling.
  • Contribute to agentic workflows, retrieval systems, ingestion pipelines, evaluation infrastructure, and enterprise integrations.
  • Drive technical initiatives from early exploration through production deployment, working closely with multidisciplinary engineering teams.
  • Mentor engineers and help establish best practices for production-quality AI-powered systems.

What We Need to See:

  • Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.
  • 5+ years of professional experience developing complex production software in modern C++.
  • Strong knowledge of software architecture, concurrency, debugging, performance optimization, and maintainable API design.
  • Experience owning complex systems from design through implementation, deployment, and ongoing operation.
  • Practical experience with AI-powered applications, agentic workflows, developer tools, retrieval systems, or related technologies.
  • Ability to integrate native C++ applications with Python-based services and service APIs.
  • Excellent communication skills and demonstrated ability to lead technical initiatives, clarify ambiguous requirements, and mentor engineers.

Ways to Stand Out From the Crowd:

  • Experience building developer tools, profiling systems, debugging infrastructure, or performance-analysis platforms.
  • Background with MCP, structured tool calling, agent orchestration, or retrieval-augmented generation.
  • Experience designing secure, enterprise-scale retrieval or semantic-search systems.
  • Familiarity with LLM evaluation, grounding, observability, and hallucination reduction.
  • Knowledge of GPU architecture, graphics APIs, game engines, or application-performance optimization.

NVIDIA is widely considered one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working with us. If you are creative and autonomous, with a genuine passion for technology, we want to hear from you!


NVIDIA is committed to fostering a diverse work environment and is proud to be an equal opportunity employer. We highly value diversity in our current and future employees and do not discriminate—including in our hiring and promotion practices—on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

How we rate this

Senior C++ Software Engineer – AI Developer Tools at NVIDIA rates 89 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

RAGAI AgentsAI Evaluation

Questions you could be asked

  1. How would you design a retrieval step so the model answers from real data instead of guessing?
  2. How do you decide when an AI agent can act on its own versus asking for approval first?
  3. How do you decide that one model's output is better than another's for a given task?
  4. How would you decide a model or AI system is ready to ship?
  5. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: RAG, AI Agents, and AI Evaluation. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review

Get new remote software engineer jobs (Builds AI ●●●●) by email

One email a week with the new remote software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at NVIDIA

More software engineer jobs

Related searches

Same AI level