Level

NVIDIAPosted today

L4

Senior C++ Software Engineer – AI Developer Tools

Senior C++ Software Engineer – AI Developer Tools at NVIDIA scores 89 out of 100 on AI centrality, which makes it a Level 4 role on this board.

Israel, Tel AvivseniorFull time

AI in this role

ragai-agentsai-evaluation

The NVIDIA PerfTech team is looking for an outstanding Senior C++ Software Engineer to build the next generation of AI-powered developer tools. You will apply deep expertise in modern C++, systems architecture, performance, and debugging to extend our developer-tools ecosystem into the emerging world of agentic software. In this role, you will help develop Genie, NVIDIA’s company-wide AI knowledge and developer-productivity service. You will build production-quality C++ components and integrations while contributing to agentic workflows and retrieval systems that help engineers find information, understand complex systems, and work more effectively.

What You’ll Be Doing:

  • Architect and develop production-quality C++ components, APIs, and integrations for NVIDIA’s AI-powered developer-tools ecosystem.
  • Build reliable, performance-sensitive systems connecting native C++ tools with Genie’s retrieval and agentic capabilities.
  • Design maintainable interfaces between C++ applications and AI services exposed through Python, MCP, REST APIs, and structured tool calling.
  • Contribute to agentic workflows, retrieval systems, ingestion pipelines, evaluation infrastructure, and enterprise integrations.
  • Drive technical initiatives from early exploration through production deployment, working closely with multidisciplinary engineering teams.
  • Mentor engineers and help establish best practices for production-quality AI-powered systems.

What We Need to See:

  • Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.
  • 5+ years of professional experience developing complex production software in modern C++.
  • Strong knowledge of software architecture, concurrency, debugging, performance optimization, and maintainable API design.
  • Experience owning complex systems from design through implementation, deployment, and ongoing operation.
  • Practical experience with AI-powered applications, agentic workflows, developer tools, retrieval systems, or related technologies.
  • Ability to integrate native C++ applications with Python-based services and service APIs.
  • Excellent communication skills and demonstrated ability to lead technical initiatives, clarify ambiguous requirements, and mentor engineers.

Ways to Stand Out From the Crowd:

  • Experience building developer tools, profiling systems, debugging infrastructure, or performance-analysis platforms.
  • Background with MCP, structured tool calling, agent orchestration, or retrieval-augmented generation.
  • Experience designing secure, enterprise-scale retrieval or semantic-search systems.
  • Familiarity with LLM evaluation, grounding, observability, and hallucination reduction.
  • Knowledge of GPU architecture, graphics APIs, game engines, or application-performance optimization.

NVIDIA is widely considered one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working with us. If you are creative and autonomous, with a genuine passion for technology, we want to hear from you!

NVIDIA is committed to fostering a diverse work environment and is proud to be an equal opportunity employer. We highly value diversity in our current and future employees and do not discriminate—including in our hiring and promotion practices—on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

RagAI AgentsAI Evaluation

Questions you could be asked

  1. How would you design a retrieval step so the model answers from real data instead of guessing?
  2. How do you decide when an AI agent can act on its own versus asking for approval first?
  3. How do you decide that one model's output is better than another's for a given task?
  4. How would you decide a model or AI system is ready to ship?
  5. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: Rag, AI Agents, and AI Evaluation. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.

Want your resume actually rewritten for this job?

The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.

Similar roles

Software Engineering roles rated Level 4 at other companies.

More jobs at NVIDIA

Related searches

Same AI level