OpenAISan Francisco$230k-$385k
NVIDIAPosted today
Senior C++ Software Engineer – AI Developer Tools
Senior C++ Software Engineer – AI Developer Tools at NVIDIA scores 89 out of 100 on AI centrality, which makes it a Level 4 role on this board.
AI in this role
The NVIDIA PerfTech team is looking for a talented C++ Software Engineer to help build the next generation of AI-powered developer tools. You will apply strong C++ and software-engineering fundamentals while gaining hands-on experience with agentic workflows, retrieval systems, and AI services.
In this role, you will contribute to Genie, NVIDIA’s company-wide AI knowledge and developer-productivity service. You will work across C++ tools and AI services to help engineers find information, understand complex systems, and work more effectively.
What You’ll Be Doing:
- Develop production-quality C++ components, APIs, and integrations for NVIDIA’s AI-powered developer-tools ecosystem.
- Build capabilities connecting native C++ tools with Genie’s retrieval and agentic features.
- Contribute to agentic workflows, retrieval systems, ingestion pipelines, MCP tools, APIs, and enterprise integrations.
- Build benchmarks and improve retrieval quality, reliability, performance, and resource usage.
- Own features from investigation and design through implementation, testing, and delivery.
- Collaborate with graphics, software, and hardware teams developing performance-analysis and developer tools.
What We Need to See:
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.
- 5+ years of modern C++ programming skills gained through professional experience, internships, or substantial technical projects.
- Good understanding of data structures, algorithms, object-oriented design, multithreading, debugging, and testing.
- Ability and motivation to work across C++ systems and Python-based AI services.
- Familiarity with AI-powered applications, agentic workflows, retrieval systems, or related technologies.
- Ability to investigate unfamiliar problems, learn new technologies, and follow work through to completion.
- Good communication and collaboration skills, with openness to technical feedback.
Ways to Stand Out From the Crowd:
- Experience building substantial C++ applications, developer tools, or performance-sensitive systems.
- Familiarity with C++ performance analysis, concurrency, memory management, or large codebases.
- Hands-on experience with RAG, semantic search, embeddings, vector databases, or retrieval evaluation.
- Experience with MCP, REST APIs, structured tool calling, or agent frameworks.
- Knowledge of GPU architecture, graphics APIs, game engines, or application-performance optimization.
NVIDIA is widely considered one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working with us. If you are creative and autonomous, with a genuine passion for technology, we want to hear from you!
NVIDIA is committed to fostering a diverse work environment and is proud to be an equal opportunity employer. We highly value diversity in our current and future employees and do not discriminate—including in our hiring and promotion practices—on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- How would you design a retrieval step so the model answers from real data instead of guessing?
- How do you decide when an AI agent can act on its own versus asking for approval first?
- How would you decide a model or AI system is ready to ship?
- Tell me about a time a model underperformed in production. How did you find out, and what did you change?
Adapt your resume
- List these exact terms on your resume: Rag and AI Agents. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.
Want your resume actually rewritten for this job?
The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.
L4Get new AI jobs at Level 4+ by email
One email a week with the new AI jobs at Level 4+, each rated Level 1 to 4 for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles rated Level 4 at other companies.




