Level

NVIDIA

Senior AI Engineer and Agentic Platforms - Network Architecture

AI in this role

vllm
ai-agentsfine-tuning

NVIDIA is at the forefront of the AI revolution, delivering brand new accelerated compute platforms for global impact. Our Network Architecture group is seeking a talented and motivated Sr. Software Engineer to build the agentic workflows that our architects use in their daily work. The software at the center of this role is our hardware network simulation environment — you will design multi-step agent workflows over it, engineer the context that grounds them in our own specifications and source code, and optimize their runtime performance. If you are passionate about building the practical infrastructure that brings intelligent agents to life, we want to hear from you.

 

What you'll be doing:

  • Build agentic workflows — loops, graphs, and multi-step pipelines — that carry real hardware network simulation and analysis work end to end.
  • Engineer the context these workflows run on, turning our simulation models, specifications, design documents, and source code into context that makes agents accurate in our domain.
  • Work closely with network architects to understand their workflows and translate them into agent workflows they use daily.
  • Optimize the runtime performance of our simulation tooling on these platforms, including execution time, compute cost, and end-to-end latency.
  • Define evaluation and regression testing for agent workflows, so that changes to a prompt, a graph, or a context source are measurable.
  • Build observability across agent runs: what the agent did, where it failed, and why.
  • Champion guidelines for secure and reliable agent workflows, including data handling, access control, and interaction boundaries.
  • Serve as a key technical resource for solving sophisticated integration issues between agents and internal tooling.

 

What we need to see:

  • B.Sc. or above in Computer Science, Computer Engineering, or a related field, or equivalent experience.
  • 5+ years of hands-on experience in software engineering, with demonstrated ownership of production systems from design through deployment.
  • Expert-level programming skills in C++, with strong Python skills alongside it.
  • Strong understanding of the full stack, including hardware: memory, I/O, networking, accelerators, and where real performance bottlenecks occur.
  • Current, practical knowledge of how to build systems around AI models: agent loops, tool interfaces, context retrieval and management, and common failure modes.
  • Understanding of inference serving, including request lifecycle, batching, caching, and the tradeoffs between throughput, latency, and cost.

 

Ways to stand out from the crowd:

  • Experience writing hardware simulation software — network, system, or architectural simulators, models, or testbenches.
  • Networking experience — protocols, fabrics, switching, or RDMA — and experience working alongside silicon, systems, or architecture teams.
  • Hands-on experience with inference serving engines such as vLLM, TensorRT-LLM, or Triton Inference Server, including low-level internals such as KV cache, batching and scheduling, and quantization, and related performance work such as profiling and GPU programming.
  • Hands-on experience building or fine-tuning LLMs or other generative models.
  • Agent workflows, tooling, or context pipelines adopted by other engineering teams.

NVIDIA is home to some of the most innovative and dedicated professionals in the industry. We are committed to fostering a diverse work environment and are proud to be an equal-opportunity employer.

How we rate this

Senior AI Engineer and Agentic Platforms - Network Architecture at NVIDIA rates 97 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

AI AgentsFine TuningvLLM

Questions you could be asked

  1. How do you decide when an AI agent can act on its own versus asking for approval first?
  2. Walk me through fine-tuning a model: what data did you use, and how did you check the result?
  3. What are the limits of vLLM that you've run into, and how did you work around them?
  4. How would you decide a model or AI system is ready to ship?
  5. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: AI Agents, Fine Tuning, and vLLM. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.

Want your resume actually rewritten for this job?

The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.

Get new AI engineer jobs (Builds AI ●●●●) by email

One email a week with the new AI engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at NVIDIA

More AI engineer jobs

Related searches

Same AI level