Level

NVIDIA

Software Engineer, DL Kernel Libraries - New College Grad 2027

NVIDIA is hiring a Software Engineer, DL Kernel Libraries - New College Grad 2027 in Santa Clara, United States. It pays $108k-$178k a year and Level rates it ; you can apply on Level.

AI in this role

Develop deep learning inference and training systems software, including GPU kernels and libraries to accelerate AI workloads.

vllmpytorchtensorflowjaxpythonccudacudnn
deep-learningkernel-developmentcompiler-designgpu-optimization

Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the DL Kernel Library team and see how you can make a lasting impact on the world.


We're looking for Software Engineer Interns to help develop groundbreaking technologies in the deep learning inference and training systems software stack! We build innovative AI systems software, primarily cuDNN and FlashInfer. As a member of the team, you'll develop libraries, code generators, and GPU kernel technologies for NVIDIA's hardware architecture. This means designing and building things like new abstractions, efficient kernel implementations, and kernel code generators to accelerate large language models, agents, and other high-impact AI workloads.


What you'll be doing:

  • Innovating and developing new AI systems technologies for efficient inference and training
  • Designing, implementing, and optimizing kernels for high impact AI workloads
  • Designing and implementing extensible abstractions for serving engines and training frameworks
  • Building efficient just-in-time domain specific compilers and runtimes
  • Collaborating closely with other engineers at NVIDIA across deep learning frameworks, libraries, kernels, and GPU arch teams
  • Contributing to open source communities across FlashInfer, cuDNN, vLLM, SGLang, PyTorch, JAX, and XLA

What we need to see:

  • BS, MS, or PhD degree in Computer Science, Electrical Engineering, or related field (or equivalent experience)
  • Strong experience in developing or using deep learning frameworks (e.g. PyTorch, JAX, TensorFlow, ONNX, etc) or inference engines and runtimes such as vLLM, SGLang, and MLC.
  • Strong Python and C/C++ programming skills

Ways to stand out from the crowd:

  • Background in domain specific compiler and library solutions for LLM inference and training (e.g. FlashInfer, Flash Attention)
  • Expertise in training frameworks and inference engines
  • Expertise in machine learning compilers (e.g. Apache TVM, MLIR)
  • Strong experience in GPU kernel development and performance optimizations (especially using CUDA C/C++, CUTLASS DSL, cuTile, Triton, or similar)
  • Open source project ownership or contributions

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 108,000 USD - 178,250 USD for Level 1, and 124,000 USD - 195,500 USD for Level 2.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 15, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

How we rate this

Software Engineer, DL Kernel Libraries - New College Grad 2027 at NVIDIA rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Deep learningKernel DevelopmentCompiler DesignGPU OptimizationvLLMPyTorchTensorFlowJax

Also common in software engineer jobs at this level

Pay

This job starts at
$108k
Typical software engineer job
$168k

This posting starts 36% below the typical software engineer job. See software engineer jobs

Questions you could be asked

  1. Tell me about a project where deep learning was part of your work. What did you do?
  2. Tell me about a project where kernel development was part of your work. What did you do?
  3. Tell me about a project where compiler design was part of your work. What did you do?
  4. Tell me about a project where gpu optimization was part of your work. What did you do?
  5. Walk me through how you've used vLLM in your day-to-day work.

Adapt your resume

  • List these exact terms on your resume: Deep learning, Kernel Development, Compiler Design, GPU Optimization, and vLLM. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new software engineer jobs (Builds AI ●●●●) by email

One email a week with the new software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at NVIDIA

More software engineer jobs

Related searches

Same AI level

Jobs by city