Compiler Engineer - AI Inference

NVIDIA is hiring a Compiler Engineer - AI Inference for a remote role open to applicants in United Kingdom. Level rates it ; you can apply on NVIDIA.

Level's read on this job

Level rates this role Builds AI ●●●●: the job is building AI systems.
This is listed as a remote role.
The posting mentions C, Python and Mlir among its tools and skills.
Level classes it as a senior role.
NVIDIA has 2,600+ other open roles on Level.

AI in this role

Seeking an AI Compiler Engineer to drive innovation in compiler optimizations, kernel generation, and AI inference performance on next-gen GPUs.

cpythonmlirgpus

compiler-designkernel-generationhardware-co-designllm-inference

NVIDIA's invention of the GPU 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company”.

NVIDIA is seeking top-tier AI Compiler Engineer to drive innovation within our world-class compiler organization. In this role, you will push the boundaries of what is possible in AI performance and help build the technology that powers the next generation of computing. Join us and make a tangible impact on a global scale.

What you’ll be doing:

Drive technical innovation: Participating in hands-on development focusing on kernel generation and computational graph optimizations for next-generation NVIDIA GPUs.
Advance the state-of-the-art: Solve complex compilation problems for AI workloads (both inference and training) and successfully transition these breakthroughs into enterprise and consumer products.
Collaborate on hardware/software co-design: Partner with leading experts across our software, hardware, and research divisions to architect and co-design future silicon.
Scale AI to the datacenter: Participating in the advancement and optimization of datacenter-scale AI workload deployments.

What we need to see:

BS or MS in Computer Science, Computer Engineering, or a related field (or equivalent experience). A PhD is strongly preferred.
Compiler Experience: 3+ years of relevant industry experience specializing in compiler optimizations, synthesis, and placement.
MLIR Knowledge: Demonstrated, hands-on experience working with MLIR.
Programming Excellence: Exceptional C/C++ and Python programming and software design skills, including rigorous debugging, performance analysis, and test design.
Team Dynamics: Strong communication and interpersonal skills, with the ability to collaborate effectively in a dynamic, fast-paced, and product-oriented environment.

Ways to stand out from the crowd:

Hardware Implementation: Hands-on experience implementing complex AI workloads on CPU, GPU, and/or custom AI accelerator architectures.
LLM Knowledge: Deep understanding of Large Language Model (LLM) inference and its profound implications on computer architecture.
Architecture & Design: Demonstrated understanding in the designing and architecting of comprehensive compiler frameworks from the ground up.

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.

How we rate this

Compiler Engineer - AI Inference at NVIDIA rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Compiler Engineer - AI Inference is an open job at NVIDIA.
Level rates this role AI Level 4 of 4: Builds AI.
The role is based in UK, Remote and is marked remote.
The job was posted on August 14, 2026.
Seniority: senior.
Applications are handled by NVIDIA. Apply on NVIDIA

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Compiler DesignKernel GenerationHardware Co DesignLLM InferenceCPythonMlirGPUs

Questions you could be asked

Tell me about a project where compiler design was part of your work. What did you do?
Tell me about a project where kernel generation was part of your work. What did you do?
Tell me about a project where hardware co design was part of your work. What did you do?
Tell me about a project where llm inference was part of your work. What did you do?
Walk me through how you've used C in your day-to-day work.

Adapt your resume

List these exact terms on your resume: Compiler Design, Kernel Generation, Hardware Co Design, LLM Inference, and C. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. You get your review by email within 24 hours.

Get a free CV review Get your CV rewritten Check your resume with the ATS resume checker

Get new remote software engineering jobs (Builds AI ●●●●) by email

One email a week with the new remote software engineering jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.