AI Computing Development Engineer, TensorRT and TensorRT-LLM AIGV

NVIDIA is hiring an AI Computing Development Engineer, TensorRT and TensorRT-LLM AIGV in Shanghai, China. Level rates it ; you can apply on NVIDIA.

Level's read on this job

Builds AI ●●●● is how Level rates this role: the job is building AI systems.
Tools and skills the posting cites include vLLM, PyTorch and Tensorrt.
Level classifies it as a mid-level role.
Level lists 2,700+ other open roles at NVIDIA.

AI in this role

Design and develop optimized deep learning inferencing software such as TensorRT and TensorRT-LLM for NVIDIA platforms.

vLLMPyTorchTensorrtTensorrt LLMPythonSglang

computer-visionspeechdeep-learninggenerative-aiperformance-optimizationsoftware-engineering

NVIDIA is hiring software engineers for its AI Computing team. Academic and commercial groups around the world are using GPUs to power a revolution in deep learning-powered AI, enabling breakthroughs in areas like generative AI, computer vision, speech recognition, recommender systems, and large-scale language and multimodal models. Join the team building the inferencing software (TensorRT/TensorRT-LLM) that will be used across our product lines. The ability to work in a fast-paced, delivery-focused environment is required, and excellent interpersonal skills are a must.

What you'll be doing:

Design and develop robust inferencing software (TensorRT/TensorRT-LLM) optimized for functionality and performance across platforms
Perform performance analysis, optimization, and tuning of deep learning inference workloads
Track and integrate academic and industry advancements in AI and feature-update TensorRT/TensorRT-LLM accordingly
Provide feedback into architecture and hardware design and development
Collaborate across hardware, software, and research teams to shape the direction of machine learning inferencing across NVIDIA platforms
Own and deliver technical work with scope based on experience, ranging from complex features to substantial parts of larger projects, with increasing independence and technical leadership over time
Publish key technical results at leading scientific and engineering conferences

What we need to see:

Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics, or related computing-focused field (or equivalent experience)
Strong Python or C/C++ programming and software design experience, including debugging, performance profiling, and test design
2+ years working experience
Strong curiosity about artificial intelligence and familiarity with the latest developments in deep learning — including generative models, multimodal systems, and large neural networks
Experience working with deep learning frameworks such as PyTorch, TensorRT/TensorRT-LLM, SGLang or vLLM
Proactive, self-driven, and able to work independently
Excellent written and verbal communication skills in English
Demonstrated ability, commensurate with experience, to take technical ownership, solve complex problems, and contribute effectively in cross-functional environments

NVIDIA is widely considered to be one of technology’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. Does the idea of contributing to and pushing the boundaries of state-of-the-art AI and compute systems excite you? Interested in getting exposure to the entire deep learning software stack? Come join us and help build the GPU-accelerated AI platform used worldwide.

How we rate this

AI Computing Development Engineer, TensorRT and TensorRT-LLM AIGV at NVIDIA rates 95 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

AI Computing Development Engineer, TensorRT and TensorRT-LLM AIGV is an open job at NVIDIA.
Level rates this role AI Level 4 of 4: Builds AI.
The role is based in China, Shanghai.
The job was posted on June 10, 2026.
Seniority: mid.
Applications are handled by NVIDIA. Apply on NVIDIA

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Computer visionSpeechDeep learningGenerative AIPerformance OptimizationSoftware EngineeringvLLMPyTorch

Questions you could be asked

Walk me through a computer vision problem you solved, from raw data to a deployed model.
What have you built with speech recognition or text-to-speech, and where did it break?
Tell me about a project where deep learning was part of your work. What did you do?
Tell me about a project where generative ai was part of your work. What did you do?
Tell me about a project where performance optimization was part of your work. What did you do?

Adapt your resume

List these exact terms on your resume: Computer vision, Speech, Deep learning, Generative AI, and Performance Optimization. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email within 3 days.

Get a free CV review Check your resume with the ATS resume checker