Manager, Software Engineering - NCCL

NVIDIA is hiring a Manager, Software Engineering - NCCL in Shanghai, China. Level rates it ; you can apply on NVIDIA.

Level's read on this job

Level rates this role Little AI ●○○○: aI is not part of the work.
Tools and skills the posting cites include vLLM, PyTorch and TensorFlow.
Level classifies it as a senior role.
Level lists 2,700+ other open roles at NVIDIA.

AI in this role

Lead the China GPU Communications Libraries and Networking team at NVIDIA, delivering high-performance communication libraries for Deep Learning and HPC.

vllmpytorchtensorflowclinuxncclnvshmemcuda

systems-softwarenetworkinggpu-architectureperformance-optimizationteam-management

We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver communication libraries like NCCL & NVSHMEM for Deep Learning and HPC. DL and HPC applications have a huge compute demand already and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) within a node and with high-speed networking (eg. Infiniband, Ethernet) across the nodes. Communication performance between the GPUs has a direct impact on the end-to-end application performance; and the stakes are even higher at huge scales! We are looking for a dynamic and technical leader for our China NCCL team. This is an outstanding opportunity to push the limits on the state-of-the-art and deliver platforms the world has never seen before. Are you ready to contribute to the development of innovative technologies and help realize NVIDIA's vision?

What you will be doing:

Lead, mentor, and grow our China engineering team. Own the end-to-end execution spanning planning, prioritization, quality control and performance.
Interact with customers and researchers to understand their use cases and requirements. Collaborate with engineering, program and product management, and partners to define the product roadmap.
Contribute to feature design and implementation.
Continuously review and identify improvement opportunities in established processes, infrastructure, and practices to ensure the teams are accomplishing work in the most efficient and transparent manner.

What we need to see:

10+ overall years of experience in the software industry with 4+ years of management experience.
Bachelors, Masters, or Ph.D. in CS, CE, EE (related technical field) or equivalent experience.
Specialization in systems software, communication runtimes, or high performance networking. Proven success in managing several complex initiatives or products through the full product life cycle.
Strong understanding of computer systems architecture, networking technologies (RDMA, RoCE, Ethernet, EFA, InfiniBand) and topologies, operating systems principles (aka systems software fundamentals), HW-SW interactions and performance analysis/optimizations.
Hands-on C/C++ programming and debugging skills in Linux.
Experience balancing multiple projects with competing priorities. Flexibility to work and communicate effectively across different teams and timezones.

Ways to stand out from the crowd:

Active user or developer of NCCL!
Customer engagement experience in this space.
Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, NIXL, OpenSHMEM, UCX, UCC).
Experience with programming using CUDA, MPI, OpenMP, OpenACC, pthreads.
Knowledge of HPC and ML/DL fundamentals. Experience with Deep Learning Frameworks such as PyTorch, TensorFlow, vLLM, SGLang, TRT-LLM, etc.

How we rate this

Manager, Software Engineering - NCCL at NVIDIA rates 20 out of 100 for how much of the daily work is AI. That makes it Little AI (AI Level 1 of 4). The level is about AI in the job, not seniority.

Classification

Little AI. AI is not part of the work.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Manager, Software Engineering - NCCL is an open job at NVIDIA.
Level rates this role AI Level 1 of 4: Little AI.
The role is based in China, Shanghai.
The job was posted on April 30, 2026.
Seniority: senior.
Applications are handled by NVIDIA. Apply on NVIDIA

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Systems SoftwareNetworkingGPU ArchitecturePerformance OptimizationTeam ManagementvLLMPyTorchTensorFlow

Questions you could be asked

Tell me about a project where systems software was part of your work. What did you do?
Tell me about a project where networking was part of your work. What did you do?
Tell me about a project where gpu architecture was part of your work. What did you do?
Tell me about a project where performance optimization was part of your work. What did you do?
Tell me about a project where team management was part of your work. What did you do?

Adapt your resume

List these exact terms on your resume: Systems Software, Networking, GPU Architecture, Performance Optimization, and Team Management. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. You get your review by email within 24 hours.

Get a free CV review Get your CV rewritten Check your resume with the ATS resume checker