Skip to content

NVIDIA

Senior Software Architect, GPU Networking

NVIDIA is hiring a Senior Software Architect, GPU Networking in Tel Aviv, Israel. Level rates it ; you can apply on NVIDIA.

Level's read on this job

  • Level rates this role Little AI ●○○○: aI is not part of the work.
  • Tools and skills the posting cites include Linux, Kubernetes and Nccl.
  • Level classifies it as a senior role.
  • Level lists 2,700+ other open roles at NVIDIA.

AI in this role

Design and prototype GPU networking software architecture for large-scale AI infrastructure.

LinuxKubernetesNcclUcxMpiCUDA
software-architecturegpu-networkingsystem-designdistributed-systems

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. The GPU Networking Software Architecture team is looking for a Senior Software Architect to help shape software for next-generation AI infrastructure. In this role, you will combine hands-on software architecture and development with system-level thinking. You will collaborate with experienced architects and engineering teams across NVIDIA while expanding your software architecture skills. Join us to help build the technologies that connect and manage large-scale accelerated computing systems.

What you’ll be doing:

  • Contribute to the architecture and prototyping of GPU networking software for large-scale AI infrastructure.

  • Analyze requirements, evaluate design alternatives, and document technical decisions and trade-offs.

  • Develop proofs of concept to evaluate interfaces, performance, resiliency, and software-hardware interactions.

  • Collaborate with GPU, switch, firmware, driver, networking software, product, and architecture teams to move concepts toward implementation.

  • Build knowledge of the GPU networking software stack and take increasing ownership of well-defined architectural areas.

What we need to see:

  • B.Sc. or M.Sc. in Computer Science, Electrical Engineering, Computer Engineering, or a related field, or equivalent experience.

  • 5+ years of relevant software development experience in Linux environments.

  • Strong understanding of software engineering fundamentals, including debugging, testing, data structures, concurrency, and operating-system concepts.

  • Solid foundational knowledge of computer networking.

  • Ability to understand complex systems, reason about component interfaces and design trade-offs, and communicate technical ideas clearly.

  • Curiosity, initiative, collaborative problem-solving skills, and an eagerness to learn from experienced architects and engineers.

  • Ability to work effectively with teams across locations and time zones.

Ways to stand out from the crowd:

  • Knowledge in one or more of the following: Ethernet and IP datacenter protocols, management and telemetry protocols, GPU interconnects, Linux kernel or driver development, and network operating systems.

  • Experience building prototypes or contributing to system-level architecture and design documents.

  • Familiarity with AI communication libraries or programming models such as NCCL, UCX, MPI, CUDA, or equivalents.

  • Knowledge of Kubernetes, containers, or cloud-native infrastructure.

  • Experience analyzing performance, reliability, resiliency, or observability in complex software systems.

NVIDIA is widely considered one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you are creative, collaborative, and excited to grow from hands-on software development into software architecture, we want to hear from you.

How we rate this

Senior Software Architect, GPU Networking at NVIDIA rates 25 out of 100 for how much of the daily work is AI. That makes it Little AI (AI Level 1 of 4). The level is about AI in the job, not seniority.

Classification

Little AI. AI is not part of the work.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Software ArchitectureGPU NetworkingSystem DesignDistributed SystemsLinuxKubernetesNcclUcx

Questions you could be asked

  1. Tell me about a project where software architecture was part of your work. What did you do?
  2. Tell me about a project where gpu networking was part of your work. What did you do?
  3. Tell me about a project where system design was part of your work. What did you do?
  4. Tell me about a project where distributed systems was part of your work. What did you do?
  5. Walk me through how you've used Linux in your day-to-day work.

Adapt your resume

  • List these exact terms on your resume: Software Architecture, GPU Networking, System Design, Distributed Systems, and Linux. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email within 3 days.

Get new software engineering jobs by email

One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free.

Similar roles

Software Engineering roles that involve little AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at NVIDIA

Related searches

Same AI level

Jobs by city