Software Architect, AI Networking

NVIDIA is hiring a Software Architect, AI Networking in Tel Aviv, Israel. Level rates it ; you can apply on Level.

AI in this role

Design and build low-level networking infrastructure and protocols to optimize communication performance for AI cloud systems.

crisc-vinfiniband

networkingrdmaembedded-systemslow-level-programming

NVIDIA seeks a highly motivated Software Architect to join our Networking Software Architecture team in Israel. In this role, you will work on innovative technologies shaping the future of AI cloud systems and RISC-V networking accelerators.

We develop RDMA transport protocols and low-level software within the Networking team. Efficient and fast communication between GPUs directly impacts end-to-end AI application performance an impact that continues to grow with the increasing scale of next-generation systems. In this role you will help design infrastructure, build proofs-of-concept, and evaluate protocol performance to deliver platforms the world has never seen before.

What You'll Be Doing

Design & Software Development: Help build and maintain C/C++ infrastructure, embedded software components, and runtime environments supporting programmable RDMA protocols for the East/West (E/W) AI networking stack.
PoC & Quantitative Modelling: Build proofs-of-concept, conduct hands-on experiments, and perform quantitative modelling to evaluate performance and drive new networking innovations.
Cross-Functional Collaboration: Partner with hardware, firmware, architecture, compiler, and SDK teams to lead cross-stack innovations and integrate scalable networking solutions.
Documentation & Technical Clarity: Craft, refine, and maintain technical design documents, test results, and specs to effectively engage with a globally distributed engineering team.

What We Need to See

Education: Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.
Experience: 0-5 years of experience in low-level software development, networking, or systems programming.
Core Skills: Strong proficiency in C and/or C++ and solid system-level debugging skills.
Networking & System Foundations: Background or coursework in computer architecture, operating systems, and networking protocols (e.g., TCP/IP, RDMA, or InfiniBand fundamentals).
Communication: Strong articulation skills for crafting clear technical documentation and collaborating across global engineering teams.
Mindset: Curiosity, strong problem-solving abilities, and an eagerness to constantly learn and improve your technical expertise.

Ways to Stand Out from the Crowd

Hands-on experience or academic projects focusing on RDMA, InfiniBand, SmartNICs, or packet processing.
Familiarity with RISC-V execution environments, RTOS, board bring-up, or driver development.
Practical experience with Linux kernel development, network simulation tools, or performance profiling.

How we rate this

Software Architect, AI Networking at NVIDIA rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Key facts

Software Architect, AI Networking is an open job at NVIDIA.
Level rates this role AI Level 3 of 4: Works on AI.
The role is based in Israel, Tel Aviv.
The job was posted on October 14, 2026.
Seniority: senior.
Applications are handled by NVIDIA. Apply on NVIDIA

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

NetworkingRdmaEmbedded SystemsLow Level ProgrammingCRisc VInfiniband

Questions you could be asked

Tell me about a project where networking was part of your work. What did you do?
Tell me about a project where rdma was part of your work. What did you do?
Tell me about a project where embedded systems was part of your work. What did you do?
Tell me about a project where low level programming was part of your work. What did you do?
Walk me through how you've used C in your day-to-day work.

Adapt your resume

List these exact terms on your resume: Networking, Rdma, Embedded Systems, Low Level Programming, and C. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review Check your resume with the ATS resume checker

Get new software engineering jobs (Works on AI ●●●○ or higher) by email

One email a week with the new software engineering jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.