Senior Software Architect, AI Cloud

NVIDIA is hiring a Senior Software Architect, AI Cloud in Tel Aviv, Israel. Level rates it ; you can apply on NVIDIA.

Level's read on this job

Builds AI ●●●● is how Level rates this role: the job is building AI systems.
Tools and skills the posting cites include Rdma, Infiband and Tcp Ip.
Level classifies it as a senior role.
Level lists 2,700+ other open roles at NVIDIA.

AI in this role

Design and build high-performance networking infrastructure and protocols like RDMA to support next-generation AI cloud systems and GPUs at scale.

rdmainfibandtcp-ipnetworking-protocols

software-architecturenetworkingdistributed-systemsquantitative-modeling

NVIDIA seeks a highly motivated senior AI cloud Software architect to join our team in Israel. Work on innovative technologies shaping the future of AI and cloud. We are developing RDMA Transport protocols within the Networking software architecture team at NVIDIA. Efficient and fast communication between GPUs directly impacts end-to-end application performance. This impact continues to grow with the increasing scale of next generation systems. This is an outstanding opportunity to advance the state-of-the-art, break performance barriers, and deliver platforms the world has never seen before. Are you ready to build the new and innovative technologies that will help realize NVIDIA's vision?

What you'll be doing:

Translate requirements into vision, architecture, and roadmap
Design infrastructure to support programmable improvements to RDMA protocols for E/W AI networking stack
Collaborate with multi-functional teams to innovate and deliver networking solutions
Explore innovative solutions in HW and SW for our next-generation platforms as part of programmable RDMA architecture
Build proofs-of-concept, conduct experiments, and perform quantitative modeling to evaluate and drive new innovations

What we need to see:

Bachelor's or Master’s degree in Computer Science or equivalent experience
8+ years of proven experience in the field
Background in networking stack and protocols such as RDMA, TCP/IP, and InfiniBand
Strong articulation skills for crafting and improving technical documents and the ability to engage with a globally distributed engineering team
Eagerness to learn new technologies and constantly improve your expertise

NVIDIA has continuously reinvented itself over two decades. NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. This is our life’s work — to amplify human imagination and intelligence.

With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and talented people in the world working for us and, due to extraordinary growth, our elite engineering teams are fast-growing fast. If you're a creative and autonomous manager with a sincere real passion for technology, we want to hear from you.

How we rate this

Senior Software Architect, AI Cloud at NVIDIA rates 80 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Senior Software Architect, AI Cloud is an open job at NVIDIA.
Level rates this role AI Level 4 of 4: Builds AI.
The role is based in Israel, Tel Aviv.
The job was posted on July 14, 2026.
Seniority: senior.
Applications are handled by NVIDIA. Apply on NVIDIA

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Software ArchitectureNetworkingDistributed SystemsQuantitative ModelingRdmaInfibandTcp IpNetworking Protocols

Questions you could be asked

Tell me about a project where software architecture was part of your work. What did you do?
Tell me about a project where networking was part of your work. What did you do?
Tell me about a project where distributed systems was part of your work. What did you do?
Tell me about a project where quantitative modeling was part of your work. What did you do?
Walk me through how you've used Rdma in your day-to-day work.

Adapt your resume

List these exact terms on your resume: Software Architecture, Networking, Distributed Systems, Quantitative Modeling, and Rdma. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. You get your review by email within 24 hours.

Get a free CV review Get your CV rewritten Check your resume with the ATS resume checker

Get new software engineering jobs (Builds AI ●●●●) by email

One email a week with the new software engineering jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.