Skip to content
Level

NVIDIA

Senior GPU Architect, Deep Learning

NVIDIA is hiring a Senior GPU Architect, Deep Learning in Tel Aviv, Israel. Level rates it ; you can apply on NVIDIA.

Level's read on this job

  • On Level's scale, this role is Builds AI ●●●●: the job is building AI systems.
  • The posting mentions Rtl, gpu architecture and deep learning among its tools and skills.
  • Level classes it as a senior role.
  • NVIDIA has 2,700+ other open roles on Level.

AI in this role

Define and drive future GPU hardware architectures and performance optimizations specifically tailored for deep learning and AI workloads.

rtl
gpu-architecturedeep-learningcomputer-architecturehardware-designperformance-modeling

We are now looking for a Senior GPU Architect, Deep Learning! The NVIDIA GPU Architecture group is looking for a world class hardware architect to help define and drive future GPU architectures for deep learning and accelerated computing. In this role, you will work at the earliest stages of product definition, with primary focus on defining architectural features for future GPUs, while also contributing to relevant microarchitectural direction and tradeoffs. You will help drive new capabilities from concept through modeling, design collaboration, validation, and silicon readiness.

A key part of NVIDIA’s strength is our ability to translate workload insight into differentiated hardware. We are constantly looking for ways to improve our GPU architecture for training and inference workloads while advancing performance, efficiency, scalability, and programmability. In this position, you will focus primarily on defining new architectural features, while also shaping the supporting microarchitectural direction, evaluating design alternatives, and partnering closely with ASIC design, verification, performance, and software teams to bring new capabilities into future products.

What you'll be doing:

  • Define and architect new GPU hardware features for future deep learning and parallel processing workloads.

  • Drive microarchitectural exploration across key areas such as compute pipelines, memory hierarchy, data movement, synchronization, and performance efficiency.

  • Analyze workload behavior and translate bottlenecks into clear architectural requirements and hardware feature proposals.

  • Evaluate performance, power, area, complexity, and programmability tradeoffs for new architectural directions.

  • Develop and use functional and performance models to study new features and refine the architecture before implementation.

  • Work closely with RTL, design, verification, compiler, and software teams to ensure successful execution from architecture definition to productization.

  • Create clear architecture specifications, validation plans, and success criteria for the features you define.

  • Be ready to learn, dig deep, and work across the full stack when required - from workloads and models to RTL and silicon.

What we need to see:

  • BS, MS, or PhD in Computer Science, Electrical Engineering, Computer Engineering, or equivalent experience.

  • 12+ years of relevant industry experience in GPU architecture, computer architecture, or other parallel processing architectures.

  • Strong background in hardware architecture and microarchitecture.

  • Experience defining and evaluating architectural features with solid understanding of performance, power, and area tradeoffs.

  • Strong programming and scripting skills in C, C++, and Python.

  • Experience with architectural modeling, simulation, or performance analysis.

  • Background in parallel computing, memory systems, high performance computing, or deep learning acceleration.

  • Strong communication skills and the ability to drive technical work across distributed, interdisciplinary teams.

Ways to stand out from the crowd:

  • Deep understanding of modern GPU architecture and the interaction between hardware and AI workloads.

  • Experience with memory subsystem architecture, interconnects, coherence, scheduling, or execution pipelines.

  • Experience with pre-silicon performance studies, workload characterization, and architectural correlation.

  • Familiarity with training and inference behavior for large-scale deep learning models.

  • Experience with silicon bring-up, debug, or post-silicon analysis.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative, autonomous, and love a challenge, consider joining our GPU Architecture team and help us build the next generation of AI computing platforms.

How we rate this

Senior GPU Architect, Deep Learning at NVIDIA rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

GPU ArchitectureDeep learningComputer ArchitectureHardware DesignPerformance ModelingRtl

Questions you could be asked

  1. Tell me about a project where gpu architecture was part of your work. What did you do?
  2. Tell me about a project where deep learning was part of your work. What did you do?
  3. Tell me about a project where computer architecture was part of your work. What did you do?
  4. Tell me about a project where hardware design was part of your work. What did you do?
  5. Tell me about a project where performance modeling was part of your work. What did you do?

Adapt your resume

  • List these exact terms on your resume: GPU Architecture, Deep learning, Computer Architecture, Hardware Design, and Performance Modeling. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. You get your review by email within 24 hours.

Get new software engineering jobs (Builds AI ●●●●) by email

One email a week with the new software engineering jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at NVIDIA

Related searches

Same AI level

Jobs by city