Senior Software and System Architect
NVIDIA is hiring a Senior Software and System Architect. Level rates it ; you can apply on NVIDIA.
Level's read on this job
- On Level's scale, this role is Little AI ●○○○: aI is not part of the work.
- The posting mentions Ethernet, Rdma and Roce among its tools and skills.
- Level classes it as a senior role.
- NVIDIA has 2,700+ other open roles on Level.
AI in this role
Architect next-generation DPU and networking software for large-scale AI datacenter deployments.
NVIDIA is looking for an outstanding Senior Networking Software Architect to join the NIC/DPU Software and Firmware Architecture group. In this role, you will help define the next generation of NVIDIA datacenter and AI networking platforms, with focus on DPU management, QoS, performance, telemetry, and software architecture across stacks. You will work closely with hardware designers, firmware/kernel driver teams, system engineers, validation, product management and customers. The role spans early architecture definition, pre-silicon design, bring-up, and production readiness for large-scale AI and cloud datacenter deployments.
What You’ll Be Doing:
Own software and system architecture for next-generation DPU management, QoS, performance, telemetry, and observability features.
Define end-to-end control and management flows across DOCA, host drivers, embedded firmware, BMC, management controllers and external management systems.
Specify telemetry and observability requirements, including counters, logs, traces, events, health monitoring, debug data, and streaming telemetry.
Define management interfaces and APIs for configuration, provisioning, lifecycle operations, diagnostics, and field serviceability.
Write clear architecture specifications, interface definitions, flow diagrams, and design documents for software, firmware, and system teams.
Partner with R&D teams to translate high-level architecture into implementable designs and guide features through development, validation, silicon bring-up, and production.
Analyze system performance bottlenecks, interoperability issues, telemetry gaps, and customer-reported issues, then feed learnings into future architecture.
Collaborate with system and cluster architects to ensure NIC/DPU features fit end-to-end AI datacenter and cloud networking designs.
What We Need To See:
B.Sc. or M.Sc. in Computer Engineering, Computer Science, Electrical Engineering, or equivalent experience.
9+ years of experience in networking, system software, embedded software, firmware, or datacenter infrastructure.
Proven experience in software architecture, or technical leadership roles.
Deep understanding of networking concepts and protocols such as Ethernet, TCP/IP, RDMA/RoCE, congestion control, QoS, virtualization overlays, and traffic management.
Strong background with DPUs, SmartNICs, or other high-performance networking devices.
Experience with system management, provisioning, monitoring, telemetry, diagnostics, or lifecycle-management flows.
Familiarity with management protocols and frameworks such as Redfish, PLDM, MCTP, IPMI, gNMI, SNMP, Netconf, REST, or gRPC-based APIs.
Ability to lead cross-functional architecture discussions across software, firmware, hardware, validation, product, and customer-facing teams.
Excellent written and verbal communication skills, including the ability to create clear architecture documents and present trade-offs.
Ways To Stand Out From The Crowd:
Experience defining software architecture for DPU products, including management, telemetry, QoS, performance, security, virtualization, or offload features.
Hands-on background with Linux networking, device drivers, firmware, embedded Linux, BMC software, DOCA, DPDK, OVS or Kubernetes networking.
Experience with performance counters, profiling tools, eBPF, Prometheus, Grafana, dashboards, heat maps, or large-scale telemetry systems.
Experience in defining and developing GAI-based analysis tools to extract insights from telemetry data and streams.
Background in RAS, diagnosability, serviceability, field failure analysis, production debug, or customer escalation handling.
NVIDIA is widely considered one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the industry working with us, and we are building the networking platforms that power the AI revolution. If you are passionate about NICs, DPUs, system software, and large-scale AI networking, and you want to shape the management, telemetry, QoS, and performance architecture of future NVIDIA platforms, we want to hear from you.
How we rate this
Senior Software and System Architect at NVIDIA rates 30 out of 100 for how much of the daily work is AI. That makes it Little AI (AI Level 1 of 4). The level is about AI in the job, not seniority.
Little AI. AI is not part of the work.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where software architecture was part of your work. What did you do?
- Tell me about a project where networking was part of your work. What did you do?
- Tell me about a project where distributed systems was part of your work. What did you do?
- Tell me about a project where telemetry was part of your work. What did you do?
- Walk me through how you've used Ethernet in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Software Architecture, Networking, Distributed Systems, Telemetry, and Ethernet. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new software engineering jobs by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that involve little AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step