Senior System Management Architect
NVIDIA is hiring a Senior System Management Architect. Level rates it ; you can apply on NVIDIA.
Level's read on this job
- Works on AI ●●●○ is how Level rates this role: the daily work is on AI products, without building the model.
- Tools and skills the posting cites include Red Fish, Pldm and Spdm.
- Level classifies it as a senior role.
- Level lists 2,700+ other open roles at NVIDIA.
AI in this role
Architect next-generation management infrastructure and protocols for large-scale AI data center factories and hardware platforms.
Our Host Management Team focuses on AI factory management infrastructure. We define the next-generation management architecture of the data center — top-down, clusters, racks, platforms and multi-SoC trays. The architecture covers end-to-end flows for power-on, reset and boot sequences, power saving, management protocols to keep the system operating securely and reliably.
We are seeking a Senior System Management Architect to join our growing team. You will be the resident expert for system management, ensuring that AI factory management components (BMCs, MCUs, CPUs, network switches and CPLDs) operate in perfect unison. You will own the lifecycle management specifications for AI factory platforms — from factory provisioning to day-one deployment. If you enjoy studying a high-level system diagram and then immediately diving into the system-level buses and interface signals topology and the associated host management protocols modeling required to make it work, this role is for you.
What you'll be doing:
System Architecture & Flow Definition: Define and document comprehensive production, provisioning, update, recovery, and reset flows for AI factory sub-systems.
Ensure system-level architectural alignment and orchestrate seamless coordination between all the AI-Factory building blocks: GPU, DPU, CPU, Switch ASIC, NIC ASIC, BMC, and peripheral components.Protocol Implementation & Guidance: Specify the use of standard management protocols (Red-Fish, NSM, PLDM, SPDM, MCTP, NC-SI) across sub-system interfaces to implement the management tasks.
Hardware/Software Intersect: Define system-level hardware and software behavior, including CPLD logic requirements, power-sequencing dependencies, and reset orchestration (e.g., handling PCIe PERST#, SBR, and forced resets).
Interface Management: Architect intra-board communication pathways using PCIe, I2C/I3C, USB, and SPI, ensuring robust out-of-band (OOB) and in-band management connectivity.
Cross-Functional Leadership: Collaborate with Production, Hardware and Firmware Engineering, ASIC FW/Driver teams, SW/NOS teams and QA to translate architectural specifications into implementable, testable solutions.
Technical Documentation: Author rigorous technical specifications, test plans, and architectural design documents to guide development and factory production.
What we need to see:
Deep System-Level Perspective: Proven ability to understand complex computing or networking systems top-to-bottom, with a background in networking architectures and efficiency and power saving methods.
Protocol Fluency: Strong working knowledge of modern platform management and security protocols.
Hardware Interface Knowledge: Familiarity with board-level communication buses (I2C, I3C, SPI, USB) and system interconnects (PCIe architecture, including link states and reset mechanisms).
Analytical Documentation Skills: Exceptional ability to write clear, unambiguous technical specifications, state-machine descriptions, and sequence diagrams.
Experience: BS/MS in Electrical Engineering, Computer Engineering, Computer Science, or a related field, with 5+ years of relevant industry experience.
Ways to stand out from the crowd:
Experience with power-saving methods.
Background with Redfish RESTful API definitions and OOB network infrastructure.
Familiarity with hardware RoT concepts and secure boot architectures.
Experience with production line tooling, factory provisioning, and manufacturing test flows.
Background in networking principles, Switch, NIC/SmartNIC data-plane and offload operations, or high-speed data center topologies.
How we rate this
Senior System Management Architect at NVIDIA rates 70 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where system architecture was part of your work. What did you do?
- Tell me about a project where hardware design was part of your work. What did you do?
- Tell me about a project where firmware was part of your work. What did you do?
- Tell me about a project where data center management was part of your work. What did you do?
- Walk me through how you've used Red Fish in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: System Architecture, Hardware Design, Firmware, Data Center Management, and Red Fish. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new software engineering jobs (Works on AI ●●●○ or higher) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step