Senior AI Storage Software Architect
NVIDIA is hiring a Senior AI Storage Software Architect. Level rates it ; you can apply on NVIDIA.
Level's read on this job
- Level rates this role Builds AI ●●●●: the job is building AI systems.
- Tools and skills the posting cites include vLLM, RAG and storage architecture.
- Level classifies it as a senior role.
- Level lists 1,800+ other open roles at NVIDIA.
AI in this role
Design and architect the next generation of storage solutions specifically tailored for AI workloads, training, and inference.
We are looking for a Storage Software Architect to join the architecture group. You will be part of a team that shapes the next generation of storage for AI: training, inferencing, KV cache, RAG and more. Utilizing the best from NVIDIA's network products, DPUs and NICs, working closely with hardware architects, SW architects and external customers, defines the programming interfaces, protocols and management. We have crafted a team of extraordinary people stretching around the globe, whose mission is to push the frontiers of what is possible today and define the platform of tomorrow. At NVIDIA, we work, think and learn as a team. We thrive in a deeply strong environment and we're passionate about a culture that demands innovation and the highest standards. The rewards are sweet and include collaborating with some of the smartest people in the industry, an aggressive compensation plan that rewards top performers, and the opportunity to work on products that transform the way people work and play.
What you’ll be doing:
Define how storage for AI clusters should look like
Research and analyze AI storage workloads, POC ways to optimize them
Design the storage SW stack for AI, APIs, and offloads
Lead hands-on POCs
Drive HW features to next generation of DPUs and NICs
What we need to see:
B.Sc., M.Sc. or Ph.D. in Computer Science or related discipline
5+ years of experience in a storage company as senior developer or an architect
Experience with AI applications, training and inference, KV cache, RAG, vLLM, NIMs, etc
Ability to quickly adapt to new technology and go deep into new areas
Can work independently
Strong communication skills
Able to work with customers and partners
Drive new solutions based on any issues that arise
NVIDIA has continuously reinvented itself over two decades. NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. This is our life’s work — to amplify human imagination and intelligence.
With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and talented people in the world working for us and, due to extraordinary growth, our elite engineering teams are fast-growing fast. If you're a creative and autonomous manager with a sincere real passion for technology, we want to hear from you.
How we rate this
Senior AI Storage Software Architect at NVIDIA rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How would you design a retrieval step so the model answers from real data instead of guessing?
- Tell me about a project where storage architecture was part of your work. What did you do?
- Tell me about a project where ai infrastructure was part of your work. What did you do?
- Tell me about a project where distributed systems was part of your work. What did you do?
- Walk me through how you've used vLLM in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: RAG, Storage Architecture, AI Infrastructure, Distributed Systems, and vLLM. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. You get your review by email within 24 hours.
Get new software engineering jobs (Builds AI ●●●●) by email
One email a week with the new software engineering jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step