Level

NVIDIA

Senior Solutions Architect, AI and HPC Infrastructure

NVIDIA is hiring a Senior Solutions Architect, AI and HPC Infrastructure for a remote role open to applicants in United States. It pays $184k-$288k a year and Level rates it ; you can apply on NVIDIA.

Level's read on this job

  • Level rates this solutions architect role Builds AI ●●●●: the job is building AI systems.
  • Pay on this posting starts 9% higher than the typical solutions architect posting on Level.
  • This is listed as a remote role.
  • The posting mentions RAG and fine tuning among its tools and skills.
  • NVIDIA has 2,700+ other open roles on Level.

AI in this role

ragfine-tuning

NVIDIA is seeking an outstanding AI Solutions Architect to assist and support energy-sector customers — power generation, oil & gas, transmission and distribution / grid, and renewables — as they build and operate AI infrastructure on NVIDIA's accelerated computing platforms. At NVIDIA, our solutions architects work across product, engineering, sales, developer relations, business development, and partner teams to help customers design, deploy, and optimize AI infrastructure for the energy industry. This role will focus on helping energy accounts from datacenter to the edge adopt NVIDIA accelerated infrastructure for training, fine-tuning, inference, retrieval, and agentic AI and HPC workloads. This is an excellent opportunity to work in an interdisciplinary team at NVIDIA! You will serve as a technical advisor for accelerated systems architecture, GPU and networking systems, cluster design, orchestration, validation, and production deployment for AI data centers and edge environments serving energy customers.

 

We need a curious, collaborative, and creative individual to advance these opportunities across AI infrastructure, industrial digital twins, and accelerated computing for the energy sector, and to become a trusted technical advisor bridging our industry, infrastructure, and partner teams. Engaging with internal developers, researchers, data scientists, and senior leaders is a core part of the role and offers exposure to a wide range of partners and challenges.

 

What you'll be doing:

  • Partner with energy-sector customers, ISVs, and account teams on discovery, architecture reviews, technical deep dives, POCs, benchmarks, demos, and production deployment guidance for AI infrastructure.
  • Advise on the design, build-out, and optimization of accelerated AI infrastructure for energy customers, including large-scale GPU clusters, AI factories, and edge deployments.
  • Support infrastructure design across compute, networking, storage, containers, observability, security, power, and data center operations for energy-sector AI workloads.
  • Drive adoption of systems monitoring, telemetry, and management tools to improve cluster utilization, reliability, performance, and workload insight.
  • Document what you learn and teach others — through targeted samples, whitepapers, blogs, and working through hard problems with customers.
  • Build repeatable reference architectures, deployment guides, sizing guidance, benchmark reports, technical playbooks, demos, and whitepapers for energy-sector AI infrastructure.
  • Strategically partner with flagship customers and industry-specific solution partners targeting our computing platform.
  • Collaborate primarily through virtual tools, and be empowered to find the best way to make our partners and customers successful. Travel up to 20% for customer meetings may be required.

 

What we need to see:

  • BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, Physics, other Engineering, or related field (or equivalent experience).
  • 8+ years of hands-on experience in AI infrastructure, accelerated computing, distributed systems, cloud infrastructure, high-performance computing, or machine learning platforms, with strong experience designing, deploying, and operating accelerated computing infrastructure at scale.
  • In-depth knowledge of AI cluster orchestration, scheduling, automation, and CI/CD deployment pipelines, and understanding of data center networking technologies such as InfiniBand, Ethernet, RDMA, network configuration, and performance tuning.
  • Familiarity with infrastructure requirements for AI workloads, including distributed training, inference serving, model deployment, storage performance, and cluster reliability.
  • Working knowledge of one or more energy sectors (power generation, oil & gas, transmission and distribution / grid, or renewables) and their operational and IT environments.
  • Excellent presentation, communication, problem-solving, documentation, and collaboration skills.
  • Strong problem structuring and the self-direction to drive ambiguous, multi-stakeholder projects to results.

 

Ways to stand out from the crowd:

  • Experience architecting AI factories, large GPU clusters, multi-node training environments, or production inference platforms.
  • Experience deploying LLM training, fine-tuning, RAG, and inference workflows on large-scale AI infrastructure.
  • Experience evaluating cluster performance using benchmarks such as MLPerf, HPL, or workload-specific performance tests.
  • Applications and systems-level knowledge of OpenMPI, NCCL, distributed training frameworks, and GPU communication patterns.
  • Comfortable with modern application-deployment practices such as Docker/Containers and Kubernetes.


NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 24, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

How we rate this

Senior Solutions Architect, AI and HPC Infrastructure at NVIDIA rates 86 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

RAGFine-tuning

Also common in solutions architect jobs at this level

Pay

This job starts at
$184k
Typical solutions architect job
$169k

This posting starts 9% above the typical solutions architect job. See solutions architect jobs

Questions you could be asked

  1. How would you design a retrieval step so the model answers from real data instead of guessing?
  2. Walk me through fine-tuning a model: what data did you use, and how did you check the result?
  3. How would you decide a model or AI system is ready to ship?
  4. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: RAG and Fine-tuning. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new remote solutions architect jobs (Builds AI ●●●●) by email

One email a week with the new remote solutions architect jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Sales roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at NVIDIA

More solutions architect jobs

Related searches

Same AI level