Skip to content

Graphcore

AI Platform Architect

Graphcore is hiring an AI Platform Architect in Austin, United States. Level rates it ; you can apply on Graphcore.

Level's read on this job

  • On Level's scale, this role is Builds AI ●●●●: the job is building AI systems.
  • Tools and skills the posting cites include PyTorch and AI research.
  • Level classifies it as a mid-level role.
  • Level lists 194 other open roles at Graphcore.
  • The role was posted in the last few days.

AI in this role

PyTorch
ai-research

About us

Graphcore is one of the world’s leading innovators in Artificial Intelligence compute.

It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry.

As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone.

Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore enjoys a culture of continuous learning and constant innovation.

Job Summary

We are seeking for a visionary AI Platform Architect to design and oversee the comprehensive infrastructure stack that powers our most demanding distributed AI workloads. Moving beyond individual hardware components, this role acts as the unifying technical authority across hardware, software, compute, network, and storage. You will be responsible for architecting a cohesive, AI rack scale platform optimized for

trillion-parameter LLM training and high-throughput inference. By orchestrating everything from advanced clustering and distributed training frameworks down to the physical layer—spanning PCIe Gen 5/6 pathways, NVMe storage topologies, and RDMA fabrics—you will ensure our AI research and deployment teams have a flawless, frictionless, and extraordinarily powerful platform at their disposal.

Responsibilities and Duties

  • End-to-End Platform Architecture: Define the holistic architecture for highly clustered AI environments, ensuring zero-bottleneck data flow between parallel storage systems, AI compute nodes, and ultra-high-bandwidth network fabrics.
  • Workload Orchestration: Influence the strategy for AI workload scheduling and orchestration, utilizing tools like Kubernetes or Slurm to manage distributed training jobs, model check-pointing, and inference serving at massive scale.
  • Full-Stack Optimization: Profile and eliminate system-level bottlenecks across the entire AI pipeline, tuning everything from deep learning frameworks (PyTorch, DeepSpeed, etc.) down to OS-level NUMA pinning and I/O scheduling.
  • Hardware-Software Co-design: Work closely with software, firmware, and OS engineering to influence platform design, ensuring the software stack fully exploits underlying hardware capabilities, including complex ARM mesh interconnects (RNI, HNF, SNF) and advanced merchant silicon features.
  • Silicon Influencing Strategy: Drive the 3-to-5-year technical vision for the AI platform. Collaborate closely with subject matter experts in processor, memory, storage, GPU, thermal, mechanical, BIOS, and Manageability disciplines to define requirements specifications to communicate and present to internal and external silicon teams to influence features, optimized board routing guidelines, power and thermal targets, and the correct feeds and speeds for a competitive AI platform. This will require a deep knowledge of the AI industry and significant market competitive analysis including TCO (OPEX / CAPEX) analysis of new technologies.

Candidate Profile

Essential:

  • Experience: Demonstrated ability in systems engineering, cloud architecture, or HPC, hardware engineering with at least 4+ years functioning as a Lead or Principal Architect for large-scale AI or machine learning platforms.
  • Distributed AI Frameworks: Deep practical knowledge of how large models are trained and deployed, including data/tensor/pipeline parallelism and the infrastructure requirements of modern LLM architectures.
  • Systems Interconnects: Authoritative understanding of system-level bottlenecks and data pathways, including deep familiarity with PCIe Gen 5/6, NVMe namespaces, and RDMA (RoCEv2/InfiniBand) integration.
  • Orchestration & Containerization: Experience with container orchestration platforms and infrastructure-as-code (IaC) tailored for GPU-heavy bare-metal and cloud environments.
  • Cross-Domain Leadership: Exceptional ability to bridge the gap between AI researchers/data scientists and low-level hardware/CPU/memory/storage/GPU/network engineers, translating model requirements into strict infrastructure specifications. Ability to generate Platform engineering requirement specifications that can be used to guide and influence future silicon designs.

Desirable

  • Rack scale GPU AI Platforms experience: Hands on experience with rack-as-a-system
  • AI platforms that integrate all the latest networking, cooling, and GPU technologies currently present in the market.
  • Software / Scripting experience: Working knowledge of scripting language such as Python/JSON to characterize workloads on bare metal AI compute systems to expose issues with current Neural engine silicon solutions.

In addition to a competitive salary, Graphcore offers flexible working and a comprehensive benefits package designed to support your health, wellbeing and financial future. Our benefits include medical, dental and vision coverage, Flexible Spending Accounts (FSAs), Health Savings Accounts (HSAs), disability and life insurance, a 401(k) retirement plan, commuter benefits, wellness services and an Employee Assistance Programme (EAP). We welcome people of different backgrounds and experiences; we're committed to building an inclusive work environment that makes Graphcore a great home for everyone. We offer an equal opportunity process and understand that there are visible and invisible differences in all of us. We can provide a flexible approach to interview and encourage you to chat to us if you require any reasonable adjustments.

How we rate this

AI Platform Architect at Graphcore rates 91 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI ResearchPyTorch

Questions you could be asked

  1. Tell me about a research question you investigated. What did you find?
  2. Walk me through how you've used PyTorch in your day-to-day work.
  3. How would you decide a model or AI system is ready to ship?
  4. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: AI Research and PyTorch. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email usually within a few hours.

Get new software engineering jobs (Builds AI ●●●●) by email

One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free.

Similar roles

Software Engineering roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Graphcore

Related searches

Same AI level

Jobs by city