Member of Technical Staff, AI Training Infrastructure

Fireworks AI is hiring a Member of Technical Staff, AI Training Infrastructure for a remote role open to applicants in United States. It pays $210k-$320k a year and Level rates it ; you can apply on Fireworks AI.

Level's read on this job

On Level's scale, this role is Builds AI ●●●●: the job is building AI systems.
The posting lists this role as remote.
Tools and skills the posting cites include PyTorch, Kubernetes and Docker.
Level classifies it as a senior role.
Level lists 90 other open roles at Fireworks AI.

AI in this role

Design and optimize large-scale distributed training infrastructure and pipelines for foundation AI models.

pytorchkubernetesdockerawsgcpazure

distributed-systemsml-infrastructuretraining-pipelinesgpu-optimizationcloud-computing

About Us:

Fireworks is the platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and products. Founded by the team behind PyTorch and backed by AMD, Atreides, Benchmark Capital, Index Ventures, Lightspeed, NVIDIA, Sequoia Capital, and TCV, Fireworks powers production AI with hundreds of state-of-the-art open models across text, image, embedding, audio, and multimodal workloads. Today, Fireworks is a Series D company valued at $17.5 billion, bringing together an ambitious, collaborative team that's building the future of enterprise AI.

The Role:

As a Training Infrastructure Engineer, you'll design, build, and optimize the infrastructure that powers our large-scale model training operations. Your work will be essential to developing high-performance AI training infrastructure. You'll collaborate with AI researchers and engineers to create robust training pipelines, optimize distributed training workloads, and ensure reliable model development.

Key Responsibilities:

Design and implement scalable infrastructure for large-scale model training workloads
Develop and maintain distributed training pipelines for LLMs and multimodal models
Optimize training performance across multiple GPUs, nodes, and data centers
Implement monitoring, logging, and debugging tools for training operations
Architect and maintain data storage solutions for large-scale training datasets
Automate infrastructure provisioning, scaling, and orchestration for model training
Collaborate with researchers to implement and optimize training methodologies
Analyze and improve efficiency, scalability, and cost-effectiveness of training systems
Troubleshoot complex performance issues in distributed training environments

Minimum Qualifications:

Bachelor's degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience
3+ years of experience with distributed systems and ML infrastructure
Experience with PyTorch
Proficiency in cloud platforms (AWS, GCP, Azure)
Experience with containerization, orchestration (Kubernetes, Docker)
Knowledge of distributed training techniques (data parallelism, model parallelism, FSDP)

Preferred Qualifications:

Master's or PhD in Computer Science or related field
Experience training large language models or multimodal AI systems
Experience with ML workflow orchestration tools
Background in optimizing high-performance distributed computing systems
Familiarity with ML DevOps practices
Contributions to open-source ML infrastructure or related projects

Why Fireworks?

Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.

How we rate this

Member of Technical Staff, AI Training Infrastructure at Fireworks AI rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Member of Technical Staff, AI Training Infrastructure is an open job at Fireworks AI.
Level rates this role AI Level 4 of 4: Builds AI.
The listed salary is $210k-$320k a year.
The role is based in San Mateo and is marked remote.
The job was posted on July 31, 2026.
Seniority: senior.
Applications are handled by Fireworks AI. Apply on Fireworks AI

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Distributed SystemsML InfrastructureTraining PipelinesGPU OptimizationCloud ComputingPyTorchKubernetesDocker

Questions you could be asked

Tell me about a project where distributed systems was part of your work. What did you do?
Tell me about a project where ml infrastructure was part of your work. What did you do?
Tell me about a project where training pipelines was part of your work. What did you do?
Tell me about a project where gpu optimization was part of your work. What did you do?
Tell me about a project where cloud computing was part of your work. What did you do?

Adapt your resume

List these exact terms on your resume: Distributed Systems, ML Infrastructure, Training Pipelines, GPU Optimization, and Cloud Computing. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review Get an express CV review Check your resume with the ATS resume checker

Get new remote AI jobs (Builds AI ●●●●) by email

One email a week with the new remote AI jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.