Member of Technical Staff, Model Training (infra & platform)
micro1 is hiring a Member of Technical Staff, Model Training (infra & platform) for a remote role. It pays $200k-$320k a year and Level rates it ; you can apply on micro1.
Level may earn a referral fee if you apply to a micro1 role through an Apply link. It does not change the order of jobs. How this works
Level's read on this job
- Builds AI ●●●● is how Level rates this role: the job is building AI systems.
- This is listed as a remote role.
- The posting mentions vLLM, PyTorch and Python among its tools and skills.
- micro1 has 340 other open roles on Level.
- Posted in the last few days.
AI in this role
Build and scale distributed infrastructure and platforms for training advanced AI models and agent ecosystems.
Job Title: Member of Technical Staff, Model Training (infra & platform)
Job Type: Full-time
Location: Remote
The Role
In this role, you will take technical ownership of the distributed systems and platforms that enable researchers to train increasingly capable models, execute large-scale experiments, and deploy specialized AI systems efficiently.
You will work across distributed training, GPU infrastructure, inference optimization, simulation environments, and agent execution frameworks, making critical architectural decisions that directly influence research velocity and model performance.
What You'll Do
- Architect, build, and scale shared infrastructure for supervised fine-tuning (SFT), reinforcement learning (RL), and on-policy distillation (OPD), supporting language, multimodal, and robotics workloads.
- Design distributed training and execution pipelines that coordinate GPU workers, rollout generation, teacher-model inference, reward computation, and simulation environments.
- Develop high-performance infrastructure for model training and inference, optimizing GPU utilization, memory management, communication, storage, and distributed execution.
- Build and evolve the core architecture of micro1's agent ecosystem, including execution runtimes, tool interfaces, environment integrations, model registries, and serving APIs.
- Develop robust systems for experiment tracking, dataset and model versioning, checkpointing, fault recovery, and observability to improve research reproducibility and operational reliability.
- Identify and eliminate infrastructure bottlenecks, reducing experiment turnaround time and enabling researchers to run increasingly complex training workloads.
- Define technical standards, platform interfaces, and architectural patterns that support collaboration across research, infrastructure, and applied engineering teams.
- Lead critical engineering initiatives from system design through implementation and production operations, mentoring engineers while maintaining direct ownership of technically challenging components.
What We're Looking For
- Strong computer science fundamentals, particularly in distributed systems, concurrency, networking, and performance engineering.
- Extensive experience designing, building, and operating scalable backend systems or distributed computing platforms.
- Proficiency in Python and at least one systems-oriented programming language, such as C++, Rust, or Go.
- Hands-on experience with GPU-based machine learning infrastructure, distributed training, model inference, or large-scale compute orchestration.
- Strong understanding of system performance, including compute utilization, memory efficiency, communication overhead, scheduling, and fault tolerance.
- Experience designing reliable APIs, services, and infrastructure components that support complex engineering or research workflows.
- Demonstrated technical ownership, including making architectural decisions, leading cross-functional initiatives, and delivering systems that other engineers depend on.
- Ability to operate effectively in fast-moving research environments where requirements evolve and infrastructure must support rapid experimentation.
Nice to Have
- Experience with distributed ML frameworks and technologies such as PyTorch Distributed, DeepSpeed, Ray, Megatron-LM, or similar systems.
- Familiarity with GPU inference engines and optimization frameworks such as vLLM, TensorRT-LLM, or equivalent technologies.
- Experience building reinforcement learning infrastructure, rollout orchestration systems, or distributed agent execution environments.
- Knowledge of CUDA, GPU kernel optimization, NCCL, or low-level GPU performance engineering.
- Experience with Kubernetes, container orchestration, cluster scheduling, and cloud-based GPU infrastructure.
- Familiarity with simulation platforms, robotics infrastructure, or large-scale agent evaluation systems.
- Contributions to open-source infrastructure, distributed computing frameworks, or high-performance machine learning systems.
Compensation & Benefits Notice
The national pay range for this full-time position is base salary of $200,000 –$320,000. All employees are eligible for equity compensation, and employees may also receive performance-based bonuses, dependent on role and subject to company policies. micro1 provides a comprehensive benefits package, including up to 100% reimbursement for health-insurance premiums, paid time off, a 401(K) plan with a company match, and additional benefits designed to support a high-performing, remote-first workforce.
micro1 is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, veteran status, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation during the application process, reach out to support@micro1.ai.
Our hiring process utilizes artificial intelligence tools to assist in candidate screening and assessment. Our AI tools are designed to complement, not replace, human decision-making.
How we rate this
Member of Technical Staff, Model Training (infra & platform) at micro1 rates 95 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Walk me through fine-tuning a model: what data did you use, and how did you check the result?
- Tell me about a project where distributed systems was part of your work. What did you do?
- Tell me about a project where model training was part of your work. What did you do?
- Tell me about a project where infra was part of your work. What did you do?
- Tell me about a project where mlops was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: Fine-tuning, Distributed Systems, Model Training, Infra, and MLOps. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new remote AI jobs (Builds AI ●●●●) by email
One email a week with the new remote AI jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Other roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next stepMore jobs at micro1
About micro1 as a platform
Level reads micro1’s own pages for pay, entry steps and accepted countries, and sets them beside the other platforms. See the micro1 platform page or compare AI training platforms.