Lead/Manager Together Cloud Infrastructure

Together AI is hiring a Lead/Manager Together Cloud Infrastructure in Amsterdam, Netherlands. Level rates it ; you can apply on Together AI.

Level's read on this job

Builds AI ●●●● is how Level rates this role: the job is building AI systems.
Some of the work can be done remotely, according to the posting.
The posting mentions Cursor, Elevenlabs and Decagon among its tools and skills.
Level classes it as a lead role.
Together AI has 83 other open roles on Level.

AI in this role

Lead an infrastructure engineering team building global distributed cloud platforms for AI compute and LLM inference.

cursorelevenlabsdecagonkubernetesslurmpythongo

fine-tuningdistributed-systemscloud-infrastructureteam-leadershipgpu-scheduling

About the Role

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.

As a Lead/Manager, you will play a key role in building the Together cloud platform engineering team in the Netherlands.

We are a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables state-of-the-art ML practitioners with self-serve AI cloud services, such as on-demand + managed Kubernetes and Slurm clusters. This platform serves both our internal SaaS products (inference, fine-tuning) and our external cloud customers, spanning dozens of data centers across the world.

Some of what you’ll work on:

Work on a distributed GPU scheduling system for the on-demand clusters product, Instant Clusters.
Build out a global management plane for managing our data center compute, networking, and storage.
Design and build new customer-facing cloud platform services, delivering killer enterprise AI cloud features.

Hybrid working 2 days a week at our offices in Amsterdam

Responsibilities

Lead/Manage a team of 8 together cloud Infrastructure Engineer in Amsterdam,
Identify, design, and develop foundational backend services that power Together’s commerce platform
Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure
Partner with product teams to understand functional requirements and deliver solutions that meet business needs
Write clear, well-tested, and maintainable software and IaC for both new and existing systems
Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
Participate in an on-call rotation to address critical incidents when necessary

Requirements

Ideally 1-2 years of leading the Infrastructure team.
Demonstrable background in acquiring talent and retaining talent.
5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices
Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
Demonstrated experience with building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers (AWS, Azure, GCP)
Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale
Experience developing against and managing a relational database, such as PostgreSQL
Expert-level programmer in one or more of programming language (Golang preferred)
Proficiency in version control practices and integrating IaC with CI/CD pipelines.
Experience with Kubernetes and containers preferred
Experience building and operating data infrastructure (Kinesis, Airflow, Kafka, etc) a plus
Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience

About Together AI

Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

How we rate this

Lead/Manager Together Cloud Infrastructure at Together AI rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Lead/Manager Together Cloud Infrastructure is an open job at Together AI.
Level rates this role AI Level 4 of 4: Builds AI.
The role is based in Amsterdam and is marked remote.
The job was posted on June 2, 2026.
Seniority: lead.
Applications are handled by Together AI. Apply on Together AI

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Fine-tuningDistributed SystemsCloud InfrastructureTeam LeadershipGPU SchedulingCursorElevenlabsDecagon

Questions you could be asked

Walk me through fine-tuning a model: what data did you use, and how did you check the result?
Tell me about a project where distributed systems was part of your work. What did you do?
Tell me about a project where cloud infrastructure was part of your work. What did you do?
Tell me about a project where team leadership was part of your work. What did you do?
Tell me about a project where gpu scheduling was part of your work. What did you do?

Adapt your resume

List these exact terms on your resume: Fine-tuning, Distributed Systems, Cloud Infrastructure, Team Leadership, and GPU Scheduling. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review Get an express CV review Check your resume with the ATS resume checker

Get new remote AI jobs (Builds AI ●●●●) by email

One email a week with the new remote AI jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.