DatadogRemote · New York, New York, USA$192k-$240k
JobgetherPosted today
Senior Site Reliability Engineer — Token Factory (Inference Platform)
Senior Site Reliability Engineer — Token Factory (Inference Platform) at Jobgether scores 85 out of 100 on AI centrality, which makes it a Level 4 role on this board.
AI in this role
Senior SRE needed to operate and optimize large-scale AI inference infrastructure for foundation models.
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Site Reliability Engineer — Token Factory (Inference Platform) based in Germany.
This is a senior engineering role focused on the reliability, performance, and observability of a large-scale AI inference platform.
You will help operate infrastructure serving foundation models across text, vision, audio, and emerging multimodal workloads.
The role combines Kubernetes, infrastructure-as-code, observability, automation, and production incident management at significant scale.
You will optimize GPU-heavy workloads, strengthen resilience, and ensure high-throughput APIs meet demanding reliability and cost targets.
You will work closely with software engineers and infrastructure teams to build self-healing systems and robust operational processes.
The environment is fast-moving, highly technical, international, and focused on solving complex infrastructure challenges for the AI ecosystem.
This is an opportunity to have a direct impact on the infrastructure powering next-generation AI applications.
L4Liked this Level 4 role? Get the best new ones weekly
Level 4 means “AI is the job”. Every week we send the highest-scoring new roles, Level 4 included, each rated Level 1 to 4. One email, no recruiter spam.
Free. One useful digest a week. Unsubscribe in one click.
Similar roles
Software Engineering roles rated Level 4 at other companies.
Abnormal SecurityRemote · Remote - USA$180k-$259k
OpenAIRemote · London, UK
Grafana LabsRemote · United Kingdom (Remote)





