# Software Development Engineer III, AWS AI/ML Servers at Amazon

Amazon is hiring a Software Development Engineer III, AWS AI/ML Servers in Seattle, United States. It pays $168k-$227k a year and Level rates it Little AI ●○○○; you can [apply on Amazon](https://jobsbylevel.com/go/9127ff73-6645-474b-a735-2ec7b79dd7ee?utm_medium=ai-agent).

AI Level 1, AI centrality 18 out of 100. US, WA, Seattle.

## Details

- Company: [Amazon](https://jobsbylevel.com/companies/amazon)
- AI level: AI Level 1 (score 18 out of 100)
- Location: US, WA, Seattle
- Salary: $168k-$227k
- Posted: September 8, 2026
- Apply: https://jobsbylevel.com/go/9127ff73-6645-474b-a735-2ec7b79dd7ee?utm_medium=ai-agent
- Free CV review for this job: https://jobsbylevel.com/cv-review?job=software-development-engineer-iii-aws-ai-ml-servers-at-amazon-6b6f8d

## Description

AWS runs the world's largest fleet of AI/ML accelerator servers. When a model with billions of parameters trains across a large scale of GPUs, the software that provisions, monitors, and heals that fleet is what keeps training on track. We build the services, control planes, and data platforms that turn hundreds of thousands of servers into a reliable, self-managing system. If you want to build software at the intersection of large-scale distributed systems and the physical infrastructure powering frontier AI, this is the role. We are seeking a Software Development Engineer to design and build the software that operates our accelerated compute fleet: fleet-management services, orchestration and remediation control planes, telemetry and analytics pipelines, and the APIs and tools that engineering, operations, and partner teams depend on. You will own software from design through production, working across multiple teams and organizations to deliver scalable, reliable services. What You Will Do You will design and build distributed services and data platforms that manage the fleet end to end. You will turn ambiguous problems into well-architected software: designing APIs, choosing data models, making the latency, availability, and cost trade-offs that come with operating at fleet scale. You will build the control planes that automate provisioning, health evaluation, and remediation, and the pipelines that transform raw telemetry into signals other teams act on. When your service catches and routes a failing node automatically before it disrupts a training job, that is your impact. Why You Will Love It Your software runs across a large scale of servers in the cloud, and you see its impact on fleet availability within days of shipping. You solve genuinely hard distributed-systems problems, own services end to end, and work close enough to the hardware to understand exactly what your software is managing. The team is small enough that your design decisions shape the architecture, and large enough that you always have experts to learn from across software, hardware, and operations. The Ideal Candidate You are a strong software engineer first: you design clean abstractions, write high-quality, testable code, and reason about correctness, scalability, and failure modes. You care about the customer of your software, whether that is an operations engineer, a partner service, or an internal tool user. You communicate clearly, raise the engineering bar for your team, and can partner with hardware, firmware, and operations engineers to build software that reflects how the fleet actually behaves. Key job responsibilities Service & Platform Development 1. Design, build, and operate scalable distributed services and control planes that automate fleet provisioning, health evaluation, and remediation across a large scale of servers 2. Design APIs, data models, and system architectures that balance latency, availability, durability, and cost at fleet scale 3. Own software end to end: design, implementation, testing, deployment, and production operations, following engineering best practices for code review, source control, and CI/CD Data & Telemetry Platforms 1. Build data and telemetry pipelines that ingest, correlate, and transform signals from across the fleet into actionable insights and automated actions 2. Develop analytics and reporting services, dashboards, and alerting that give engineering and operations teams real-time visibility into fleet health 3. Apply appropriate algorithms and data structures to process high-volume telemetry efficiently and reliably Reliability & Operational Excellence 1. Instrument services for observability; participate in post-incident reviews, identify contributing causes, and drive permanent software fixes that eliminate whole classes of risk 2. Improve the resilience, performance, and cost of the services you own, and reduce operational load through automation 3. Produce clear, maintainable documentation

The description is cut here. Read the full offer: https://jobsbylevel.com/jobs/software-development-engineer-iii-aws-ai-ml-servers-at-amazon-6b6f8d

Source: https://jobsbylevel.com/jobs/software-development-engineer-iii-aws-ai-ml-servers-at-amazon-6b6f8d

## Cite this page

Level. https://jobsbylevel.com/jobs/software-development-engineer-iii-aws-ai-ml-servers-at-amazon-6b6f8d.

Get job alerts: https://jobsbylevel.com/newsletter