Senior Software Development Engineer, EC2 Trainium AI Infra
AI in this role
Lead the design and operation of infrastructure services and provisioning for AWS Trainium-based AI servers.
Key job responsibilities
- Lead the design and development of infrastructure systems that support AI workloads on UltraServers, ensuring reliability and performance at scale.
- Own your team's architectural direction for provisioning systems, influencing technical decisions across dependent systems and driving alignment with partner teams.
- Collaborate with capacity management, hardware engineering, and datacenter teams to improve provisioning workflows and operate efficiently at scale.
- Mentor and coach engineers on the team, driving adoption of engineering best practices and raising the technical bar across the organization.
- Investigate complex performance challenges, develop solutions, and publish actionable best practices to internal and external stakeholders.
A day in the life
You might start your morning reviewing operational metrics for provisioning pipelines, then shift into a design review with hardware engineering partners on an upcoming server configuration. After lunch, you could be deep in code — prototyping a new microservice or refactoring a critical path in the provisioning workflow. Throughout the day, you balance hands-on technical work with mentoring teammates, unblocking cross-team dependencies, and contributing to architectural decisions that shape how AI infrastructure scales.
About the team
The EC2 UltraServer Provisioning team is responsible for delivering AWS Trainium-based UltraServer infrastructure at scale. We manage end-to-end provisioning workflows from host ingestion through testing, repair, and recovery. Our mission is to ensure that AI/ML customers have reliable, high-performance compute infrastructure ready when they need it. We are a collaborative engineering team that values technical depth, operational excellence, and building systems that grow with customer demand.
Basic qualifications
- 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team
Preferred qualifications
- 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually
How we rate this
Senior Software Development Engineer, EC2 Trainium AI Infra at Amazon rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where software development was part of your work. What did you do?
- Tell me about a project where infrastructure was part of your work. What did you do?
- Tell me about a project where provisioning was part of your work. What did you do?
- Tell me about a project where system architecture was part of your work. What did you do?
- Walk me through how you've used AWS Trainium in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Software Development, Infrastructure, Provisioning, System Architecture, and AWS Trainium. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get a free CV reviewGet new software engineer jobs (Builds AI ●●●●) by email
One email a week with the new software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step