AmazonSoftware Development Engineer II, AWS SageMaker AI Training Job
Amazon is hiring a Software Development Engineer II, AWS SageMaker AI Training Job in Bellevue, United States. It pays $144k-$194k a year and Level rates it ; you can apply on Level.
AI in this role
This is a great opportunity to join the SageMaker Training Job team, which lies at the very core of SageMaker. SageMaker Training is a set of managed services that allow customers to train machine learning models using large datasets on managed infrastructure. As the industry leader, SageMaker training is the fastest, easiest, and most cost-effective platform for data scientists to train their models. Learn more at https://docs.aws.amazon.com/sagemaker/latest/dg/how-it-works-training.html.
You will be responsible for building and maintaining mission-critical systems in our best-in-class machine learning platform, and scale those systems to support training jobs that run on hundreds of thousands of machines with less than 0.1% failure rate.
You will constantly experiment with new technologies and ideas in order to innovate on our platform and help ensure SageMaker remains best-in-class.
You will be expected to perform at the highest levels of engineering and operational excellence: building highly resilient and scalable systems, writing clear and effective documents, actively contribute to discussions on technical direction and strategy, and raise the bar on all fronts.
Most importantly, you will get to work with a team of highly talented engineers who have all answered the call above and strive for new heights every day.
Key job responsibilities
As a Software Development Engineer on the SageMaker AI team, you will:
- Design, build, test, and operate services that orchestrate foundation-model data preparation, training, evaluation, and deployment as reliable, contract-validated workflows.
- Own delivery of individual components end-to-end — from design and implementation through deployment, monitoring, and on-call operations.
- Build and extend compute-backend integrations and job launchers — submitting, monitoring, and recovering large-scale training jobs across SageMaker (Training/Processing), and AWS Batch.
- Improve the platform's resiliency and operability for long-running distributed jobs — checkpoint/resume, fault detection and recovery, retries, and observability (metrics, logging, experiment tracking).
- Contribute to the SDK, workflow orchestration, and schema/contract layer that teams use to declare and run jobs, and to the CDK infrastructure that deploys the platform.
- Integrate containerized training and evaluation frameworks (e.g., PyTorch/FSDP, verl, NeMo/Megatron) into the platform's task and recipe model.
- Contribute to design and architecture discussions, write clear technical designs, and uphold engineering best practices (code review, testing, operational readiness).
- Collaborate with ML scientists and internal customers to translate training requirements into reliable, self-service platform capabilities, and help onboard and mentor interns and new engineers as you grow.
Basic qualifications
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- 1+ years of software development engineer or related occupational experience
- 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
- 1+ years of Object Oriented Design experience
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
- Experience programming with at least one software programming language
Preferred qualifications
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Experience building complex software systems that have been successfully delivered to customers
- Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
- Experience debugging, profiling, and implementing best software engineering practices in large-scale systems
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, BELLEVUE - 143,700.00 - 194,400.00 USD annually
How we rate this
Software Development Engineer II, AWS SageMaker AI Training Job at Amazon rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- What's a project where you used PyTorch hands-on?
- Walk me through how you've used Sagemaker in your day-to-day work.
- How would you decide a model or AI system is ready to ship?
- Tell me about a time a model underperformed in production. How did you find out, and what did you change?
Adapt your resume
- List these exact terms on your resume: PyTorch and Sagemaker. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new software engineer jobs (Builds AI ●●●●) by email
One email a week with the new software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step