AmazonPosted 2mo ago
Software Dev Engineer II, Stores Foundational AI -SFAI at Amazon scores 96 out of 100 on AI centrality, which makes it AI Level 4 of 4 (Builds AI) on this board. The level measures how much of the work is AI, not seniority.
AI in this role
As a Software Development Engineer, you will solve challenging data and distributed-systems problems at the center of Amazon’s next-generation shopping AI. You will build scalable data platforms and intelligence capabilities that transform billions of customer interactions into high-quality training data, learning signals, and insights that directly improve large language models, agentic systems, and customer experiences.
You will own important components spanning data ingestion, behavioral analysis, dataset generation, and experimentation and evaluation for large language models and AI agents. Working closely with applied scientists and experienced engineers, you will turn complex research and product needs into reliable production systems and help pioneer automated, agent-driven workflows for continuous model improvement.
Key job responsibilities
1, Design, build, and operate scalable systems that transform real customer interactions into high-quality datasets, behavioral signals, and actionable insights for model training, post-training, and evaluation.
2, Develop data intelligence capabilities to analyze customer behavior, identify meaningful patterns and model quality gaps, and discover signals that improve large language models and agentic systems.
3, Build reliable pipelines and self-service tools for data ingestion, filtering, sampling, aggregation, dataset generation, quality validation, and exploratory analysis.
4, Partner with applied scientists to define metrics, analyze experiments, evaluate training data effectiveness, and translate findings into improved data recipes and learning signals.
5, Develop automated and agent-driven workflows for data curation, anomaly detection, experimentation, evaluation, and continuous model improvement while maintaining high standards for privacy, security, scalability, and operational excellence.
Preferred qualifications
1, Experience building large-scale data platforms, analytical systems, or data products using technologies such as Spark, Flink, SQL, distributed storage, or workflow orchestration systems.
2, Experience analyzing large and complex datasets to identify customer behavior patterns, data quality issues, and opportunities to improve machine learning models.
3, Experience defining metrics and building data quality monitoring, anomaly detection, or self-service analytics capabilities.
4, Knowledge of experimental design, statistical analysis, sampling methodologies, and techniques for measuring the impact of data or model changes.
5, Experience partnering with applied scientists, data scientists, or machine learning engineers to translate ambiguous analytical requirements into scalable production systems.
6, Knowledge of machine learning and large language model workflows, including training data preparation, post-training, experimentation, evaluation, model behavior analysis, agentic systems, and feedback loops.
Basic qualifications
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language
- Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques
Preferred qualifications
- Knowledge of ML frameworks including JAX, PyTorch, vLLM, SGLang, Dynamo, TorchXLA, and TensorRT
- Knowledge of system performance, memory management, and parallel computing principles
- Experience with CUDA/C++/Kernel development
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, CA, Palo Alto - 165,200.00 - 223,600.00 USD annually
USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Walk me through how you've used vLLM in your day-to-day work.
- What are the limits of PyTorch that you've run into, and how did you work around them?
- What's a project where you used Jax hands-on?
- How would you decide a model or AI system is ready to ship?
Adapt your resume
- List these exact terms on your resume: AI Agents, vLLM, PyTorch, and Jax. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.
Want your resume actually rewritten for this job?
The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.
Similar roles
Software Engineering roles rated AI Level 4 at other companies.
DatabricksNew York City, New York$200k-$265k4h ago
MercorSan Francisco$250k-$500k4h ago
WaymoMountain View, CA, USA$85/hr4h ago
Anduril IndustriesCosta Mesa, California, United States; Seattle, Washington, United States; Washington, District of Columbia, United States$191k-$253k7h ago
TuringHyderabad, Telangana, India11h ago
Sword HealthRemote · Remote - Portugal€50k-€72k14h ago
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step





