Applied Scientist, Artificial General Intelligence, Foundational AI

Amazon is hiring an Applied Scientist, Artificial General Intelligence, Foundational AI in Bellevue, United States. It pays $136k-$184k a year and Level rates it ; you can apply on Amazon.

Level's read on this job

Level rates this applied scientist role Builds AI ●●●●: the job is building AI systems.
The posting mentions Python, Java and C among its tools and skills.
Level classes it as a senior role.
Amazon has 20,000+ other open roles on Level.

AI in this role

Develop quality strategies, evaluation frameworks, and LLM-as-a-Judge systems for foundational AI models.

PythonJavaCSQL

machine-learningllmauditingquality-assurance

The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems.

Key job responsibilities
As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services.

A day in the life
An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.

Basic qualifications

- Master's degree in computer science, mathematics, statistics, machine learning or equivalent quantitative field
- Experience programming in Java, C++, Python or related language
- Experience with SQL and an RDBMS (e.g., Oracle) or Data Warehouse

Preferred qualifications

- Experience implementing algorithms using both toolkits and self-developed code
- Have publications at top-tier peer-reviewed conferences or journals

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, BELLEVUE - 136,000.00 - 184,000.00 USD annually

How we rate this

Applied Scientist, Artificial General Intelligence, Foundational AI at Amazon rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Applied Scientist, Artificial General Intelligence, Foundational AI is an open job at Amazon.
Level rates this role AI Level 4 of 4: Builds AI.
The listed salary is $136k-$184k a year.
The role is based in US, WA, Bellevue.
The job was posted on August 26, 2026.
Seniority: senior.
Applications are handled by Amazon. Apply on Amazon

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Machine learningLLMAuditingQuality AssurancePythonJavaCSQL

Also common in applied scientist jobs at this level

Deep learning Generative AI NLP Reinforcement learning TensorFlow Spark

Pay

This job starts at: $136k
Typical applied scientist job: $169k

This posting starts 20% below the typical applied scientist job. See applied scientist jobs

Questions you could be asked

Tell me about a project where machine learning was part of your work. What did you do?
Tell me about a project where llm was part of your work. What did you do?
Tell me about a project where auditing was part of your work. What did you do?
Tell me about a project where quality assurance was part of your work. What did you do?
Walk me through how you've used Python in your day-to-day work.

Adapt your resume

List these exact terms on your resume: Machine learning, LLM, Auditing, Quality Assurance, and Python. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email within 3 days.

Get a free CV review Check your resume with the ATS resume checker