# Applied Scientist, Agentic AI, AWS Governance at Amazon

Amazon is hiring an Applied Scientist, Agentic AI, AWS Governance in Seattle, United States. It pays $143k-$193k a year and Level rates it Builds AI ●●●●; you can [apply on Amazon](https://jobsbylevel.com/go/380fdaea-fd92-4c00-b471-c78964e32a42?utm_medium=ai-agent).

AI Level 4, AI centrality 97 out of 100. US, WA, Seattle.

## Details

- Company: [Amazon](https://jobsbylevel.com/companies/amazon)
- AI level: AI Level 4 (score 97 out of 100)
- Location: US, WA, Seattle
- Salary: $143k-$193k
- Posted: October 26, 2026
- Apply: https://jobsbylevel.com/go/380fdaea-fd92-4c00-b471-c78964e32a42?utm_medium=ai-agent
- Free CV review for this job: https://jobsbylevel.com/cv-review?job=applied-scientist-agentic-ai-aws-governance-at-amazon-c5a953

## Prepare for this job

The job page lists 5 likely interview questions for this offer, with a CV checklist: https://jobsbylevel.com/jobs/applied-scientist-agentic-ai-aws-governance-at-amazon-c5a953

## Description

Do you want to build the ML models that power every compliance verdict customers and auditors rely on? We are building a new Governance, Risk, and Compliance (GRC) service at AWS where every action — human or agent — is recorded, assessed, and provably governed, continuously and at any scale. As an Applied Scientist on this team, you will own the Natural Language Inference (NLI) model at the center of our compliance engine: fine-tuning, calibrating, and monitoring it in production. You will also design the science behind framework decomposition, evidence auto-linking, and a new agent-context system that tackles retrieval, grounding, and hallucination measurement for AI agents. Your work will directly shape the accuracy and trustworthiness of every customer-visible result we produce. Key job responsibilities - Own the production NLI model end-to-end: fine-tune, promote, calibrate thresholds, and monitor for drift to ensure accurate compliance verdicts across frameworks. - Design and implement framework decomposition pipelines that translate compliance controls into NLI hypotheses, including enrichment and per-framework threshold calibration. - Build and improve the evidence auto-linking system using ranking, embedding, and reranking techniques, tuning precision-recall tradeoffs and addressing OCR quality challenges. - Drive the quality flywheel by establishing labeling standards, designing offline and online evaluation methods, orchestrating retraining cycles, and ensuring privacy-safe data handling. - Research and develop the agent-context capability — retrieval and representation of lifecycle signals, cross-framework knowledge, memory, grounding, and hallucination measurement — collaborating with engineering pods to bring these models into production. A day in the life You will split your time between collaborative and heads-down work. On the collaborative side, you will partner with several pods of software development engineers in an Agile cadence — aligning on data collection needs, sharing experiment results, and integrating models into production services. On the heads-down side, you will dig into model training runs, analyze evaluation metrics, and iterate on threshold tuning until the numbers meet the bar. Your work is roadmap-driven, giving you the space to plan experiments methodically while still responding to new framework onboarding requests as they arise. About the team Our team builds the AI and ML systems behind AWS Governance, Risk, & Compliance service, where science is not auxiliary — it is the core. Every customer-visible compliance result flows through models our scientists create and maintain. We are investing in next-generation capabilities including observability and governance for AI agents, and the multi-quarter Agent Context initiative is an organization-defining program that will need technical leaders. Growth here is tangible. You will own the full model lifecycle from training through production monitoring, develop rare expertise at the intersection of ML and compliance, and have a clear path to expand your scope into technical leadership as the service scales. Basic qualifications - 2+ years of building models for business application experience - 2+ years of programming in Java, C++, Python or related language experience - 2+ years of hands-on predictive modeling and large data analysis experience Preferred qualifications - PhD in computer science, machine learning, engineering, or related fields - Experience in written and verbal communication with the ability to present complex technical information in a clear and concise manner to executives and non-technical leaders - Experience with one of the following areas: machine learning technologies, Reinforcement Learning, Deep Learning, Computer Vision, Natural Language Processing (NLP) or related applications - Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and

The description is cut here. Read the full offer: https://jobsbylevel.com/jobs/applied-scientist-agentic-ai-aws-governance-at-amazon-c5a953

Source: https://jobsbylevel.com/jobs/applied-scientist-agentic-ai-aws-governance-at-amazon-c5a953

## Cite this page

Level. https://jobsbylevel.com/jobs/applied-scientist-agentic-ai-aws-governance-at-amazon-c5a953.

Get job alerts: https://jobsbylevel.com/newsletter