Skip to content

Amazon

Senior Applied Scientist, Secure Third Party Tools (S3T)

Amazon is hiring a Senior Applied Scientist, Secure Third Party Tools (S3T) in Austin, United States. It pays $167k-$226k a year and Level rates it ; you can apply on Amazon.

Level's read on this job

  • Level rates this applied scientist role Builds AI ●●●●: the job is building AI systems.
  • Pay on this posting starts in line with the typical applied scientist posting on Level.
  • The posting mentions RAG and AI safety among its tools and skills.
  • Amazon has 20,000+ other open roles on Level.
  • Posted in the last few days.

AI in this role

ragai-safety
Secure Third Party Tools team looking for a Senior Applied Scientist with generative AI experience. We seek a hands-on leader and team player who excels in the end-to-end development cycles from research and launch. This leader will conduct applied research and take the resulting models into production. We work in an ambiguous and dynamic space where this leader will need to independently define problems more often than solving pre-scoped problems. Strong candidates will demonstrate the ability to scale themselves by teaching others and simplify complexities.

With the team, you will influence the science roadmap, define model quality measurements, and partner extensively to deliver solutions. Decisions draw on varied, unstructured data in a rapidly changing security landscape. Models need to codify human expertise, detect new issues, and prove approaches, to develop solutions that raise security postures practically, not theoretically.

Key job responsibilities
- Set and follow the science direction. Define the research agenda, success metrics, and multi quarter roadmap for applied science in third party security, and present tradeoffs and recommendations to senior leaders.

- Automate security decision making. Build machine learning and large language model (LLM) systems that analyze security information and help teams make faster, more consistent third party security decisions.

- Build agentic AI workflows. Design agent based and retrieval augmented generation (RAG) systems that automate multi step security work and bring in human experts where judgment is needed.

- Improve third party risk insight. Develop models that connect information across systems, identify changes in risk over time, and help teams focus on the issues that matter most.

- Earn trust in model decisions. Define evaluation methods, benchmarks, and quality controls, and decide when an automated decision is reliable and when it needs expert review.

- Raise the team's capability. Mentor scientists and engineers, set best practices for responsible AI in security, and share results through publications and internal forums.

About the team
Secure Third Party Tools, part of Amazon Security, builds tools to help evaluate, remediate, and monitor vendor’s security with confidence. Scientists work on a cross-functional team building and redesigning platforms to improve deterministic automated security at the pace and scale of Amazon. Pairing expert judgment, rapid experimentation, and creative solutions will drive third party security innovation that raises security standards and outcomes that protect our customers.

Basic qualifications

- PhD, or Master's degree and 6+ years of applied research experience
- Experience programming in Java, C++, Python or related language
- Experience in building machine learning models for business application

Preferred qualifications

- Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware, or experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
- Experience in security- or risk-related fields
- Experience prioritizing and delivering projects on time in a fast-moving environment
- Experience designing evaluation methods and quality controls for LLM or agentic systems, including benchmarks, calibration, regression testing, and human in the loop review
- Experience leading multi quarter science initiatives, setting responsible AI practices, and influencing senior business and technical stakeholders

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.



USA, TX, Austin - 167,100.00 - 226,100.00 USD annually

How we rate this

Senior Applied Scientist, Secure Third Party Tools (S3T) at Amazon rates 88 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

RAGAI Safety

Also common in applied scientist jobs at this level

Pay

This job starts at
$167k
Typical applied scientist job
$167k

This posting starts close to the typical applied scientist job. See applied scientist jobs

Questions you could be asked

  1. How would you design a retrieval step so the model answers from real data instead of guessing?
  2. How do you think about the risk of an AI system in this kind of role failing silently?
  3. How would you decide a model or AI system is ready to ship?
  4. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: RAG and AI Safety. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email usually within a few hours.

Get new applied scientist jobs (Builds AI ●●●●) by email

One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free.

Similar roles

Research roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Amazon

More applied scientist jobs

Related searches

Same AI level

Jobs by city