AmazonPosted 1mo ago
Science Annotation Ops Analyst at Amazon scores 64 out of 100 on AI centrality, which makes it AI Level 3 of 4 (Works on AI) on this board. The level measures how much of the work is AI, not seniority.
AI in this role
As a Science Annotation Operations Analyst, you'll own end-to-end data pipelines that extract, validate, and consolidate annotation metrics from AWS and SageMaker. You'll build production dashboards, create custom annotation interfaces, and automate critical workflows—all while collaborating with Program Managers, Science Specialists, and cross-functional teams. This role offers you the opportunity to leverage Python, AWS services, and web development skills to solve real problems that impact both customers and the planet.
Key job responsibilities
- Design and maintain scalable data pipelines that extract, parse, validate, and consolidate annotation metrics from AWS and SageMaker, ensuring data quality and auditability throughout the lifecycle
- Build and operate production dashboards on EC2 covering the full data lifecycle (ingest, validate, score, publish) using technologies like Plotly Dash or Streamlit
- Implement secure, least-privilege cross-account AWS integrations using IAM, STS, Lambda, and API Gateway to enable seamless data ingestion from multiple source accounts
- Develop custom SageMaker Ground Truth labeling templates using HTML and JavaScript with conditional logic that transform written SOPs into validated annotation interfaces
- Automate recurring manual processes including monthly consolidation, historical backfills, and scheduled jobs while maintaining alerting, backups, and deployment workflows to improve operational efficiency
A day in the life
You'll collaborate with Program Managers, Leads, and Science Annotations Specialists to tackle technical challenges that span the data lifecycle. You could start with debugging a Python script that processes annotation metrics with pandas and boto3, followed by deploying a new dashboard feature to EC2. Later, you could be writing SQL queries to validate data quality, configuring IAM policies for secure cross-account access, or building a new annotation UI template in HTML and JavaScript. You'll use Git for version control and Linux command-line tools to manage deployment workflows, all while serving as the technical POC for your team.
About the team
The Worldwide Returns, ReCommerce & Sustainability team is dedicated to making zero happen—zero cost of returns, zero waste, and zero defects. We're an agile and inclusive organization that innovates to create long-term value by investing in our people and our planet. Our team spans business, product, operations, data, and software engineering disciplines working together to manage the lifecycle of returned and damaged products.
You'll partner across teams to help customers discover great deals on quality used and open box items, improve the returns experience, and reduce waste in reverse logistics. As part of this mission-driven team, you'll be a builder and an owner, collaborating cross-functionally to design scalable solutions. At Amazon, Earth is our customer too—join us and help innovate for a more sustainable future.
Basic qualifications
- Bachelor's degree within last 12 months in computer science, machine learning, engineering, or related fields, or experience with data scripting languages (e.g., SQL, Python, R, or equivalent) or statistical/mathematical software (e.g., R, SAS, Matlab, or equivalent)
- Experience with AWS Services including EC2, Lambda, S3, DynamoDB, SQS
- Experience building web based dashboards using common frameworks
Preferred qualifications
- SageMaker Ground Truth experience
- ML / annotation-operations domain familiarity
- Experience standardizing metrics and processes across teams
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- What's a project where you used Sagemaker hands-on?
- Describe a typical day in a role like this one: which parts run through AI directly?
- If you removed AI from this role, what would be left, and how do you decide what still needs a human?
Adapt your resume
- List these exact terms on your resume: Sagemaker. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project — this role expects it to be a running habit.
Want your resume actually rewritten for this job?
The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.
Similar roles
Other roles rated AI Level 3 at other companies.
WriterRemote · San Francisco, CA$184k-$260k2h ago
Mistral AISingapore8h ago
SalesforceMexico - Mexico City21h ago
ToastRemote · Remote22h ago
Shield AIWashington, D.C.$30-$45/hr23h ago
ElevenLabsRemote · New York1d
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step





