Sr Manager Software Dev, Advertising Full Funnel Agentic Intelligence

Amazon is hiring a Sr Manager Software Dev, Advertising Full Funnel Agentic Intelligence in Seattle, United States. It pays $220k-$298k a year and Level rates it ; you can apply on Level.

AI in this role

bedrock

ai-agentsfine-tuning

Senior Software Development Manager, FAIM Evaluations.

Amazon Advertising is building toward a future where an advertiser specifies a few marketing parameters (budget, success definition, which products to promote) and a set of AI agents handles the rest. The Full Funnel Agentic Intelligence and Models (FAIM) organization owns that bet: the Ads Nova agent, the Ads Nova model it reasons with, and the agent infrastructure, learning environments, and evaluations that connect the two. We are looking for a Senior Software Development Manager to found and lead the FAIM Evaluations team. You will report directly to the Vice President of Full Funnel Agentic Intelligence and Models and own how the entire organization answers one question: is this actually good at advertising?

This is a ground-up build. Evaluation today lives inside individual model and agent teams, measured task by task. You will create the standalone engineering team that turns it into a shared, rigorous system spanning the Ads Nova model, the Ads Nova agent, and the internal agent that serves our Sales, Services, and Operations teams. No inherited harness, no pattern to follow, and a direct line to the VP who sponsors the work.

What we're building

An advertising benchmark: a representative set of real advertising tasks, organized by domain and difficulty, from single-step questions through multi-step analysis to long-horizon strategic work, each with structured criteria for what a correct end-to-end response looks like

Evaluation infrastructure that scores models and agents deterministically against that benchmark, compares Ads Nova to frontier models on the tasks that matter to advertisers, and gives every science and product team in FAIM the same yardstick

Rubrics and task environments built to serve double duty: scoring quality today and producing the reward signal that trains the next version of the model

An expert-in-the-loop program that captures how experienced advertising practitioners actually work and encodes that judgment into criteria a machine can grade against

A capability map, derived from benchmark results, that tells FAIM where the model and agent stand and what to train next

Key job responsibilities

Found and lead a standalone team of roughly 10-12: software engineers plus a product manager and a technical program manager; you will hire most of them

Own the technical vision and roadmap for FAIM evaluations end to end: task taxonomy, rubric design, environment construction, scoring, benchmark versioning, and the separation between what we evaluate on and what we train on

Build for the whole org, not one product: your team evaluates the Ads Nova model, the Ads Nova agent, and the internal agent, and you participate in the planning and reviews for all three

Partner with applied scientists across FAIM to turn evaluation criteria into training signal for reinforcement learning, and to make sure what we measure is what we optimize

Run the domain-expert program: source advertising practitioners, define the annotation and calibration process, and hold the quality bar on inter-rater agreement

Set the evaluation standard for the organization and hold the line on it; where good internal assets already exist, adopt them rather than rebuild

Publish results leadership and partner teams trust, and own the cadence for re-scoring as models, agents, and tasks evolve

Represent evaluations in VP-level reviews, annual planning, and cross-org discussions on model and agent quality

We're looking for a leader who brings

10+ years of engineering experience and 5+ years managing engineering teams, including building a team from a small core

A track record delivering evaluation systems, benchmarks, or data-quality programs for machine learning models, ideally large language models or agentic systems

Working fluency in how modern models are trained and improved (supervised fine-tuning, reinforcement learning from rubric or verifier signal) and what makes an eval useful as a training asset rather than only a scorecard

Judgment about measurement: when all-or-nothing grading beats partial credit, how to find ambiguous criteria through grader disagreement

Experience running expert-annotation or labeling programs with external partners, including quality control at scale

The ability to operate in ambiguity: turn "is it good at advertising" into a concrete, scored, versioned asset with minimal scoping help

Comfort working as the engineering counterpart to scientists you do not manage, and the influence to get model, agent, and product teams onto one yardstick

Advertising domain knowledge, or the curiosity and speed to build it by working closely with practitioners

Experience with Amazon Bedrock, agent frameworks, and tool-use protocols (MCP) is a plus

Basic qualifications

- 10+ years of engineering experience
- 5+ years of engineering team management experience
- 10+ years of planning, designing, developing and delivering consumer software experience
- Experience partnering with product or program management teams
- Experience managing multiple concurrent programs, projects and development teams in an Agile environment
- 10+ years of software development experience
- Bachelor's degree in computer science, computer engineering, or related technical field
- Experience designing, building, operating, and managing large-scale distributed systems or web services
- Experience with software development in a team, and a track record of shipping software on time

Preferred qualifications

- Experience partnering with product and program management teams
- Experience designing and developing large scale, high-traffic applications
- Experience hiring, developing, and managing high-performing technical teams
- Experience with AI/ML technologies
- Experience within advertising technology related sales
- Experience with AWS Services including EC2, Lambda, S3, DynamoDB, SQS

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, SEATTLE - 220,100.00 - 297,700.00 USD annually

How we rate this

Sr Manager Software Dev, Advertising Full Funnel Agentic Intelligence at Amazon rates 67 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Key facts

Sr Manager Software Dev, Advertising Full Funnel Agentic Intelligence is an open job at Amazon.
Level rates this role AI Level 3 of 4: Works on AI.
The listed salary is $220k-$298k a year.
The role is based in US, WA, Seattle.
The job was posted on October 7, 2026.
Seniority: senior.
Applications are handled by Amazon. Apply on Amazon

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

AI agentsFine-tuningBedrock

Questions you could be asked

How do you decide when an AI agent can act on its own versus asking for approval first?
Walk me through fine-tuning a model: what data did you use, and how did you check the result?
What are the limits of Bedrock that you've run into, and how did you work around them?
Describe a typical day in a role like this one: which parts run through AI directly?
If you removed AI from this role, what would be left, and how do you decide what still needs a human?

Adapt your resume

List these exact terms on your resume: AI agents, Fine-tuning, and Bedrock. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
Show where AI is part of your daily process, not a one-off project — this role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review

Get new other jobs (Works on AI ●●●○ or higher) by email

One email a week with the new other jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.