# Staff AI Evaluation Lead at Fetch

Fetch is hiring a Staff AI Evaluation Lead for a remote role open to applicants in United States. It pays $129k-$152k a year and Level rates it Works on AI ●●●○; you can [apply on Fetch](https://jobsbylevel.com/go/4eb513b8-5e00-4f30-8721-5d772c6833a9?utm_medium=ai-agent).

AI Level 3, AI centrality 70 out of 100. Remote (United States - Remote).

## Details

- Company: [Fetch](https://jobsbylevel.com/companies/fetch)
- AI level: AI Level 3 (score 70 out of 100)
- Location: Remote (United States - Remote)
- Salary: $129k-$152k
- Posted: August 7, 2026
- Apply: https://jobsbylevel.com/go/4eb513b8-5e00-4f30-8721-5d772c6833a9?utm_medium=ai-agent
- Free CV review for this job: https://jobsbylevel.com/cv-review?job=staff-ai-evaluation-lead-at-fetch-cd3a67

## Prepare for this job

The job page lists 5 likely interview questions for this offer, with a CV checklist: https://jobsbylevel.com/jobs/staff-ai-evaluation-lead-at-fetch-cd3a67

## Description

What we’re building and why we’re building it.
Fetch helps people live rewarded every day, with a vision to become the rewards destination for everyone. We turn everyday activities into meaningful rewards, whether it’s grocery shopping, grabbing a quick meal, or playing a favorite mobile game. To date, we’ve awarded more than $1 billion in Fetch Points to our users.
Each day, more than 13 million receipts are submitted on Fetch, providing visibility into over $212 billion in gross merchandise value. This creates the largest retail-agnostic, SKU-level view of household spending, powering Fetch as an outcomes-based advertising platform that helps brands acquire and retain lifelong consumers.
The Fetch app is available on the App Store and Google Play, with more than 6 million five-star reviews from a highly engaged and loyal user base.
It’s not just our users who believe in Fetch: with investments from Softbank, ICONIQ, DST, Greycroft, and partnerships ranging from challenger brands to Fortune 500 companies, Fetch is reshaping how brands and consumers connect in the marketplace. When you work at Fetch, you play a vital role in a platform that drives brand loyalty and creates lifelong consumers with the power of Fetch points. User and partner success are at the heart of everything we do, and we extend that same commitment to our employees.
At Fetch, we value curiosity, adaptability, and the confidence to explore new tools, especially AI, to drive smarter, faster work. You don’t need to be an expert, but you should be ready to learn quickly and think critically. We welcome learners who move fast, challenge the status quo, and shape what’s next, with us. Ranked as one of America’s Best Startup Employers by Forbes for two years in a row, Fetch fosters a people-first culture rooted in trust, accountability, and innovation. We encourage our employees to challenge ideas, think bigger, and always bring the fun to Fetch.
About the Role:
At Fetch, we’re building AI and automation systems that make our work smarter, faster, and more scalable. The AI Operations team ensures our models, automations, and LLM systems perform with quality, reliability, and measurable impact.
As a Staff AI Evaluation Lead, you’ll own automation and evaluation programs across AI Operations. You’ll translate business and functional goals into scalable systems, define how we measure quality, and ensure automation and evaluation become durable, high-impact capabilities across the organization.
This role is ideal for someone who combines deep technical problem-solving with systems-level thinking and strong cross-functional leadership.
This is a full-time role that can be held from one of our US offices or remotely in the United States.
Role Responsibilities:
Own programs:
Lead complex, high-impact automation and evaluation initiatives across workflows or teams
Design scalable solutions:
Architect end-to-end workflows integrating datasets, evaluations, automations, and HITL processes; build the harness and reusable components other analysts build against; build evaluation pipelines that run against production without hands-on operation
Establish standards:
Define dataset standards, evaluation methodology, failure taxonomy, and quality measurement across AI Operations; verify that projects you don't run are meeting them; own the process by which those standards get made and used
Own metric definitions:
Create and maintain the metric definitions the org evaluates against, validate them against real production behavior, and revise them as models, tooling, and system architectures change
Set the bar for production:
Define the quality bar a system clears before it reaches production and where human review stays in the loop, and pull a system back when it stops meeting the bar
Allocate evaluation depth by risk:
Decide which systems get what depth of evaluation given finite capacity, name the risk accepted on the rest, and make that tradeoff visible to project stakeholders

The description is cut here. Read the full offer: https://jobsbylevel.com/jobs/staff-ai-evaluation-lead-at-fetch-cd3a67

Source: https://jobsbylevel.com/jobs/staff-ai-evaluation-lead-at-fetch-cd3a67

## Cite this page

Level. https://jobsbylevel.com/jobs/staff-ai-evaluation-lead-at-fetch-cd3a67.

Get job alerts: https://jobsbylevel.com/newsletter