Program Manager, Quality
Mercor is hiring a Program Manager, Quality in San Francisco, United States. It pays $120k-$200k a year and Level rates it ; you can apply on Mercor.
Level's read on this job
- Works on AI ●●●○ is how Level rates this role: the daily work is on AI products, without building the model.
- The posting mentions LLMs, Databases and Scripting among its tools and skills.
- Level classes it as a mid-level role.
- Mercor has 88 other open roles on Level.
AI in this role
Own quality programs and develop automated technical solutions involving LLMs and scripting to evaluate AI data deliverables.
Mercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.
Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.
About the Role:As a Program Manager for Quality Team, you will devise cross-functional quality processes through developing automated, technical solutions and managing an operational team of quality control specialists who evaluate our human data deliverables before they are sent to our customers. The ideal candidate is a scrappy, data-first, and results-driven leader with a track record of excellence.
Responsibilities:
Own quality programs for designated accounts or projects in various human data domains.
Own outcomes end to end for quality programs on projects: from initial brainstorming and operational execution to final, detailed delivery of audit results and quality insights.
Develop technical solutions to auto-evaluate quality of our datasets and proactively root-cause issues. Actively identify opportunities for automation and technical simplification — leveraging LLMs, databases, and scripting where applicable.
Devise systems to evaluate auditor and human data talent performance, ensuring adherence to quality standards and identifying process improvement opportunities.
Report on quality through regular monitoring and maintenance of quality performance metrics and KPIs.
Develop, update, and regularly present leadership-facing reports to inform company operations and strategy on human data deliveries. Work cross-functionally across engineering, account operations, and other stakeholders to execute on delivering SLAs for high-priority projects.
Help hire and maintain a 30+ auditor workforce for quality control; coach and develop specialists in the auditor pool to achieve high-impact outcomes that drive quality in our customer engagements
Ideal requirements:
3+ years of experience owning high-impact technical and operational outcomes
A strong bias for being results-driven, and experience being entrepreneurial/scrappy: building systems from scratch, including technical and operational solutions, and working under pressure in high-urgency environments
Strong communication skills across leadership, strategic project leads, cross-functional stakeholders, and our auditor workforce
Ability to develop scalable solutions to difficult operational problems — which often require going close to the ground on projects in order to root-cause.
Robust project management experience, including the ability to manage a distributed team through ruthless prioritization and a high-urgency mindset.
A data-first approach to problem-solving, with demonstrated qualitative and quantitative analytical ability
Bonus:
STEM background
Experience with LLMs, databases, and scripting
Experience developing and growing a 30+ distributed workforce
Professional experience at a high-growth startup or fast-paced tech environment
Compensation
Base cash comp from $120K-$200k
Aggressive bi-annual performance bonus structure
Generous equity grant vested over 4 years
$15K relocation bonus (for moving to the Bay Area)
$10K housing bonus (if you live within 0.5 miles of our office)
$1.5K monthly stipend for meals
Free Equinox membership
$200 monthly laundry reimbursement
$200 monthly personal wellness reimbursement
Health, Dental, Vision insurance
How we rate this
Program Manager, Quality at Mercor rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where program management was part of your work. What did you do?
- Tell me about a project where quality assurance was part of your work. What did you do?
- Tell me about a project where automation was part of your work. What did you do?
- Tell me about a project where data analysis was part of your work. What did you do?
- Walk me through how you've used LLMs in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Program Management, Quality Assurance, Automation, Data Analysis, and LLMs. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new operations jobs (Works on AI ●●●○ or higher) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Operations roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next stepMore jobs at Mercor
About Mercor as a platform
Level reads Mercor’s own pages for pay, entry steps and accepted countries, and sets them beside the other platforms. See the Mercor platform page or compare AI training platforms.