Skip to content

Mercor

Member of Technical Staff, Annotation UI

Mercor is hiring a Member of Technical Staff, Annotation UI in San Francisco, United States. It pays $250k-$400k a year and Level rates it ; you can apply on Mercor.

Level's read on this job

  • Works on AI ●●●○ is how Level rates this role: the daily work is on AI products, without building the model.
  • The posting mentions AI agents and AI data labeling among its tools and skills.
  • Level classes it as a lead role.
  • Mercor has 105 other open roles on Level.
  • Posted in the last few days.

AI in this role

ai-agentsai-data-labeling
About Mercor

Mercor’s mission is to organize human intelligence for the AI economy. We build the infrastructure that enables frontier AI labs and enterprises to train, evaluate, and improve AI on real-world professional work. More than five million experts have joined our network, and we pay out over $5 million daily for their knowledge and expertise.

We built our training and evaluation infrastructure alongside the world’s leading AI labs. Now, we’re bringing those capabilities to enterprises across industries, enabling them to train, evaluate, and improve AI using their own expertise and standards. Our APEX benchmarks measure how AI performs on economically valuable work, while our enterprise evaluations and post-training capabilities turn those insights into measurable improvements across real-world workflows.

Our work sits at the intersection of frontier AI, human expertise, and real-world application. We’re solving problems few companies have encountered, with the opportunity to influence what the world’s most advanced AI systems become capable of doing. We’re looking for people who bring different perspectives, take ownership, exercise sound judgment, and hold themselves to an exceptionally high standard. You’ll have the opportunity to do consequential work alongside talented colleagues who challenge one another, collaborate openly, and share a commitment to excellence.

Mercor is profitable and recently raised a $750 million Series D at a $20 billion valuation. We work in person five days a week in San Francisco, New York, and London.

About the Role

Mercor produces training data for frontier AI labs, and two kinds of workers produce it today: human experts (doctors, lawyers, engineers, analysts) who write tasks, write rubrics, and judge quality, and synthetic pipelines, swarms of AI agents that build environments, generate tasks, and iterate until they pass our quality bar.

Today these two sides barely work together. Experts face friction: they write specs, wait on pipelines, and redo work when an agent gets it wrong. Pipelines under-use the expert, whose judgment is our most valuable signal. And nobody owns the system between the two.

This is a role for a senior engineer who ships products people use, understands the infrastructure underneath them, and can reason across product, agent pipelines, research, and the business at the same time.

What You'll Do

  • Define the interaction model between experts and agents: how an expert sees, steers, and corrects agent work, and how agents ask experts for input and use what they get.

  • Build the surfaces experts use every day inside Studio, our data platform.

  • Build the infrastructure that lets agents act on expert input in real time.

  • Own the metrics: expert time per unit of accepted data, share of expert input the pipelines use, and expert satisfaction and retention.

  • Work across product, synthetic pipelines, research, and go-to-market to connect what customers want, what experts need, and what makes data valuable for training models.

  • Set the bar for engineering quality and technical direction across the collaboration system.

What We're Looking For

  • 7+ years of engineering experience building and shipping production products that people use.

  • Strong full-stack product engineering skills, with a high bar for usability and empathy for end users.

  • Infrastructure experience: you can build both the surface and the pipes, including real-time, high-throughput, or pipeline-based systems.

  • Ability to think across product, systems, and the business, and to understand where agent pipelines work and where they fail.

  • High ownership mindset; able to navigate ambiguity and drive projects from design through delivery.

  • Strong communication skills and ability to articulate technical and product tradeoffs clearly.

Nice-to-Haves

  • Experience building human-in-the-loop AI workflows, or tooling for data labeling, annotation, or evaluation.

  • Experience building agentic systems or LLM-powered products.

  • Familiarity with what makes data valuable for training and evaluating models.

  • Experience at top-tier tech companies or fast-scaling startups.

Why This Role Matters

  • Nobody has solved how human experts and AI agents should work together to create data. This is a brand new product problem.

  • The system you build can become the operating system for expert work, well beyond training data.

  • Your work directly influences the training and evaluation of frontier AI models.

  • You'll shape the experience of thousands of experts and operators who use Studio every day.

Benefits:

  • Generous equity grant vested over 4 years

  • Health, dental, and vision insurance

  • 401(k) with company match

  • Unlimited paid vacation and sick days

  • Parental leave for birthing and non-birthing parents

  • Free mental health services

  • $200 monthly wellness reimbursement

  • $1.5K monthly meal stipend

  • $200 monthly laundry reimbursement

  • Free Equinox membership

  • Up to $15K relocation bonus

Mercor is an Equal Opportunity Employer and is committed to providing equal opportunity to all employees and applicants. Mercor does not discriminate based on actual or perceived race, color, creed, religion, national origin, ancestry, citizenship status, age, sex or gender (including pregnancy, childbirth, related medical conditions and lactation), gender identity or gender expression, sexual orientation, marital status, military service and veteran status, disability, protected medical condition as defined by California or local law, genetic information, or any other characteristic protected by applicable federal, California, or local laws and ordinances. Further, Mercor prohibits discrimination, harassment, and retaliation based on any combination of protected characteristics. This Policy applies to all areas of employment, including recruitment, hiring, training, promotion, compensation, benefits, discipline, termination, and all other privileges, terms, and conditions of employment. This Policy and the law prohibit employment discrimination against any employee or applicant based on any legally protected status.

How we rate this

Member of Technical Staff, Annotation UI at Mercor rates 67 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI agentsAI Data Labeling

Questions you could be asked

  1. How do you decide when an AI agent can act on its own versus asking for approval first?
  2. How do you keep labeling instructions consistent across a large annotation team?
  3. Describe a typical day in a role like this one: which parts run through AI directly?
  4. If you removed AI from this role, what would be left, and how do you decide what still needs a human?

Adapt your resume

  • List these exact terms on your resume: AI agents and AI Data Labeling. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email usually within a few hours.

Get new design jobs (Works on AI ●●●○ or higher) by email

One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free.

Similar roles

Design roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Mercor

About Mercor as a platform

Level reads Mercor’s own pages for pay, entry steps and accepted countries, and sets them beside the other platforms. See the Mercor platform page or compare AI training platforms.

Related searches

Same AI level

Jobs by city