Level

Mercor

Research Scientist - Environments, Data and Post-Training

Mercor is hiring a Research Scientist - Environments, Data and Post-Training in San Francisco, United States. It pays $250k-$500k a year and Level rates it ; you can apply on Level.

AI in this role

ai-evaluationai-research
About Mercor

Mercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.

 

Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.

About the Role

As a Research Scientist at Mercor, you will work at the intersection of research and engineering on frontier post-training. You will develop new training and evaluation methods, test them through rigorous experiments, and implement successful approaches at scale.

Working with researchers, engineers, domain experts, and customers, you will investigate how data, rewards, environments, and optimization methods shape model behavior. Your work will influence frontier models, Mercor’s products, and the broader research community through releasing blogposts, technical reports, and papers.

What You’ll Do

  • Implement novel post-training methods that improve model reasoning, tool use, and agentic behavior.

  • Develop new training recipes for frontier open models.

  • Design and run experiments across datasets, reward functions, environments, and optimization strategies, including methods such as GRPO and DAPO.

  • Build reinforcement learning with verifiable rewards (RLVR) and other post-training pipelines at scale.

  • Investigate model capabilities and failure modes, then develop targeted training interventions.

  • Create methods for measuring data quality, usability, and causal impact on model performance.

  • Build scalable pipelines for data generation, filtering, augmentation, and selection.

  • Develop rubrics, evaluators, benchmarks, and scoring systems that inform training decisions.

  • Translate open-ended research questions into rigorous experiments and production systems.

  • Collaborate with researchers, applied AI teams, engineers, and domain experts producing training data.

  • Contribute to open-source post-training tools and research.

What We’re Looking For

  • Demonstrated experience training and evaluating machine learning models.

  • A strong research record in post-training, reinforcement learning, language-model evaluation, data-centric ML, or a closely related field.

  • Ability to reason rigorously about model behavior, experimental results, and data quality.

  • Strong programming skills and experience implementing machine learning systems.

  • Knowledge of the current AI research landscape and important open problems.

  • Excitement to work in person in San Francisco, five days a week (with optional remote Saturdays), and thrive in a high-intensity, high-ownership environment.

Nice To Have

  • Experience on an industry post-training or frontier-model team.

  • Main authorship of publications at top-tier conferences (NeurIPS, ICML, ACL).

  • Experience with synthetic-data generation

  • Experience building large-scale evaluation or data-generation infrastructure.

  • Solid foundations in distributed or backend systems, and experimental design.

  • Familiarity with APIs, databases, and cloud infrastructure.

Benefits

  • Bi-annual performance bonus structure

  • Generous equity grant vested over 4 years

  • Up to $15k Relocation bonus

  • $10K housing bonus (if you live within 0.5 miles of our office)

  • $1.5K monthly stipend for meals

  • Free Equinox membership

  • $200 monthly laundry reimbursement

  • $200 monthly personal wellness reimbursement

  • Health, Dental, Vision insurance

How we rate this

Research Scientist - Environments, Data and Post-Training at Mercor rates 99 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

AI EvaluationAI Research

Questions you could be asked

  1. How do you decide that one model's output is better than another's for a given task?
  2. Tell me about a research question you investigated. What did you find?
  3. How would you decide a model or AI system is ready to ship?
  4. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: AI Evaluation and AI Research. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review

Get new research scientist jobs (Builds AI ●●●●) by email

One email a week with the new research scientist jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Research roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Mercor

More research scientist jobs

Related searches

Same AI level

Jobs by city