Level

Snorkel AI

Research Scientist - Human-AI Systems

AI in this role

ai-agentsai-evaluationnlp

About Snorkel

At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data.

We’re on a mission to help enterprises transform expert knowledge into specialized AI at scale. The AI landscape has gone through incredible changes since 2015, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!

We’re looking for a Research Scientist to advance how high-quality data and environments for AI agents are created. You’ll build and optimize pipelines that combine real-world data, automated generation, and human expert input. Working with domain experts, academic partners, customers, and our product and engineering teams, you’ll scale these pipelines to target frontier model performance gaps and expand data and environment diversity. Your work will amplify human knowledge and judgement, enabling experts to create and refine data and agentic environments that strengthens Snorkel’s position as the frontier data lab.

This role is ideal for someone who wants to advance frontier AI through data and environment creation and enjoys turning research into reusable, scalable systems.

Location: San Francisco, New York, OR REMOTE

Main Responsibilities

  • Design, implement, and optimize reusable pipelines that combine AI capabilities with expert judgment to accelerate data and agentic environment creation.
  • Design and run rigorous experiments to validate proof-of-concept approaches, measure their impact on data quality, pipeline efficiency, and model performance, and communicate findings.
  • Partner with engineering, data operation, domain experts, and customers to turn research prototypes into reliable production workflows.
  • Work directly with domain experts to design and test workflows that help them author, review, and refine data and environments.
  • Work cross-functionally with data operations, product, and engineering to surface research findings that inform the company roadmap. 
  • Stay at the frontier of research in data and agentic environment creation and bring best practices into Snorkel's workflows.
  • Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data-centric AI.
  •  

Preferred Qualifications

  • Strong research background in AI, machine learning, NLP, LLMs, or related fields, with experience developing and evaluating new methods.
  • Experience building environments for AI agents in automated research, computer use, coding, or professional domain workflows.
  • Experience with one or more of synthetic data generation, human in the loop workflows, reinforcement learning, agent environments, or model evaluation.
  • Strong experimental design skills, including defining hypotheses and conducting ablations.
  • Experience with software engineering best practices (e.g., clean coding, modular design, version control).
  • Ability to collaborate with domain experts and translate their knowledge into concrete tasks, evaluation criteria, and repeatable workflows.
  • Comfort with rapid iteration, ambiguous research questions, and moving ideas from experimentation into production.
  • Ph.D. in machine learning, NLP, or a related field preferred; equivalent industry or research lab experience considered.

 

Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location.

Salary range(s) for this role$200,000—$375,000 USD

Be Your Best at Snorkel

Joining Snorkel AI means becoming part of a company that has market proven solutions, robust funding, and is scaling rapidly—offering a unique combination of stability and the excitement of high growth. As a member of our team, you’ll have meaningful opportunities to shape priorities and initiatives, influence key strategic decisions, and directly impact our ongoing success. Whether you’re looking to deepen your technical expertise, explore leadership opportunities, or learn new skills across multiple functions, you’re fully supported in building your career in an environment designed for growth, learning, and shared success.

Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

How we score this

Research Scientist - Human-AI Systems at Snorkel AI scores 92 out of 100 on AI centrality, which makes it AI Level 4 of 4 (Builds AI) on this board. The level measures how much of the work is AI, not seniority.

Classification

AI Level 4. Building AI systems is the job itself: without AI, the role would not exist.

  1. AI Level 480 to 100
  2. AI Level 360 to 79
  3. AI Level 240 to 59
  4. AI Level 10 to 39

Bands come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

AI AgentsAI EvaluationNlp

Questions you could be asked

  1. How do you decide when an AI agent can act on its own versus asking for approval first?
  2. How do you decide that one model's output is better than another's for a given task?
  3. What NLP problem have you worked on, and how did you measure whether it actually worked?
  4. How would you decide a model or AI system is ready to ship?
  5. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: AI Agents, AI Evaluation, and Nlp. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.

Want your resume actually rewritten for this job?

The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.

Get new research scientist jobs at AI Level 4+ by email

One email a week with the new research scientist jobs at AI Level 4+, each rated AI Level 1 to 4 for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Research roles rated AI Level 4 at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Snorkel AI

More research scientist jobs

Related searches

Same AI level