Research Scientist - Human-AI Systems
Snorkel AI is hiring a Research Scientist - Human-AI Systems in New York and San Francisco, United States. It pays $200k-$375k a year and Level rates it ; you can apply on Snorkel AI.
Level's read on this job
- Level rates this research scientist role Builds AI ●●●●: the job is building AI systems.
- Pay on this posting starts 5% higher than the typical research scientist posting on Level.
- Some of the work can be done remotely, according to the posting.
- The posting mentions Python, AI agents and AI evaluation among its tools and skills.
- Snorkel AI has 40 other open roles on Level.
AI in this role
Research and optimize data and environment creation pipelines for frontier AI and agentic systems at Snorkel AI.
About Snorkel
Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises to move from better data to better outcomes.
Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!
We’re looking for a Research Scientist to advance how high-quality data and environments for AI agents are created. You’ll build and optimize pipelines that combine real-world data, automated generation, and human expert input. Working with domain experts, academic partners, customers, and our product and engineering teams, you’ll scale these pipelines to target frontier model performance gaps and expand data and environment diversity. Your work will amplify human knowledge and judgement, enabling experts to create and refine data and agentic environments that strengthens Snorkel’s position as the frontier data lab.
This role is ideal for someone who wants to advance frontier AI through data and environment creation and enjoys turning research into reusable, scalable systems.
Location: San Francisco, New York City, OR REMOTE
Main Responsibilities
- Design, implement, and optimize reusable pipelines that combine AI capabilities with expert judgment to accelerate data and agentic environment creation.
- Design and run rigorous experiments to validate proof-of-concept approaches, measure their impact on data quality, pipeline efficiency, and model performance, and communicate findings.
- Partner with engineering, data operation, domain experts, and customers to turn research prototypes into reliable production workflows.
- Work directly with domain experts to design and test workflows that help them author, review, and refine data and environments.
- Work cross-functionally with data operations, product, and engineering to surface research findings that inform the company roadmap.
- Stay at the frontier of research in data and agentic environment creation and bring best practices into Snorkel's workflows.
- Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data-centric AI.
Preferred Qualifications
- Strong research background in AI, machine learning, NLP, LLMs, or related fields, with experience developing and evaluating new methods.
- Experience building environments for AI agents in automated research, computer use, coding, or professional domain workflows.
- Experience with one or more of synthetic data generation, human in the loop workflows, reinforcement learning, agent environments, or model evaluation.
- Strong experimental design skills, including defining hypotheses and conducting ablations.
- Experience with software engineering best practices (e.g., clean coding, modular design, version control).
- Ability to collaborate with domain experts and translate their knowledge into concrete tasks, evaluation criteria, and repeatable workflows.
- Comfort with rapid iteration, ambiguous research questions, and moving ideas from experimentation into production.
- Ph.D. in machine learning, NLP, or a related field preferred; equivalent industry or research lab experience considered.
Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location.
Salary range(s) for this role$200,000—$375,000 USDBe Your Best at Snorkel
Joining Snorkel AI means becoming part of a company that has market proven solutions, robust funding, and is scaling rapidly—offering a unique combination of stability and the excitement of high growth. As a member of our team, you’ll have meaningful opportunities to shape priorities and initiatives, influence key strategic decisions, and directly impact our ongoing success. Whether you’re looking to deepen your technical expertise, explore leadership opportunities, or learn new skills across multiple functions, you’re fully supported in building your career in an environment designed for growth, learning, and shared success.
Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
How we rate this
Research Scientist - Human-AI Systems at Snorkel AI rates 95 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in research scientist jobs at this level
Pay
- This job starts at
- $200k
- Typical research scientist job
- $190k
This posting starts 5% above the typical research scientist job. See research scientist jobs
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- How do you decide that one model's output is better than another's for a given task?
- What NLP problem have you worked on, and how did you measure whether it actually worked?
- Tell me about a project where machine learning was part of your work. What did you do?
- Tell me about a project where llms was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: AI agents, AI Evaluation, NLP, Machine learning, and LLMs. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new remote research scientist jobs (Builds AI ●●●●) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Research roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step