Data Scientist, Core Experimentation
OpenAI is hiring a Data Scientist, Core Experimentation in Seattle, United States. It pays $347k-$385k a year and Level rates it ; you can apply on OpenAI.
Level's read on this job
- Builds AI ●●●● is how Level rates this data scientist role: the job is building AI systems.
- Pay on this posting starts 109% higher than the typical data scientist posting on Level.
- Some of the work can be done remotely, according to the posting.
- The posting mentions Python, AI research and statistics among its tools and skills.
- OpenAI has 793 other open roles on Level.
AI in this role
Staff Data Scientist leading core experimentation platform development and methodology for frontier AI products.
About the Team
The Statsig team at OpenAI builds and operates the experimentation platform that powers product development, measurement, and decision-making across the company. We partner closely with product, engineering, and infrastructure teams to ensure experiments are trustworthy, statistically rigorous, and scalable to the needs of frontier AI products.
Our mission is to help teams make better decisions through reliable experimentation. We care deeply about statistical correctness, pragmatic solutions, and building systems that researchers and engineers can trust at massive scale. The team operates at the intersection of experimentation methodology, data infrastructure, causal inference, and product analytics.
We are looking for experienced experimentation experts who want to shape the future of experimentation in the AI era.
About the Role
We are hiring a Staff-level Data Scientist to help lead the evolution of OpenAI’s core experimentation platform. This role is focused on improving the statistical rigor, reliability, and practical usability of experimentation across the company.
You’ll work on some of the hardest problems in online experimentation: sample ratio mismatch detection, variance reduction, bias mitigation, metric design, triggered analysis, heterogeneous treatment effects, sequential testing, and experimentation in complex ML systems. You’ll also help translate advanced statistical concepts into pragmatic systems and product experiences that teams can actually use.
This is a highly technical individual contributor role with significant influence across methodology, platform architecture, and experimentation best practices. The ideal candidate combines deep statistical expertise with strong systems intuition and hands-on experience building or operating experimentation platforms at scale.
In this role, you will:
Drive the statistical direction and technical strategy for OpenAI’s experimentation platform
Design and improve experimentation methodologies used across product and research teams
Build pragmatic solutions to real-world experimentation challenges, balancing rigor with operational simplicity
Improve the reliability and trustworthiness of experiment results, including detection and prevention of bias, logging issues, and data quality failures
Developscalable analytical systems and pipelines in Python and distributed compute environments
Partner with engineers and product teams to improve experiment design, metric quality, and decision-making practices
Lead investigations into complex experimentation anomalies and measurement failures
Establish best practices for experimentation governance, interpretation, and statistical correctness
Mentor other data scientists and raising the overall technical bar for experimentation and causal inference
You might thrive in this role if you have:
Experience building, scaling, or operating experimentation platforms at a large technology company
Deep expertise in statistics, causal inference, and online experimentation methodology
Strong understanding of practical experimentation challenges in production systems
Experience with areas such as variance reduction, CUPED, sequential testing, SRM detection, metric design, or heterogeneous effects
Strong coding and systems skills in Python and large-scale data processing frameworks (e.g. Spark)
Experience designing analytical data models and scalable experimentation pipelines
Ability to communicate complex statistical concepts clearly to technical and non-technical audiences
Track record of influencing technical strategy through hands-on technical leadership
Experience in large-scale product experimentation, ML experimentation, ranking systems, marketplace systems, or similar high-scale experimentation domains is highly valued
Workplace & Location
This role is based in Bellevue. We use a hybrid work model and value in-person collaboration for technical design, iteration, and cross-functional partnership.
Compensation Range: $293K - $325K USD
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.
Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
OpenAI Global Applicant Privacy Policy
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
How we rate this
Data Scientist, Core Experimentation at OpenAI rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in data scientist jobs at this level
Pay
- This job starts at
- $347k
- Typical data scientist job
- $166k
This posting starts 109% above the typical data scientist job. See data scientist jobs
Questions you could be asked
- Tell me about a research question you investigated. What did you find?
- Tell me about a project where statistics was part of your work. What did you do?
- Tell me about a project where experimentation was part of your work. What did you do?
- Tell me about a project where data science was part of your work. What did you do?
- Tell me about a project where causal inference was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: AI Research, Statistics, Experimentation, Data Science, and Causal Inference. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new remote data scientist jobs (Builds AI ●●●●) by email
One email a week with the new remote data scientist jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Data roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step