PerplexityBerlin
Thinking Machines LabPosted 1w ago
Research, Finetuning Science
Research, Finetuning Science at Thinking Machines Lab scores 100 out of 100 on AI centrality, which makes it a Level 4 role on this board.
AI in this role
Advance frontier fine-tuning science and post-training techniques for customizable AI models.
The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.
About the Role
At Thinking Machines we build tools that enable people to make AI their own, customizing models to serve their unique needs. This includes the ability to train model weights.
In this role, you'll work on frontier customization techniques and help build the best post-training engine in the industry – Tinker – drawing on a whole-stack understanding of RL science. Findings directly shape Tinker's training defaults, API design, and the open-source Tinker Cookbook. You'll work with our internal research teams as well as contributing to open science for external partners.
What You’ll Do
In this role, you'll advance the science of fine-tuning and frontier post-training techniques. You’ll:
Contribute to areas like LoRA and parameter efficient fine-tuning and how to push customization quality, efficiency, and reliability to the frontier.
Ship research into product: inform Tinker's training defaults and primitives, and codify best-practice methods as recipes in the Tinker Cookbook.
Improve the stability, efficiency, and reliability of large-scale fine-tuning and RL runs on Tinker.
Share what you learn through papers, technical blog posts, and community contributions.
You’ll contribute to areas like LoRA, parameter-efficient fine-tuning, how things interact with RL and post-training, and how to push customization quality, efficiency, and reliability to the frontier.
Skills and Qualifications
Required qualifications:
Bachelor’s degree or equivalent experience in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline with strong theoretical and empirical grounding.
Proficiency in Python and familiarity with deep learning frameworks (e.g., PyTorch, TensorFlow, or JAX). Comfort debugging distributed training and writing code that scales.
Clarity in communication, an ability to explain complex technical concepts in writing.
Strong interest in our mission to enable custom models.
Preferred qualifications — we encourage you to apply if you meet some but not all of these:
A strong grasp of probability, statistics, and ML fundamentals. You can look at experimental data and distinguish between real effects, noise, and bugs.
Prior experience with RLHF, RLAIF, preference modeling, or reward learning for large models.
Experience managing or analyzing human data collection campaigns or large-scale annotation workflows.
Research or engineering contributions in alignment, data-centric AI, or human-AI collaboration.
Experience with RL training stability techniques for large runs.
PhD in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline with strong theoretical and empirical grounding; or, equivalent industry research experience.
Logistics
Location: This role is based in San Francisco, California.
Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $350,000 - $475,000 USD.
Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.
Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.
As set forth in Thinking Machines' Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- Walk me through fine-tuning a model: what data did you use, and how did you check the result?
- Tell me about a project where machine learning was part of your work. What did you do?
- Tell me about a project where reinforcement learning was part of your work. What did you do?
- Tell me about a project where research was part of your work. What did you do?
- Walk me through how you've used PyTorch in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Fine Tuning, Machine Learning, Reinforcement Learning, Research, and PyTorch. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.
Want your resume actually rewritten for this job?
The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.
Similar roles
Research roles rated Level 4 at other companies.
AmazonRO, Bucharest
NVIDIAUS, CA, Santa Clara$38-$94/hr
AmazonUS, WA, Seattle$136k-$184k
NVIDIAUS, CA, Santa Clara$38-$94/hr
AmazonUS, NY, New York$184k-$249k
More jobs at Thinking Machines Lab
Thinking Machines LabSan Francisco$300k-$350k
Thinking Machines LabSan Francisco$300k-$360k
