Strategic Project Lead - AI Post-Training (London)
Appen is hiring a Strategic Project Lead - AI Post-Training (London) for a remote role open to applicants in United Kingdom. Level rates it ; you can apply on Appen.
Level's read on this job
- Works on AI ●●●○ is how Level rates this role: the daily work is on AI products, without building the model.
- This is listed as a remote role.
- The posting mentions fine tuning, AI evaluation and AI data labeling among its tools and skills.
- Appen has 26 other open roles on Level.
- Posted within the past two weeks.
AI in this role
Manage AI post-training data programs, model evaluation, and preference data workflows.
About the Role
The Strategic Project Lead – AI Post-Training will help lead AI companies develop and improve frontier models through high-quality data programs. We’re looking for someone with experience in AI post-training, preference data, or model evaluation to lead projects that shape how models respond, reason, and perform.
You’ll own delivery while bringing practical knowledge of the data, evaluation methods, and quality standards behind model improvement. Working closely with clients and internal teams, you’ll help translate evolving AI research needs into clear workflows, reliable datasets, and measurable outcomes.
Your Impact
- Own end-to-end project delivery, including scope, timelines, budgets, staffing, and risk management.
- Lead client communication, status reporting, planning sessions, and escalations.
- Translate model improvement objectives into data requirements, workflows, rubrics, and evaluation plans.
- Define quality standards and acceptance criteria for preference data, model comparisons, and evaluation outputs.
- Monitor delivery quality, investigate inconsistencies, and resolve ambiguous requirements with clients.
- Advise on data design, evaluation approaches, and project feasibility based on your domain expertise.
- Develop reusable guidelines, SOPs, and QA frameworks to improve consistency across programs.
- Mentor Operations Specialists and contribute to project scoping, pilots, and new capability development.
What You Bring
- 1–2+ years of experience in AI data operations, project coordination, or delivery, ideally in a GenAI or frontier AI environment.
- Familiarity with at least one AI post-training or model evaluation workflow.
- Experience coordinating projects or workstreams, managing stakeholders, and communicating with clients.
- Understanding of data quality, annotation workflows, and quality assurance methods.
- Ability to translate evolving requirements into clear workflows, rubrics, and measurable quality standards.
- Strong troubleshooting and organizational skills, with the ability to manage multiple priorities.
- Interest in current AI developments, including frontier models and post-training approaches.
Nice to Have
- Experience with reinforcement learning from human feedback (RLHF), preference data, or model response evaluation.
- Familiarity with rubric design, model comparison, benchmark development, or evaluation creation.
- Experience assessing model responses for quality, accuracy, reasoning, or instruction following.
- Exposure to AI companies, frontier AI labs, or model evaluation programs.
- Bilingual capabilities, particularly German or a Nordic language.
Why You'll Love Working Here
At Appen, we foster a culture of innovation, collaboration, and excellence. We value curiosity, accountability, and a commitment to delivering the highest quality AI solutions for frontier models.
You'll work on complex challenges that shape the future of AI across industries and geographies, alongside talented people in a culture that values humility over ego. You'll have the flexibility to deliver in a way that works for you and your team, supported by tools, resources, and development opportunities to continue to build your capability over time.
About Appen
- Appen has been a leader in AI training data for over 30 years. We specialise in human generated data to train, fine tune, and evaluate models across generative AI, large language models, computer vision, and speech recognition. Our AI assisted data annotation platform and global crowd of more than 1 million contributors in over 200 countries support model pre training, supervised fine tuning, evaluation and benchmarking, safety and red teaming, and multilingual global expansion.
How we rate this
Strategic Project Lead - AI Post-Training (London) at Appen rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Walk me through fine-tuning a model: what data did you use, and how did you check the result?
- How do you decide that one model's output is better than another's for a given task?
- How do you keep labeling instructions consistent across a large annotation team?
- Walk me through a computer vision problem you solved, from raw data to a deployed model.
- What have you built with speech recognition or text-to-speech, and where did it break?
Adapt your resume
- List these exact terms on your resume: Fine-tuning, AI Evaluation, AI Data Labeling, Computer vision, and Speech. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new remote AI jobs (Works on AI ●●●○ or higher) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Other roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step