Manager Data Science**Home based San Francisco, CA
RELX is hiring a Manager Data Science**Home based San Francisco, CA for a remote role open to applicants in United States. It pays $115k-$192k a year and Level rates it ; you can apply on RELX.
Level's read on this job
- Builds AI ●●●● is how Level rates this role: the job is building AI systems.
- This is listed as a remote role.
- The posting mentions Hugging Face, PyTorch and Python among its tools and skills.
- Level classes it as a senior role.
- RELX has 790 other open roles on Level.
AI in this role
Lead data science team in designing and executing LLM training, fine-tuning, and evaluation projects.
About the Business
LexisNexis Legal & Professional® provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital pioneer, the company was the first to bring legal and business information online with its Lexis® and Nexis® services.
About the Role
A Manager Data Science is an emerging subject matter expert in their domain. They lead a team of junior members to support their development and work product. They are mindful of best practices and train their team in the execution of those best practices. They manage a team to define new best practices and innovative approaches to new business problems or use cases.
Responsibilities
- Lead the design and execution of LLM training and fine-tuning projects, including model selection, training strategy, experimentation, and evaluation.
- Oversee the preparation of high-quality training datasets, including data collection, cleaning, deduplication, annotation, and quality validation.
- Develop and optimize supervised fine-tuning and parameter-efficient fine-tuning workflows; apply preference optimization methods where appropriate.
- Establish evaluation frameworks to assess factual accuracy, instruction following, domain relevance, safety, and performance on business-specific tasks.
- Diagnose training issues and improve model quality, training stability, GPU utilization, and computational efficiency.
- Manage and mentor data scientists, review technical work, and establish reproducible development practices.
- Partner with product, engineering, and domain experts to define requirements and support model deployment and monitoring.
- Manage project priorities, timelines, and compute resources, and communicate results and tradeoffs to stakeholders.
Requirements
- LLM fundamentals: Strong understanding of transformer architectures, attention mechanisms, tokenization, language modeling objectives, and the differences between pretraining, continued pretraining, and fine-tuning.
- Programming and frameworks: Strong Python and PyTorch skills, with practical experience using Hugging Face Transformers, Datasets, or equivalent tools.
- Hands-on LLM training: Demonstrated ability to implement supervised fine-tuning (SFT), configure training objectives and loss masking, tune hyperparameters, and select model checkpoints.
- Efficient fine-tuning: Practical experience with parameter-efficient fine-tuning (PEFT), including LoRA or QLoRA, and an understanding of their quality, memory, and compute tradeoffs.
- Training data engineering: Ability to build instruction-response datasets, apply chat templates, manage sequence lengths and packing, and prevent data leakage and evaluation contamination.
- GPU and distributed training: Experience training models across multiple GPUs using frameworks such as PyTorch FSDP or DeepSpeed, including mixed precision, gradient accumulation, and gradient checkpointing.
- Evaluation and debugging: Ability to design reliable benchmarks and human evaluations, analyze model errors, and troubleshoot unstable loss, overfitting, and GPU memory issues.
- Reproducibility: Experience with experiment tracking, dataset and model versioning, checkpoint management, and documented training pipelines.
Work in a Way That Works for You
We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.
Working Pattern
Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
About the Business
We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.
Please read our Candidate Privacy Policy.
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
How we rate this
Manager Data Science**Home based San Francisco, CA at RELX rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Walk me through fine-tuning a model: what data did you use, and how did you check the result?
- Tell me about a project where llm training was part of your work. What did you do?
- Tell me about a project where data annotation was part of your work. What did you do?
- Tell me about a project where peft was part of your work. What did you do?
- Tell me about a project where transformer architectures was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: Fine-tuning, LLM Training, Data Annotation, Peft, and Transformer Architectures. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new remote data jobs (Builds AI ●●●●) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Data roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step