Senior Machine Learning Engineer III Raleigh, NC

AI in this role

chatgptopenaiclaudegeminilangchainlanggraphautogen

rag

Are you looking to develop your Machine Learning Engineer career?

Do you enjoy coaching others to achieve high standards?

This is a full-time position based in Raleigh, NC.

(Hybrid - 3 days in office)

About the Role

We are seeking a Consultant-level Machine Learning Engineer to lead the implementation and scaling of AI systems for legal products. This role focuses on how to build and scale—owning system architecture, infrastructure, and productionization of ML/LLM solutions.

You will partner with Data Scientists to turn validated models and prototypes into reliable, high-performance, customer-facing systems.

Key Responsibilities

Architect and implement scalable ML/LLM systems in production.
Build and deploy LLM applications, including RAG pipelines and agentic systems.
Implement hybrid search systems (semantic + lexical) using embeddings and search platforms.
Develop and maintain APIs, microservices, and model serving infrastructure.
Build data pipelines and streaming systems for large-scale data processing.
Define and develop reusable frameworks, libraries, and infrastructure for AI/ML across teams.
Optimize systems for latency, scalability, reliability, and cost efficiency.
Establish best practices for deployment, monitoring, observability, and CI/CD.
Collaborate with Data Scientists to productionize models and integrate into products.
Provide technical leadership in system design and engineering standards.

Required Qualifications

Bachelor’s degree in Computer Science, Engineering, or a related field.
Strong experience implementing and scaling production ML/LLM systems.
Deep experience with LLM application development, including RAG and prompt orchestration.
Strong experience designing and implementing agentic systems using agent frameworks (e.g., LangChain, LangGraph, AutoGen, Google ADK), including orchestration of multi-step workflows in production environments.
Strong experience with hybrid search (semantic + lexical), embeddings, and search platforms (e.g., Solr, OpenSearch).
Expertise in distributed systems and cloud-native development, including AWS (S3, DynamoDB).
Experience with streaming and messaging systems (e.g., Kafka, SQS) and caching (e.g., Redis).
Proficiency in Python and experience with systems languages (e.g., Rust, Go, Scala).
Experience building scalable APIs (REST/GraphQL).
Experience with containerization and orchestration (Docker, Kubernetes).
Strong software engineering fundamentals (system design, testing, CI/CD).

Preferred Qualifications

Experience with LLM platforms (e.g., ChatGPT/OpenAI, Claude, Gemini, LangChain, Google ADK).
Experience with DevOps and infrastructure as code (e.g., Terraform, CloudFormation, Jenkins).
Experience with big data technologies (e.g., Spark, Hadoop).
Familiarity with graph databases (e.g., Dgraph, Neo4j, Neptune).
Experience building high-availability, low-latency systems.
Experience in legal or regulatory domains.

Key Competencies

Strong system architecture and scalability mindset.
Ownership of implementation, performance, and reliability.
Ability to translate data science solutions into production systems.
Cross-functional collaboration with DS, product, and platform teams.
Excellent debugging, optimization, and operational skills.
Clear communication of technical designs and trade-offs.

#AIFluent



U.S. National Base Pay Range: $118,300 - $219,800. Geographic differentials may apply in some locations to better reflect local market rates.



This job is eligible for an annual incentive bonus.







We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights.

How we rate this

Senior Machine Learning Engineer III ***Raleigh, NC*** at RELX rates 98 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

RAGChatGPTOpenAIClaudeGeminiLangChainLangGraphAutoGen

Questions you could be asked

How would you design a retrieval step so the model answers from real data instead of guessing?
Walk me through how you've used ChatGPT in your day-to-day work.
What are the limits of OpenAI that you've run into, and how did you work around them?
What's a project where you used Claude hands-on?
Walk me through how you've used Gemini in your day-to-day work.

Adapt your resume

List these exact terms on your resume: RAG, ChatGPT, OpenAI, Claude, and Gemini. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review

Get new machine learning engineer jobs (Builds AI ●●●●) by email

One email a week with the new machine learning engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Also alert me for new jobs at RELX

Free. One email a week. Unsubscribe in one click.