LegoraTechnical Legal Engineer - Evals
Legora is hiring a Technical Legal Engineer - Evals in Stockholm, Sweden. Level rates it ; you can apply on Legora.
Level's read on this job
- Level rates this role Works on AI ●●●○: the daily work is on AI products, without building the model.
- Tools and skills the posting cites include LLMs, legal evaluation and quality assurance.
- Level classifies it as a mid-level role.
- Level lists 304 other open roles at Legora.
AI in this role
Evaluate, stress-test, and improve AI systems and generated outputs used in legal workflows as a technical legal engineer.
About Us
Legora is redefining how legal work gets done. Not built for lawyers, built with them. We work alongside the world’s best legal teams, who expect excellence, precision, and speed, and we hold ourselves to the same bar.
Our AI-native workspace lets legal professionals move faster, think more clearly, and operate with sharper precision. By analysing thousands of documents in minutes and powering end-to-end workflows, we cut through complexity, teams can focus on what matters: judgment, strategy, and outcomes.
2,100+ customers across 80+ countries trust us, including Cleary Gottlieb, Goodwin, Linklaters, White & Case, Dentons, and Barclays. We’ve scaled to $200M+ in ARR, with teams across Europe, North America and APAC, and continue to expand through acquisitions including Qura, Walter AI, Graceview, Cadastral, and Wexler.
We partner with world-class performers: including Aaron Judge and the New York Yankees, Ludvig Åberg (and his caddie), and campaigns featuring Jude Law.
Joining Legora means three things.
We lean in: ownership over titles, outcomes over intentions.
We fight for excellence: high standards, direct, ego-free feedback.
We grow together: as a team and with our customers.
Mission before ego. Everyone contributes. No one coasts.
If you’re driven by impact, pace, and raising the bar. This is the place.
The Role
We are seeking a tech-savvy lawyer with knowledge of, or a strong interest in tech products, AI and LLM evaluations.
Apply your legal training and practice experience to evaluate, stress-test, and improve AI systems used in legal work. You will not be expected to code, but will apply legal judgment at scale. You would be reviewing and helping to improve AI-generated outputs as an experienced lawyer would review junior work, precedents, or research memos.
This role is ideal for a lawyer who enjoys issue-spotting, quality control, and analytical rigor, and is eager to shape how legal work is performed using modern technology.
You will collaborate closely with senior legal engineers, product managers, and engineers to ensure AI outputs meet professional standards for legal accuracy, reasoning, and usability.
What You Will Be Doing
Legal Review & Evaluations
Review AI-generated legal outputs for accuracy, completeness, legal reasoning, and jurisdictional correctness across research, drafting, and analysis use cases.
Assess outputs for real-world usability and identify failure modes, edge cases, and legal ambiguities that affect product reliability.
Dataset & Benchmark Development
Design and build high-quality evaluation datasets, including benchmark cases and gold-standard legal answers.
Define clear scoring rubrics and evaluation guidelines for consistent, objective assessment.
Continuously refine benchmarks as products, models, and legal requirements evolve.
Error Analysis & Insight Generation
Identify recurring legal errors, edge cases, and failure patterns.
Distinguish minor drafting issues from substantive legal risks.
Flag AI behavior that could mislead users or create downstream legal risk.
Collaboration & Feedback
Work closely with senior legal engineers, product managers, and engineers.
Translate legal feedback into clear, actionable guidance for non-lawyers.
What This Role Is Not
No production coding required.
No provision of legal advice to clients.
No traditional billable work.
Instead, you will use your legal training to define, evaluate, and safeguard legal quality at scale.
Legora is an Equal Opportunity Employer
At Legora, we believe great teams are built on diversity of thought and experience. We’re proud to be an equal opportunity employer and committed to creating an inclusive, high-performance culture where everyone can do their best work. We welcome people of all backgrounds and don’t discriminate based on race, color, religion, national origin, gender, gender identity or expression, sexual orientation, age, disability, veteran status, or any other characteristic protected by law.
How we rate this
Technical Legal Engineer - Evals at Legora rates 70 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where legal evaluation was part of your work. What did you do?
- Tell me about a project where quality assurance was part of your work. What did you do?
- Tell me about a project where issue spotting was part of your work. What did you do?
- Tell me about a project where legal research was part of your work. What did you do?
- Walk me through how you've used LLMs in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Legal Evaluation, Quality Assurance, Issue Spotting, Legal Research, and LLMs. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. You get your review by email within 24 hours.
Get new software engineering jobs (Works on AI ●●●○ or higher) by email
One email a week with the new software engineering jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step