Product Engineer
deepset is hiring a Product Engineer for a remote role open to applicants in Germany. Level rates it ; you can apply on deepset.
Level's read on this job
- On Level's scale, this role is Works on AI ●●●○: the daily work is on AI products, without building the model.
- This is listed as a remote role.
- The posting mentions Haystack, AI agents and AI evaluation among its tools and skills.
- deepset has 3 other open roles on Level.
- Posted in the last few days.
AI in this role
TL;DR
We are hiring a Product Engineer, Backend (Junior - Mid) to join our Engineering Excellence team (Remote, bonus: Berlin, Full-time). The role builds and runs the automation that keeps our engineering teams fast: the agents and bots that triage, plan and fix work, CI and release workflows, and internal tools. The profile is backend-leaning: Python, APIs and gluing systems together (GitHub, Linear, Slack, LLM agents), with product sense for what developers actually use.
Why deepset
At deepset, we’re on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We’re remote-first, flexible, and built on a culture of trust and ownership. You’ll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.
What you will do
Own How We Build and Ship
Build and run our CI/CD: GitHub Actions, test pipelines, ephemeral environments and releases across our services.
Make builds fast and reliable: fix flaky tests at the root, cut feedback time, and make failures easy to debug.
Automate the Engineering Workflow
Take a slow, manual step in how we build (triage, review, release, docs) and automate it end to end, with code, workflows or an agent where it fits.
Build and run our engineering agents, such as Marvin, our ticket-to-PR bot, on our own Haystack Enterprise Platform, so every gap you hit becomes feedback for the product.
Ship Fast and Measure
Ship the smallest version early, talk to the engineers who use it, and fix forward.
Measure what works (PR success rate, time from bug to fix, adoption), and kill what nobody uses.
What you bring to the team
Strong engineering fundamentals: clean backend code in Python, APIs, async, and an understanding of how systems fail.
Hands-on CI/CD experience: you have built and debugged pipelines (e.g. GitHub Actions), containers and release workflows that other engineers relied on.
You build with AI every day, and you understand the code it writes well enough to tell when it is wrong.
High agency: you find the problem yourself, ship without waiting for a spec, and say so when you disagree.
Nice to have
Experience building internal tools, developer tooling or automation that other engineers relied on.
Experience with Kubernetes, Docker and infrastructure as code (e.g. Terraform).
Experience with LLM evaluation or building agents.
A side project where you built something with agents just because it fascinated you.
Benefits
Remote-first setup with flexible hours & tech of your choice
30 days vacation + extra days for family sick leave
Competitive salary & stock options for every team member
Monthly sports & mental health support allowance with Oliva
Annual learning & development budget
Monthly team socials & in-person meetups
Dog-friendly Berlin HQ
About us
Founded in 2018, deepset builds open and enterprise-grade tools that help teams build AI with purpose. From Haystack, our open-source framework, to the Haystack Enterprise Platform, we give developers and organizations the building blocks to solve complex, high impact challenges with AI with full control, transparency, and sovereignty. Backed by GV and Balderton, we’re growing the world’s production AI community and customer base solving challenges too critical to get wrong.
Visit us to learn more: deepset Website | Haystack Website | GitHub | Linkedin | X deepset (Twitter) | X haystack (Twitter)
How we rate this
Product Engineer at deepset rates 69 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- How do you decide that one model's output is better than another's for a given task?
- What are the limits of Haystack that you've run into, and how did you work around them?
- Describe a typical day in a role like this one: which parts run through AI directly?
- If you removed AI from this role, what would be left, and how do you decide what still needs a human?
Adapt your resume
- List these exact terms on your resume: AI agents, AI Evaluation, and Haystack. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new remote software engineering jobs (Works on AI ●●●○ or higher) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step