Senior Developer in Test
Napier AI is hiring a Senior Developer in Test in Belfast, United Kingdom. Level rates it ; you can apply on Napier AI.
Level's read on this job
- Level rates this role Uses AI ●●○○: an ordinary role that requires AI tools.
- The posting mentions AI agents among its tools and skills.
- Level classes it as a senior role.
- Napier AI has 4 other open roles on Level.
- Posted in the last few days.
AI in this role
Napier AI's technology works like a digital detective, combining AI with smart analytics to outthink criminals and protect people's money from becoming criminal proceeds. It's not just about stopping crime. It's about making the financial world safer and more trustworthy for everyone.
After securing another investment round, we're fueling our ongoing growth and investing further in our AI products. We're building out our Engineering Centre of Excellence in Belfast, so this is a super exciting time to join Napier as we expand. The Role: Senior Developer in Test
The Senior Developer in Test plays a key role within the Napier Engineering group. You'll write production-quality test code, building and owning automated UI, API and performance tests for one or more of our products, and making automated testing a fast, reliable part of every delivery pipeline. Security and performance testing are core to the role, and with Napier already building agentic AI into our products, you'll help shape how we test AI agents.
You'll work closely with developers to make sure they ship high-quality software with high test coverage, and with Platform Engineering on the environments and pipelines that run it. You'll report to our VP of Delivery, who sets the overall automation strategy, and you'll extend our shared frameworks and help shape how we test.
You'll be a passionate, hands-on technologist who wants to drive our platform to the next level of quality through automation, and to embed automation as a first-class consideration in everything we build. A desire to teach, to learn and to help grow a culture of delivery excellence at Napier is welcome. Your creativity and ideas will be encouraged and supported. We're ready to hear them!
Your day to day: Senior Developer in Test
Test automation
- Design, write and maintain automated UI, API and integration tests for your product area
- Extend and improve our shared automation frameworks (mabl and Playwright for UI, Pytest for API, K6 for performance) in line with our automation strategy
- Keep suites reliable: hunt down flaky tests, improve test data and environment setup
- Build and run performance, load and soak tests (e.g. K6, JMeter) for UI and API journeys, and track results release on release
- Embed security testing in the pipeline: API security, authentication and authorisation, input validation and OWASP Top 10 risks
- Work with Information Security and Platform Engineering to triage and verify security and performance findings
- Bring strategic ideas on how to test agentic and AI-driven features, building on the agentic capabilities Napier is already developing
- Help define approaches for non-deterministic behaviour: evaluation datasets, scoring and guardrail tests, regression checks on model and prompt changes
- Test agent-specific risks such as prompt injection, unsafe tool use, data leakage and hallucinated outputs
- Explore how AI agents can improve our own testing, from test generation to triage
- Integrate automated tests into GitHub Actions pipelines
- Help build and maintain pipelines that test across multiple environments and product versions
- Keep feedback loops fast, so developers know within minutes if a change breaks something
- Champion shift-left testing: get involved in story refinement and design, not just after code is written
- Guide engineering teams on effective and sustainable automation practices
- Lead technical design discussions on test architecture, pipeline quality gates and performance testing
- Influence engineering decisions so quality is built in, not inspected later
- Mentor QA engineers and support upskilling in automation and modern testing practices
- Work closely with developers and Platform Engineering to align testing strategy with system architecture
- Pair with developers on testability, unit and component test coverage
- Promote and reinforce a quality-first, shift-left engineering culture
- Track and report on coverage, defect leakage and pipeline execution time for your area
- Analyse test results and failures, raise clear defects and drive root-cause fixes
Do you have what it takes?
- 5+ years in software testing or development, with at least 3 years writing test automation
- Strong coding skills in Python, Java or TypeScript, writing test code to the same standard as production code
- Hands-on UI automation experience with Playwright and/or mabl (Cypress or Selenium experience also considered)
- Experience testing REST APIs with Pytest or similar
- Proven performance testing experience with K6, JMeter or similar, including designing load scenarios and analysing results
- Proven security testing experience, such as API security testing
- Clear, strategic thinking on how to test AI agents and other non-deterministic systems
- Good understanding of API testing in a microservices architecture
- Experience integrating tests into CI/CD pipelines (GitHub Actions, Jenkins or Azure DevOps)
- Comfortable with Git, code review and working in Agile teams
- Clear communicator who can explain risk and test results to developers and product owners
Nice to have
- Hands-on experience testing LLM-based or agentic systems, or with evaluation tools
- Docker and Kubernetes, including running tests against containerised environments
- Cloud platforms (AWS, Azure or GCP)
- Experience in financial services, RegTech or AML/financial crime software
How we rate this
Senior Developer in Test at Napier AI rates 46 out of 100 for how much of the daily work is AI. That makes it Uses AI (AI Level 2 of 4). The level is about AI in the job, not seniority.
Uses AI. An ordinary role that requires AI tools.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- This role expects you to use AI tools as part of the job. Which ones have you used, and for what?
- Tell me about a time an AI tool got something wrong. How did you catch it?
Adapt your resume
- List these exact terms on your resume: AI agents. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Put the AI tool in a bullet point about what you did, not just in a skills list. This role treats it as a required part of the job.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email usually within a few hours.
Get new software engineering jobs (Uses AI ●●○○ or higher) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that use AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step