Principal Quality Engineer
Hiscox is hiring a Principal Quality Engineer in Boston, United States. It pays $115k-$135k a year and Level rates it ; you can apply on Hiscox.
Level's read on this job
- Works on AI ●●●○ is how Level rates this role: the daily work is on AI products, without building the model.
- Tools and skills the posting cites include Playwright, Cucumber and GitHub Actions.
- Level classifies it as a lead role.
- Level lists 98 other open roles at Hiscox.
AI in this role
Advance testing capabilities through AI-driven methodologies, automated test generation, and anomaly detection as a Principal Quality Engineer.
Job Type:
PermanentBuild a brilliant future with Hiscox
Principal Quality Engineer
We are seeking an innovative Principal Quality Engineer who will advance our testing capabilities through modern automation and AI-driven methodologies. This position is responsible for establishing an automation-centric approach, designing sophisticated test frameworks, and ensuring quality is integrated throughout the software development lifecycle by utilizing artificial intelligence for efficient test generation, anomaly detection, and predictive analytics.
Reporting directly to the Director of Quality Engineering, the successful candidate will support and guide scrum teams, exemplify best practices, and champion ongoing improvement initiatives. The ideal applicant will demonstrate a strong commitment to scalable automation, effective cross-functional collaboration, leveraging AI in testing strategies, and addressing complex testing scenarios.
Key Responsibility Areas:
Quality Engineering Leadership & Execution:
Lead the design, implementation, and evolution of automation frameworks using Playwright, and Cucumber.
Drive an automation‑first mindset, ensuring new features are supported by robust automated tests across UI, API, integration, and regression layers.
Partner with developers to improve code quality through testability reviews, shift‑left practices, and continuous testing.
Own test strategy for assigned value streams, ensuring coverage, reliability, and alignment with CI/CD pipelines.
Framework & Tooling Ownership:
Build and maintain scalable, reusable automation frameworks that support multiple teams and applications.
Integrate automated tests into modern CI/CD pipelines (GitHub Actions, Jenkins, Azure DevOps, or similar).
Establish standards for test data management, mocking, and service virtualization.
Evaluate and introduce new tools that improve speed, stability, and observability of automated tests.
Process Engineering & Quality Governance:
Define and enforce best practices for test automation, defect triage, root‑cause analysis, and quality gates.
Partner with QE leadership to standardize tooling, reporting, and quality metrics across teams.
Track and communicate key quality indicators such as automation coverage, flakiness, performance trends, and release readiness.
Cross‑Functional Collaboration & Enablement:
Work closely with Engineering, Product, Architecture, and Security to embed testing early in the development lifecycle.
Lead enablement sessions on Playwright, Cucumber, TypeScript best practices, and continuous testing.
Support performance testing, security testing, and observability initiatives as needed.
Qualifications:
10+ years of experience in software test automation or software engineering, with at least 5+ years in a principal or lead role.
Deep hands‑on expertise with TypeScript, Playwright, Cucumber, and modern automation frameworks.
Strong understanding of CI/CD pipelines, cloud‑native application testing, and DevOps‑aligned QA workflows.
Experience designing automation frameworks from scratch and scaling them across teams.
Solid understanding of performance testing, API testing, and test observability tools.
Familiarity with Agile/SAFe practices; insurance or financial services domain experience is a plus.
Excellent communication, collaboration, and technical leadership skills.
What We Offer:
Competitive salary and bonus (based on personal & company performance)
401(k) with competitive company matching
Comprehensive health insurance, vision, dental and FSA plans (medical, limited purpose, and dependent care)
Company paid group term life, short- term disability and long-term disability coverage
24 Paid time off days plus 2 Hiscox days, 10 paid holidays plus 1 paid floating holiday, and ability to purchase 5 PTO days
Paid parental leave
4 week paid sabbatical after every 5 years of service
Financial Adoption Assistance and Medical Travel Reimbursement Programs
Annual reimbursement up to $600 for health club membership or fees associated with any fitness program
Company paid subscription to Headspace to support employees’ mental health and wellbeing
Recipient of 2024 Cigna’s Well-Being Award for having a best-in-class health and wellness program
Dynamic, creative and values-driven culture
Modern and open office spaces, complimentary drinks
Spirit of volunteerism, social responsibility and community involvement, including matching charitable donations for qualifying non-profits via our sister non-profit company, the Hiscox USA Foundation
Salary: $115-$135k
The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role; the skills, education, training, credentials and experience of the candidate; and other conditions of employment.
**Please note that this position is hybrid and requires two (2) days in our office weekly**
#LI-RM1
Work with amazing people and be part of a unique culture
How we rate this
Principal Quality Engineer at Hiscox rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where test automation was part of your work. What did you do?
- Tell me about a project where quality assurance was part of your work. What did you do?
- Tell me about a project where ai testing was part of your work. What did you do?
- Tell me about a project where ci/cd was part of your work. What did you do?
- Walk me through how you've used Playwright in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Test Automation, Quality Assurance, AI Testing, CI/CD, and Playwright. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new software engineering jobs (Works on AI ●●●○ or higher) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step