AI QA Automation Engineer, AVP - State Street Investment Management
State Street is hiring an AI QA Automation Engineer, AVP - State Street Investment Management in Boston, United States. It pays $80k-$140k a year and Level rates it ; you can apply on State Street.
Level's read on this job
- Level rates this role Uses AI ●●○○: an ordinary role that requires AI tools.
- Tools and skills the posting cites include Copilot, prompt engineering and RAG.
- Level classifies it as a senior role.
- Level lists 1,100+ other open roles at State Street.
- The role was posted in the last few days.
AI in this role
We are looking for an AI Quality Engineer to modernize and accelerate software quality engineering through AI-assisted testing and intelligent automation. The ideal candidate will bring strong hands-on QA automation experience and demonstrated expertise in Playwright, GitHub Copilot, and Tricentis Tosca, including Tosca AI capabilities. The engineer will use AI-assisted development and automation techniques to improve test generation, automation development, execution, maintenance, defect analysis, and overall QA productivity. This role will also support the development and adoption of reusable AI-powered QA agents and automation frameworks across multiple application teams.
Key Responsibilities
AI-Assisted Quality Engineering
- Use GitHub Copilot to accelerate the development of automated test cases, utilities, test data solutions, API tests, and QA frameworks.
- Apply Generative AI to requirements analysis, test scenario identification, test case generation, automation generation, and defect analysis.
- Develop reusable prompts, instructions, skills, and engineering patterns that improve the consistency and accuracy of AI-generated QA assets.
- Evaluate AI-generated tests for accuracy, stability, coverage, maintainability, and security rather than accepting generated output without engineering validation.
- Contribute to the development and enhancement of AI QA agents for requirements analysis, test design, automation generation, traceability, and defect triage.
Playwright Automation Engineering
- Design, develop, and maintain scalable automated test frameworks using Playwright. Hands-on Playwright experience is mandatory for this role.
- Build and maintain Playwright tests for modern web applications using JavaScript or TypeScript.
- Develop reusable fixtures, page objects, utilities, reporting, test data, and environment configuration to support enterprise-scale automation.
- Implement reliable cross-browser, API, integration, regression, and end-to-end testing with Playwright.
- Integrate Playwright automation into GitHub Actions, Azure DevOps, Jenkins, or equivalent CI/CD and Continuous Testing pipelines.
- Analyze failed automation and determine whether failures are caused by application defects, test data, environment, or automation issues.
Tricentis Tosca & Tosca AI
- Design, develop, and maintain automated tests using Tricentis Tosca.
- Apply Tosca AI-assisted capabilities to increase automation productivity and improve test maintenance.
- Build reusable Tosca components and automation assets that can be shared across applications.
- Support GUI, API, integration, regression, and end-to-end testing.
- Integrate Tosca automation into CI/CD and Continuous Testing pipelines.
QA Transformation & Adoption
- Partner with application QA and development teams to identify opportunities for AI-assisted testing and automation.
- Help application teams adopt Playwright, GitHub Copilot, Tosca, and AI QA capabilities.
- Build reusable examples, templates, prompts, standards, and best practices.
- Conduct demonstrations, knowledge-sharing sessions, and technical enablement for QA engineers.
- Measure improvements in automation coverage, development effort, execution time, maintenance effort, and defect detection.
Required Skills and Qualifications
- 5+ years of experience in Quality Engineering or QA Automation.
- Mandatory: Strong hands-on experience designing, developing, and maintaining automated tests and frameworks using Playwright.
- Strong JavaScript or TypeScript experience for Playwright automation development.
- Strong hands-on experience with GitHub Copilot.
- Strong experience with Tricentis Tosca.
- Experience applying Generative AI or large language models (LLMs) to software testing or engineering workflows.
- Strong understanding of test automation architecture, functional and regression testing, API testing, UI/web automation, test data management, CI/CD, Continuous Testing, defect analysis, and debugging.
- Programming or scripting experience with Java, JavaScript/TypeScript, Python, or C#.
- Experience with Git/GitHub and modern development workflows.
Preferred Skills
- Tosca API and enterprise application automation.
- GitHub Actions, Jenkins, or Azure DevOps.
- Jira and Xray.
- AI agent development or agentic workflows.
- Prompt engineering and reusable AI instruction or skill development.
- Retrieval-Augmented Generation (RAG) and enterprise knowledge-base integration.
- Requirements-to-test traceability.
- AI-generated automation validation and governance.
- Performance or data testing experience.
Salary Range:
$80,000 - $140,000 AnnualThe range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.
Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.
For a full overview, visit https://hrportal.ehr.com/statestreet/Home.
About State Street
Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
Discover more information on jobs at StateStreet.com/careers
Read our CEO Statement
Job Application Disclosure:
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
How we rate this
AI QA Automation Engineer, AVP - State Street Investment Management at State Street rates 55 out of 100 for how much of the daily work is AI. That makes it Uses AI (AI Level 2 of 4). The level is about AI in the job, not seniority.
Uses AI. An ordinary role that requires AI tools.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How do you structure and test a prompt to get consistent output from a language model?
- How would you design a retrieval step so the model answers from real data instead of guessing?
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Tell me about a workflow you automated with AI tools, end to end.
- Walk me through how you've used Copilot in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Prompt engineering, RAG, AI agents, AI Automation, and Copilot. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Put the AI tool in a bullet point about what you did, not just in a skills list. This role treats it as a required part of the job.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new software engineering jobs (Uses AI ●●○○ or higher) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that use AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step