UAT Testing - Advanced
Capco is hiring a UAT Testing - Advanced in Mumbai, India. Level rates it ; you can apply on Capco.
Level's read on this job
- On Level's scale, this role is Uses AI ●●○○: an ordinary role that requires AI tools.
- Tools and skills the posting cites include AI agents.
- Level classifies it as a senior role.
- Level lists 702 other open roles at Capco.
AI in this role
About Us
“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.
WHY JOIN CAPCO?
You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.
MAKE AN IMPACT
Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.
#BEYOURSELFATWORK
Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.
CAREER ADVANCEMENT
With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.
DIVERSITY & INCLUSION
We believe that diversity of people and perspective gives us a competitive advantage.
MAKE AN IMPACT
Experience: 10+ Years
Location: Mumbai
Domain: Investment Banking/BFSI
Job Summary
We are seeking a highly skilled Senior QA Automation Engineer with 10+ years of experience in software testing and automation. The ideal candidate should have strong expertise in UI and API test automation using Playwright with TypeScript and hands-on experience in Agentic AI testing, including AI-driven workflows, Large Language Models (LLMs), AI agents, and evaluation frameworks. The candidate will play a key role in designing, developing, and maintaining scalable automation frameworks while ensuring the quality of modern AI-powered applications. Domain knowledge and skills is a must.
Key Responsibilities
· Design, develop, and maintain robust UI and API automation frameworks using Playwright and TypeScript.
· Automate functional, regression, smoke, integration, and end-to-end test scenarios.
· Build reusable automation components and improve framework scalability and maintainability.
· Validate AI-driven applications, Agentic AI workflows, LLM-powered systems, and intelligent agents.
· Design and execute test strategies for AI models, prompts, workflows, and autonomous agent behaviors.
· Perform functional, integration, regression, and end-to-end testing for AI-based applications.
· Develop and execute evaluation frameworks to measure AI response quality, accuracy, reliability, safety, and performance.
· Automate API testing using REST APIs and validate request/response payloads.
· Collaborate with developers, product owners, business analysts, and AI/ML teams to understand business and technical requirements.
· Integrate automation suites into CI/CD pipelines and ensure continuous quality delivery.
· Perform defect tracking, root cause analysis, and support issue resolution.
· Prepare test plans, test cases, automation scripts, execution reports, and quality metrics.
· Mentor junior QA engineers and contribute to automation best practices.
How we rate this
UAT Testing - Advanced at Capco rates 43 out of 100 for how much of the daily work is AI. That makes it Uses AI (AI Level 2 of 4). The level is about AI in the job, not seniority.
Uses AI. An ordinary role that requires AI tools.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- This role expects you to use AI tools as part of the job. Which ones have you used, and for what?
- Tell me about a time an AI tool got something wrong. How did you catch it?
Adapt your resume
- List these exact terms on your resume: AI agents. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Put the AI tool in a bullet point about what you did, not just in a skills list. This role treats it as a required part of the job.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. You get your review by email within 24 hours.
Get new AI jobs (Uses AI ●●○○ or higher) by email
One email a week with the new AI jobs (Uses AI ●●○○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Other roles that use AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step