PwCIN_Associate_Agentic AI Testing_Digital Integration_Advisory_Kolkata
PwC is hiring an IN_Associate_Agentic AI Testing_Digital Integration_Advisory_Kolkata. Level rates it ; you can apply on Level.
AI in this role
Validate the full agentic AI lifecycle including user intent, reasoning, routing, and tool execution with strong observability and testing skills.
Line of Service
AdvisoryIndustry/Sector
Not ApplicableSpecialism
MicrosoftManagement Level
AssociateJob Description & Summary
At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients. These individuals combine technical experience with creative thinking to deliver innovative software products and solutions.In quality engineering at PwC, you will focus on implementing leading practice standards of quality in software development and testing processes. In this field, you will use your experience to identify and resolve defects, optimise performance, and enhance user experience.
*Why PWC
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.
At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. "
Job Description & Summary:
We are looking for someone who can validate the full agentic lifecycle—from user intent and prompting, through agent reasoning and routing, to MCP tool execution and end-to-end workflow validation—with strong observability, automation, and AI quality assessment skills
Responsibilities:
- Validate the entire agentic lifecycle, starting from user intent and prompting through agent reasoning and routing.
- Ensure accurate MCP tool execution and conduct thorough end-to-end workflow validation.
- Utilize strong observability skills to monitor and assess the effectiveness of workflows.
- Employ automation techniques to streamline testing and validation processes.
- Conduct AI quality assessments to ensure optimal functionality and performance of the system.
- Collaborate with cross-functional teams to refine and enhance lifecycle validation methodologies.
Mandatory skill sets:
- Strong experience in Agentic AI testing and validation.
- Must have hands-on knowledge of MCP testing, including tool invocation validation, payload/schema validation, orchestration, error handling, retries, and API/integration testing.
- Experience with AI observability and tracing tools such as LangFuse, Phoenix, or similar platforms for debugging, root cause analysis, and agent behavior validation.
- Strong understanding of AI quality metrics including hallucination detection, accuracy, correctness, groundedness, consistency, determinism, and latency.
- Experience designing and executing prompt testing strategies, including multi-turn, multi-hop, ambiguous, negative, and guardrail/jailbreak scenarios.
- Understanding of intent recognition, routing validation, agent selection, context retention, memory validation, and reasoning/planning validation.
- Ability to create test strategies, evaluation rubrics, golden datasets, and quality metrics for AI systems.
- Experience with API testing and automation frameworks (e.g., Postman, Katalon, Playwright, or equivalent).
Preferred skill sets:
- Experience automating multi-agent validation and orchestration testing.
- Experience with RAG validation, retrieval quality assessment, and grounding/citation validation.
- Knowledge of AI governance, Responsible AI, and risk-based AI validation approaches.
- Experience building automated evaluation pipelines and AI scoring frameworks.
- Familiarity with token usage, model observability, and AI performance monitoring.
Years of experience required:
4+yrs
Education qualification:
Bachelor's degree in Computer Science, IT, or a related field.
Education (if blank, degree and/or field of study not specified)
Degrees/Field of Study required: Bachelor of EngineeringDegrees/Field of Study preferred:Certifications (if blank, certifications not specified)
Required Skills
QA AutomationOptional Skills
Accepting Feedback, Accepting Feedback, Active Listening, AI Fluency, AI-Human Collaboration, Communication, Compatibility Testing, Defect Reporting, Digital Tooling, Emotional Regulation, Empathy, Functional Testing, Inclusion, Intellectual Curiosity, Optimism, Performance Testing, Post Go Live Support, Process Improvement, QA Methodologies, Quality Assurance Engineering, Quality Assurance Metrics, Quality Assurance Process Design, Quality Assurance Process Evaluation, Quality Assurance Process Management, Quality Assurance Testing {+ 17 more}Desired Languages (If blank, desired languages not specified)
Travel Requirements
Not SpecifiedAvailable for Work Visa Sponsorship?
NoGovernment Clearance Required?
NoJob Posting End Date
July 9, 2026How we rate this
IN_Associate_Agentic AI Testing_Digital Integration_Advisory_Kolkata at PwC rates 70 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- How would you design a retrieval step so the model answers from real data instead of guessing?
- How do you think about the risk of an AI system in this kind of role failing silently?
- Tell me about a project where agentic ai was part of your work. What did you do?
- Tell me about a project where quality assurance was part of your work. What did you do?
- Tell me about a project where testing was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: RAG, AI Safety, Agentic AI, Quality Assurance, and Testing. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new AI jobs (Works on AI ●●●○ or higher) by email
One email a week with the new AI jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Other roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step