# Quality Assurance Engineer – AI Agentic Applications, AVP at Deutsche Bank

Deutsche Bank is hiring a Quality Assurance Engineer – AI Agentic Applications, AVP in Pune, India. Level rates it Builds AI ●●●●; you can [apply on Level](https://jobsbylevel.com/go/d8c941a2-7b88-46c8-b099-e1aa3e7db7bd).

AI Level 4, AI centrality 90 out of 100. Pune - Business Bay.

## Details

- Company: [Deutsche Bank](https://jobsbylevel.com/companies/deutsche-bank)
- AI level: AI Level 4 (score 90 out of 100)
- Location: Pune - Business Bay
- Posted: October 8, 2026
- Apply: https://jobsbylevel.com/go/d8c941a2-7b88-46c8-b099-e1aa3e7db7bd

## Description

Job Description: Job Title: Quality Assurance Engineer – AI Agentic Applications Location: Pune, India Corporate Title: AVP Role Description Quality Assurance Engineer to validate AI agentic applications across development and production. The position combines specialized AI testing, automation, safety evaluation, and continuous quality measurement. The engineer is responsible to design, build and execute the test strategy for LLM accuracy, RAG ingestion and attribution, agent planning and tool use, recovery behavior, and production failure patterns What we’ll offer you As part of our flexible scheme, here are just some of the benefits that you’ll enjoy Best in class leave policy Gender neutral parental leaves 100% reimbursement under childcare assistance benefit (gender neutral) Sponsorship for Industry relevant certifications and education Employee Assistance Program for you and your family members Comprehensive Hospitalization Insurance for you and your dependents Accident and Term life Insurance Complementary Health screening for 35 yrs. and above Your key responsibilities Design, execute, and maintain test strategies and automation frameworks for AI-powered agentic workflows Develop and implement specialized testing approaches for LLM-powered applications, validating response accuracy, relevance, and grounding, while identifying hallucinations and edge-case behaviours Test and evaluate the behaviour of autonomous and semi-autonomous AI agents, ensuring proper planning, tool selection/sequencing, agent-to-agent interactions, and graceful error/timeout recovery Validate Retrieval-Augmented Generation (RAG) performance, including document ingestion, chunking, metadata quality, embedding accuracy, and citation/source attribution Perform AI safety and security testing to identify vulnerabilities such as prompt injection (direct/indirect), data leakage, unauthorized tool execution, and privilege escalation Establish quantitative AI evaluation metrics and quality gates (e.g., classification accuracy, groundedness, hallucination rate, tool-selection accuracy, and cost/latency) to measure performance across releases Build and maintain automated test suites (covering APIs, UI, integration, RAG, and agent trajectories) to progressively transition the testing suite toward automated continuous evaluation Analyze production AI interactions and failed agent journeys to identify recurring failure patterns, create regression tests from production incidents, and ensure decision auditability Your skills and experience Minimum Required Skills & Experience (Must Have): Bachelor's degree or above in Computer Science, Engineering, Information Technology, or a related discipline 5+ years of experience in software quality assurance and testing, with strong knowledge of test planning, functional, integration, regression, and end-to-end testing 1–2 years of hands-on experience specifically testing GenAI, LLM, or Agentic AI applications Strong experience with test automation and building automation frameworks and test utilities (rather than relying solely on manual tools) Strong programming ability in at least one language: Java / Kotlin or Python Strong understanding of generative AI technologies, including LLMs, prompt engineering, RAG, embeddings, vector databases, AI agents/agentic workflows, and tool/function calling Hands-on experience with LLM and agent evaluation tools such as Langsmith/Langfuse, Ragas, or equivalent frameworks for dataset-based testing, custom evaluation metrics, experiment tracking, tracing, and continuous regression evaluation Add On Experience (Nice to Have): Experience testing API and data integrations, including REST APIs, JSON, SQL, databases, and messaging systems like Kafka Good understanding of CI/CD integration and establishing automated quality gates Experience working in the financial services industry, with knowledge of regulatory reporting, trade lifecycles, transaction reporting, reconciliations, and

The description is cut here. Read the full offer: https://jobsbylevel.com/jobs/quality-assurance-engineer-ai-agentic-applications-avp-at-deutsche-bank-dc43ed

Source: https://jobsbylevel.com/jobs/quality-assurance-engineer-ai-agentic-applications-avp-at-deutsche-bank-dc43ed

## Cite this page

Level. https://jobsbylevel.com/jobs/quality-assurance-engineer-ai-agentic-applications-avp-at-deutsche-bank-dc43ed.

Get job alerts: https://jobsbylevel.com/newsletter