MastercardAI Principle Architect
Mastercard is hiring an AI Principle Architect in Pune, India. Level rates it ; you can apply on Mastercard.
Level's read on this job
- On Level's scale, this role is Builds AI ●●●●: the job is building AI systems.
- The posting mentions OpenAI, Anthropic and Gemini among its tools and skills.
- Mastercard has 1,100+ other open roles on Level.
- Posted in the last few days.
AI in this role
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
AI Principle ArchitectMastercard's Business & Market Insights (B&MI) group empowers organizations to achieve growth and innovation goals by delivering unparalleled data-driven intelligence and cutting-edge AI solutions. By harnessing proprietary data, frontier generative AI, and global expertise, B&MI helps businesses make smarter, faster, and more impactful decisions. We transform complex, multi-modal data into agentic systems and generative applications that drive measurable business outcomes and sustained competitive advantage.We're looking for a Principal Architect, Generative AI & ML Engineering, for the Operational Intelligence Program within B&MI. As a principal-level technical leader, you'll define the architecture vision and technical strategy for our agentic AI platform. On this platform, agents make extensive tool calls into enterprise services and APIs and must run securely, reliably, and at scale. You'll set the standards teams build on across tool calling, multi-agent orchestration, self-correcting agents, memory, retrieval, and LLMOps. You'll also make the key decisions on models, platforms, and trade-offs. Working closely with engineering, product, security, and business leaders, you'll shape the long-term direction of Gen AI across B&MI and mentor architects and senior engineers. You'll also stay hands-on with prototypes that de-risk big bets. The hardest problems in enterprise Gen AI are reliability, integration, security, and scale. If you've solved them as a backend or distributed systems architect and have started applying that experience to LLM systems, we'd love to hear from you.
Roles & Responsibilities
• Own the architecture and technical roadmap for the Operational Intelligence Gen AI platform, defining reference architectures and standards that teams across the program can reuse and scale.
• Architect the enterprise tool-calling layer, setting standards for how internal services, data platforms, and external APIs are exposed to agents as tools. This covers schemas, contracts, versioning, access control, and resilient execution (parallel and chained calls, retries, timeouts, idempotency, circuit breakers, and fallbacks).
• Set the architecture for multi-agent and skills-based agent systems (e.g., LangGraph, CrewAI, AutoGen), including when to use agents versus deterministic workflows and how agents coordinate, delegate, and share context.
• Design self-correcting agent patterns: tool critics and verifiers that check tool selection, arguments, and results, plus reflection and plan-and-execute loops that catch errors before agents act or respond.
• Architect agent memory and state for long-running, multi-step sessions, including short- and long-term memory (e.g., Mem0, Zep, LangGraph memory), session persistence, and memory scoping and retention.
• Define retrieval architecture for grounded reasoning, including Self-RAG, Corrective RAG (CRAG), adaptive retrieval, and Graph-RAG, built on vector databases (e.g., Pinecone, pgvector, OpenSearch) and knowledge graphs (e.g., Neo4j, AWS Neptune).
• Design the inference and orchestration layer for high throughput, covering async processing, streaming, caching, rate limiting, and model routing across OpenAI, Anthropic, Gemini, and open-source models.
• Establish the LLMOps architecture on Databricks (AWS), including MLflow, CI/CD for prompts and agents, and model lineage. Set platform-wide evaluation and observability standards: end-to-end tracing of tool calls, tool-selection accuracy, task success rates, cost, and latency.
• Build security and Responsible AI into the architecture, including guardrails, prompt-injection defenses, hallucination mitigation, data privacy, and audit trails that meet Mastercard's data ethics and regulatory standards.
• Own key architecture decisions and trade-offs, such as build versus buy, model and vendor selection, and cost versus latency versus accuracy, documented through architecture decision records. Assess emerging models, frameworks, and standards such as MCP for production readiness.
• Lead design reviews and partner with engineering, product, security, and data teams to align on architecture and raise the engineering bar across the program.
• Stay hands-on, building prototypes and reference implementations that de-risk decisions and give teams a working starting point.
All About You
• Bachelor's or Master's degree in Computer Science, AI/ML, or Engineering, or equivalent practical experience.
• Significant experience architecting large-scale distributed systems in production, including microservices, event-driven systems, data platforms, and cloud-native infrastructure.
• Deep expertise in API design and systems integration, including contracts, security models, and reliability patterns for services consumed by many teams. You understand what changes when the consumer is an LLM.
• Hands-on experience designing and shipping LLM-powered systems in production, especially agents that use tool/function calling, memory, and retrieval, and a clear view of how they fail.
• Strong Python skills for hands-on prototyping (async programming, FastAPI or similar), plus SQL proficiency.
• Deep experience with at least one major cloud platform (AWS preferred; Azure or GCP welcome), including its AI services such as Bedrock, SageMaker, Azure OpenAI, or Vertex AI.
• A solid grounding in security, privacy, and compliance for enterprise systems, ideally in financial services or another regulated industry.
• The ability to influence without authority, aligning engineering, product, and leadership around a technical direction and explaining trade-offs in business terms.
• Nice to have: hands-on experience with tool critics, Self-RAG, CRAG, reflection loops, memory frameworks such as Mem0 or Zep, MCP tool servers, or agent evaluation frameworks.
• Nice to have: exposure to fine-tuning (LoRA, PEFT, RLHF), multimodal models, or knowledge graphs.
• Coming from backend or distributed systems architecture? The hardest problems in enterprise Gen AI are reliability, integration, security, and scale, and you've solved them before. If you've started applying that experience to LLM systems, we want to hear from you, even if you haven't used every tool listed here.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
Abide by Mastercard’s security policies and practices;
Ensure the confidentiality and integrity of the information being accessed;
Report any suspected information security violation or breach, and
Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
How we rate this
AI Principle Architect at Mastercard rates 95 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How would you design a retrieval step so the model answers from real data instead of guessing?
- Walk me through fine-tuning a model: what data did you use, and how did you check the result?
- How do you think about the risk of an AI system in this kind of role failing silently?
- What's a project where you used OpenAI hands-on?
- Walk me through how you've used Anthropic in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: RAG, Fine-tuning, AI Safety, OpenAI, and Anthropic. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new software engineering jobs (Builds AI ●●●●) by email
One email a week with the new software engineering jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step