Level

State Street

Principal Engineer – Knowledge, Data & RAG Engineering- Assistant Vice President

State Street is hiring a Principal Engineer – Knowledge, Data & RAG Engineering- Assistant Vice President in Hyderabad, India. Level rates it ; you can apply on State Street.

Level's read on this job

  • Level rates this role Works on AI ●●●○: the daily work is on AI products, without building the model.
  • Tools and skills the posting cites include Copilot, LangChain and LlamaIndex.
  • Level classifies it as an executive role.
  • Level lists 1,300+ other open roles at State Street.
  • The role was posted in the last few days.

AI in this role

copilotlangchainllamaindexlanggraphsemantic-kernelvertex-aimlflowdatabricks
ragai-agentsml-opsai-safety

Who we are looking for

We are looking for an experienced Architect to lead enterprise architecture for knowledge and data engineering, RAG, and Graph RAG. Experience in Agentic AI, orchestration, testing, evaluation, and governance is desirable. Working with architecture, data, AI, security, risk, product, testing, and application teams, you will turn business strategy into practical architectures, standards, roadmaps, and delivery controls. You will bring strong architectural leadership and expertise in semantic technologies, modern data platforms, and retrieval systems.

 

Why this role is important to us

Enterprise AI depends on trusted, well-engineered, permission-aware, traceable, and continuously validated data and knowledge. This role establishes the architectural foundation that connects source systems, data pipelines, semantic models, knowledge graphs, retrieval services, models, agents, controls, testing, and business workflows. The Architect will reduce fragmented point solutions, promote reusable capabilities, guide investment decisions, and ensure that AI applications and agents retrieve reliable evidence, generate grounded responses, execute approved actions, and remain secure, observable, auditable, resilient, and compliant throughout their lifecycle.

 

About the team — Alpha Intelligence

Alpha Intelligence is State Street’s AI & Automation Center of Excellence for Alpha Implementations — the team rewiring how the industry’s first front-to-back platform gets delivered. We turn the deep expertise locked inside our implementation teams into engineered processes, governed knowledge and intelligent agents that cut manual effort, compress client go-live timelines and make every implementation faster and more predictable than the last.

We operate as one global team across the North America, EMEA, and APAC, combining process engineering, automation delivery, AI platform engineering and responsible-AI governance under a single roof. We work on real client implementations, not pilots that sit on a shelf — what we build is adopted, measured and scaled. If you want to shape how AI is applied to one of the most complex delivery landscapes in financial services, this is the team to do it in.

 

What you will be responsible for

Own the enterprise architecture for Knowledge Engineering, Data Engineering, RAG and Graph RAG, Agentic AI, testing, and governance, aligning strategy, platforms, delivery, controls, and measurable outcomes.

 

  • Define the enterprise vision, target architecture, standards, reusable patterns, and roadmap across data, knowledge, retrieval, AI agents, testing, and governance.
  • Translate business priorities into scalable solution architectures, transition plans, investment decisions, and measurable outcomes.
  • Lead knowledge and data architecture, including ontologies, semantic models, knowledge graphs, metadata, lineage, data pipelines, quality, and lifecycle management.
  • Architect production-grade RAG and Graph RAG services covering ingestion, indexing, hybrid retrieval, ranking, grounding, citations, provenance, and feedback.
  • Establish testing, evaluation, and release standards for data quality, retrieval, prompts.
  • Embed testing, monitoring, traceability, rollback, and governance controls in delivery pipelines.
  • Lead architecture reviews, align stakeholders, and guide technical teams.

 

What we value

The successful candidate will combine strategic thinking, enterprise architecture perspective, deep technical credibility, and a quality-and-risk mindset. The candidate must communicate complex architectural choices, test evidence, control requirements, risks, and trade-offs clearly to engineering teams, business stakeholders, governance forums, auditors, and senior technology leaders. We value pragmatic architecture, business-value alignment, secure-by-design and test-by-design practices, reuse, interoperability, measurable quality, transparent decision making, and continuously governed enterprise AI outcomes.

 

These skills will help you succeed in this role:

Must-have skills

  • Strong experience in enterprise architecture, technical leadership, and working with cross-functional teams.
  • Strong data engineering expertise across ETL/ELT, batch and streaming pipelines, lakehouse or warehouse platforms, data quality, and DataOps.
  • Expertise in designing ontologies and semantic models and implementing end-to-end RAG and Graph RAG pipelines, including ingestion, chunking, embeddings, indexing, hybrid retrieval, semantic search, graph traversal, ranking, grounding, provenance, and evaluation.
  • Strong knowledge of Responsible AI, privacy, access control, model risk, auditability, regulatory compliance, and policy enforcement.
  • Experience delivering solutions in financial services or another regulated industry.

Nice-to-have skills

  • Exposure to modern data, streaming, workflow, monitoring, vector database, and enterprise search tools such as Snowflake, Databricks, Kafka, dbt, or Airflow would be useful.
  • Familiarity with AI platforms or frameworks such as Azure AI Foundry, Copilot Studio, Vertex AI, LangChain, LangGraph, LlamaIndex, Semantic Kernel, or MLflow would be beneficial.
  • Awareness of Model Context Protocol, connecting AI agents with tools, access controls, monitoring, and AI security would be helpful.
  • Experience establishing automated testing, quality gates, monitoring, traceability, release, and rollback controls within CI/CD and MLOps/LLMOps.
  • An understanding of cloud costs, capacity planning, and communicating architecture proposals to senior stakeholders would be useful.
  • Relevant certifications in architecture, cloud, data, graph, testing, security, governance, or Generative AI would be a plus.

 

Education & Preferred Qualifications

  • A bachelor’s degree in Computer Science, Engineering, Artificial Intelligence, Data Engineering, Information Systems, or a related field is preferred; a master’s degree would be a plus.
  • Extensive technology experience, ideally including architecture, data or knowledge engineering, software or AI engineering, testing, governance, or enterprise platforms.
  • Experience providing architectural guidance and contributing to standards, roadmaps, governance, and key design decisions would be valuable.
  • Exposure to delivering secure, scalable, and well-governed data platforms, knowledge graphs, ontologies, RAG or Graph RAG services, Agentic AI, or Generative AI solutions would be beneficial.
  • The ability to work with senior stakeholders and bring business, architecture, engineering, testing, cloud, security, risk, and operations teams together would be helpful.
  • Relevant certifications in architecture, cloud, data, graph, testing, security, governance, or Generative AI would be a plus.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.


We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.


As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.


Discover more information on jobs at StateStreet.com/careers


Read our CEO Statement

How we rate this

Principal Engineer – Knowledge, Data & RAG Engineering- Assistant Vice President at State Street rates 67 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

RAGAI agentsML OpsAI SafetyCopilotLangChainLlamaIndexLangGraph

Questions you could be asked

  1. How would you design a retrieval step so the model answers from real data instead of guessing?
  2. How do you decide when an AI agent can act on its own versus asking for approval first?
  3. How do you monitor a model once it's live, and how do you know it needs retraining?
  4. How do you think about the risk of an AI system in this kind of role failing silently?
  5. Walk me through how you've used Copilot in your day-to-day work.

Adapt your resume

  • List these exact terms on your resume: RAG, AI agents, ML Ops, AI Safety, and Copilot. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new software engineering jobs (Works on AI ●●●○ or higher) by email

One email a week with the new software engineering jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at State Street

Related searches

Same AI level

Jobs by city