Level

State Street

AI Orchestration Engineer, Vice President

AI in this role

langchainlanggraphcrewaiautogensemantic-kerneldatabricks
prompt-engineeringragai-agentsml-opsai-safety

Who We Are Looking For

The State Street Global Cybersecurity (GCS) organization is seeking an AI Orchestration Engineer to help build the next generation of enterprise AI capabilities across Cybersecurity functions.

As part of the GCS team, you will operate at the intersection of Artificial Intelligence, Agentic Systems, Data Engineering, and Enterprise Governance. This role is responsible for designing, engineering, and operationalizing scalable AI orchestration frameworks that transform enterprise data into intelligent, auditable, and secure business outcomes.

This role requires strong capabilities in both AI Engineering and Data Engineering. You will design data products, orchestrate multi-agent workflows, develop Retrieval-Augmented Generation (RAG) systems, integrate enterprise knowledge sources, and establish the governance and observability capabilities required to operate AI safely within a highly regulated financial services environment.

Why This Role Is Important To Us

State Street is accelerating the adoption of AI-enabled capabilities to improve operational efficiency, enhance cybersecurity resilience, strengthen risk management, and deliver intelligent experiences across the enterprise.

As an AI Orchestration Engineer, you will help establish the AI execution layer that enables secure collaboration between enterprise data platforms, large language models, internal knowledge repositories, agentic workflows, governance controls, and human decision makers.

What You Will Be Responsible For

  • Design and engineer AI orchestration frameworks that coordinate multiple models, agents, tools, APIs, and enterprise applications.
  • Develop agent-to-agent and human-in-the-loop workflows that automate complex operational and analytical processes.
  • Build reusable orchestration patterns that enable rapid deployment of AI-enabled business capabilities.
  • Design and develop scalable data pipelines supporting AI, analytics, and agentic workflows.
  • Build enterprise data products optimized for AI consumption.
  • Design and implement enterprise RAG architectures.
  • Develop reusable AI platform components supporting multiple use cases and business domains.
  • Implement MLOps and LLMOps deployment, monitoring, versioning, and governance capabilities.
  • Implement Responsible AI guardrails, governance controls, and model risk management processes.
  • Build AI observability, evaluation, telemetry, and performance measurement solutions.

Education & Qualifications

Minimum Qualifications

  • Bachelor's degree in Computer Science, Data Engineering, Information Systems, Artificial Intelligence, or equivalent practical experience.
  • 3–5 years of experience in Data Engineering, AI Engineering, Machine Learning Engineering, Software Engineering, or related disciplines.
  • Strong experience developing large-scale data pipelines and distributed data-processing solutions.
  • Experience with Python, SQL, APIs, workflow automation, and cloud-native architectures.
  • Strong communication and stakeholder collaboration skills.

Preferred Qualifications

  • LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, or similar frameworks.
  • Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, and Airflow.
  • Experience with vector databases, semantic search, and enterprise RAG platforms.
  • Experience implementing MLOps, LLMOps, AI observability, and evaluation frameworks.
  • Knowledge of Responsible AI, data governance, and model risk management.

Success Measures

  • Accelerate delivery of AI-enabled business capabilities through reusable orchestration frameworks.
  • Increase adoption of governed enterprise AI services.
  • Improve enterprise data accessibility for AI use cases.
  • Enhance reliability, observability, and auditability of AI systems.
  • Reduce operational complexity through agentic automation and intelligent workflows.

Core Competencies

  • AI Orchestration
  • Agentic AI
  • Enterprise AI Platforms
  • Data Engineering
  • RAG Architecture
  • Vector Databases
  • Prompt Engineering
  • MLOps / LLMOps
  • AI Observability
  • Responsible AI
  • Model Governance
  • Human-in-the-Loop AI Systems
  • Python / SQL development

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

How we rate this

AI Orchestration Engineer, Vice President at State Street rates 89 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

Prompt EngineeringRAGAI AgentsML OpsAI SafetyLangChainLangGraphCrewAI

Questions you could be asked

  1. How do you structure and test a prompt to get consistent output from a language model?
  2. How would you design a retrieval step so the model answers from real data instead of guessing?
  3. How do you decide when an AI agent can act on its own versus asking for approval first?
  4. How do you monitor a model once it's live, and how do you know it needs retraining?
  5. How do you think about the risk of an AI system in this kind of role failing silently?

Adapt your resume

  • List these exact terms on your resume: Prompt Engineering, RAG, AI Agents, ML Ops, and AI Safety. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review

Get new AI jobs (Builds AI ●●●●) by email

One email a week with the new AI jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at State Street

Related searches

Same AI level