Level

State Street

AI Systems Design Architect, Vice President

AI in this role

prompt-engineeringragai-safety
About the Role

We are seeking an experienced AI Systems Design Architect (VP) to lead enterprise AI system architecture strategy across the full Generative AI platform stack. This role requires deep expertise in Generative AI, enterprise architecture, platform engineering, distributed systems, and scalable cloud architectures on AWS, Azure, or Google Cloud Platform (GCP).

The ideal candidate will define architecture direction, technology standards, and cloud design principles for AI platforms and shared services across the organization. This role will shape modernization priorities, represent Architecture in senior leadership and governance forums, and ensure AI systems are designed for security, resiliency, compliance, interoperability, and long-term scalability.

Key Responsibilities

  • Own and drive enterprise-wide AI system architecture strategy across the full GenAI platform stack, including shared services, orchestration layers, model integration, APIs, data flows, and downstream enterprise systems.

  • Define and govern reference architectures, design standards, architecture principles, integration patterns, and cloud design approaches for AI platforms and AI-enabled applications.

  • Provide strategic technical leadership on scalable, secure, resilient, and compliant AI system design across the organization.

  • Lead architecture decisions for cloud and hybrid AI environments on AWS, Azure, or Google Cloud, ensuring interoperability, platform reuse, cost efficiency, and operational excellence.

  • Establish reusable enterprise patterns for RAG, model serving, prompt orchestration, agentic AI workflows, AI gateways, and service integration.

  • Chair or lead architecture governance forums, reviewing major solution designs, resolving technical trade-offs, and ensuring alignment to enterprise standards.

  • Partner closely with business leaders, product teams, engineering, cloud, security, risk, data, and operations teams to align architecture strategy with business priorities.

  • Ensure AI solutions comply with Responsible AI, governance, data controls, model risk, testing standards, security requirements, and regulatory expectations.

  • Drive architecture assessments, technical due diligence, platform modernization, proof-of-concept direction, and production onboarding standards for AI systems.

  • Guide enterprise decisions on platform capabilities, shared services, build-vs-buy evaluations, and modernization opportunities.

  • Influence and mentor architects and engineering leaders to improve design quality, architectural consistency, and adoption of enterprise AI standards.

  • Represent the Architecture function in senior governance and leadership forums.

Required Qualifications

  • Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or a related discipline; Master’s degree preferred.

  • 12–17 years of experience in solution architecture, enterprise application architecture, platform architecture, or AI/ML architecture, including leadership of large-scale enterprise initiatives.

  • Deep hands-on and architectural experience with Generative AI, LLMs, ML systems, RAG, vector databases, prompt design/orchestration, and AI application integration.

  • Proven expertise in cloud architecture and enterprise solution design on AWS, Azure, or Google Cloud Platform (GCP).

  • Strong understanding of cloud-native architecture including AI/ML services, networking, storage, security, IAM, resilience, and performance optimization.

  • Proven experience designing enterprise-scale, secure, resilient, and high-performing architectures for AI and data-driven applications.

  • Expertise in API architecture, microservices, distributed systems, event-driven patterns, enterprise integration, and platform design.

  • Strong understanding of AI governance, Responsible AI, model risk, compliance, testing, production controls, and control frameworks.

  • Strong understanding of DevSecOps, CI/CD, observability, monitoring, reliability engineering, and platform engineering concepts.

  • Demonstrated ability to lead architecture discussions with senior executives and communicate effectively with both technical and non-technical stakeholders.

  • Strong leadership, stakeholder management, problem-solving, and cross-functional collaboration skills.

Salary Range:

$120,000 - $217,500 Annual

The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.

Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

For a full overview, visit https://hrportal.ehr.com/statestreet/Home.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

Job Application Disclosure:

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

How we rate this

AI Systems Design Architect, Vice President at State Street rates 68 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.

Skills and AI tools this role asks for

Prompt EngineeringRAGAI Safety

Questions you could be asked

  1. How do you structure and test a prompt to get consistent output from a language model?
  2. How would you design a retrieval step so the model answers from real data instead of guessing?
  3. How do you think about the risk of an AI system in this kind of role failing silently?
  4. Describe a typical day in a role like this one: which parts run through AI directly?
  5. If you removed AI from this role, what would be left, and how do you decide what still needs a human?

Adapt your resume

  • List these exact terms on your resume: Prompt Engineering, RAG, and AI Safety. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project — this role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review

Get new AI jobs (Works on AI ●●●○ or higher) by email

One email a week with the new AI jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at State Street

Related searches

Same AI level