Skip to content
Level

Poly AI

Staff Product Manager (Runtime Team)

Poly AI is hiring a Staff Product Manager (Runtime Team) in London, United Kingdom. Level rates it ; you can apply on Poly AI.

Level's read on this job

  • On Level's scale, this AI product manager role is Builds AI ●●●●: the job is building AI systems.
  • The posting mentions product management, inference and runtime infrastructure among its tools and skills.
  • Level classes it as a lead role.
  • Poly AI has 1 other open role on Level.
  • Posted in the last few days.

AI in this role

Staff Product Manager to own the runtime, inference, and data infrastructure for PolyAI's enterprise conversational platform.

product-managementinferenceruntime-infrastructuredata-platformai-models

PolyAI is the Agentic Dialog Platform for building the conversational enterprise, used to build, run, govern, and improve dialog agents at scale. Powered by Raven, a proprietary dialog model trained on more than a billion enterprise conversations, PolyAI agents are built for complexity, open at every layer, and sovereign by design. PolyAI serves hundreds of enterprises across 75 languages and 25 countries, including Metro Bank, Marriott, PG&E, and UniCredit.

PolyAI automates customer service through lifelike voice assistants that let customers lead a conversation. Our voice assistants make it possible for businesses to deliver outstanding customer service that rivals their human agents.

Our customers, which include the world’s leading logos, are expanding how they use our platform, driving automation of critical customer service operations and integrating PolyAI into their daily customer service workflows.

We’re looking for a highly technical, senior product leader to own the platform underneath everything our agents do: the runtime that serves conversations in production, the inference layer that powers our models, and the data infrastructure that feeds both. This is a deep infrastructure role with direct exposure to latency, cost, and reliability tradeoffs at scale, not a roadmap-and-backlog role. You’ll set strategy for areas other teams build on top of, working closely with engineering leadership rather than through them

RESPONSIBILITIES

  • Own the product strategy for runtime (how conversations get served in production), inference (how our models are hosted and served, including self-hosted and third-party paths), and the data platform (how conversation and model data moves, is stored, and is queried across the business)
  • Set direction on build-vs-buy and self-host-vs-managed tradeoffs for model serving, including evaluating cost, latency, and scaling implications of infrastructure decisions before they’re made, not after
  • Build and own the evaluation framework for how we measure runtime and inference performance in production (latency, throughput, cost per minute/token, failure rates), and drive continuous improvement off that data
  • Partner directly with infrastructure and platform engineering leadership to sequence a technical roadmap that often has no visible customer-facing surface, and defend its priority against features that do
  • Own how conversation data flows into and out of the platform, including data residency, retention, and access-control tradeoffs that affect what the business can build or sell
  • Translate ambiguous technical constraints (capacity limits, model failure modes, data gaps) into decisions the rest of the business can plan around
  • Lead and influence a cross-functional group of engineers, data scientists, and infrastructure specialists without formal authority over them
  • Represent this area in exec-level conversations on cost, capacity planning, and platform risk

REQUIRED QUALIFICATIONS

  • 6+ years of product management or related technical experience, including a strong track record owning infrastructure, ML/data platform, or runtime-adjacent products, not just user-facing features
  • Bachelor’s degree (or foreign equivalent) in Computer Science, Engineering, Statistics, or a related field involving AI/ML or distributed systems, or equivalent industry experience
  • Strong working knowledge of how inference and model-serving infrastructure actually works: latency budgets, GPU/node economics, self-hosted vs. managed serving tradeoffs
  • Comfortable owning a roadmap with no end-user-visible surface, and able to make the business case for infrastructure investment on its own terms
  • Experience with data platform decisions: pipelines, residency/compliance constraints, and tradeoffs between centralizing vs. fragmenting data by region or product line
  • Demonstrated ability to operate at a senior level: setting direction, not just executing against someone else’s plan, and mentoring more junior PMs
  • Entrepreneurial mindset, comfortable with ambiguity and fast iteration in a high-growth environment
  • Exceptional cross-functional communication skills, particularly translating infrastructure tradeoffs for non-technical stakeholders

Compensation

We offer a competitive base salary, shaped by your experience and location, plus equity — so you share in the value you help create.

Benefits

💰 Participation in the company’s employee share options plan

🏝 Tenure-Based PTO: You will receive 25 holidays when you join and will gain an additional 1 day after 2 years of service, then 1 day each year until capped at 32 holidays

🏡 Flexible working from home policy

🌎 Work from outside of the UK for up to 6 months each year

🫂TELUS Health EAP 24/7 - offers you and your chosen family confidential, judgment-free support for any work, health, or life challenge

🧡 Enhanced parental leave

🚲 Bike2Work scheme

📚 Annual learning and development allowance

🏡 We’re all about making WFH work for you - that’s why we offer a one-off WFH allowance when you join. Offering perks like noise-cancelling headphones or a comfortable desk chair to boost your comfort and focus!

👨‍👩‍👧 Company-funded fertility and family-forming programmes

🌸 Menopause care programme with Maven

🏥 Private healthcare and dental cover, discounts on gym members and relaxation apps, and access to a range of mental health programs

🌎 Sabbatical Program: 5-week paid sabbatical available after 5 years of employment

At PolyAI, we take great pride in our values - they guide everything we do. We believe that a strong culture leads to meaningful work and lasting impact.

Our core values are:


Only the best
We expect the best from our people, we hire people that expect the best from themselves, and we nurture this drive for excellence.


Ownership
We care deeply about what we do. We take ownership of our initiatives, decisions and outcomes.


Relentlessly improve
We demand more from ourselves and are always evolving. Continuous, obsessive improvement is the only way we will transform the world of conversational AI.


Bias for action
Our world moves quickly and so do we. We take calculated risks and we deliver impact fast.


Disagree and commit
We are all working toward the same goal. If we donʼt agree with something, we work hard to understand it and when a decision is made, we accept it and give it our all.


Build for people
We want the world to enjoy the experiences they have with us. We are building for a future that prefers automation.

PolyAI is proud to be an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All employment decisions at PolyAI will be based on the business needs without attention to ethnicity, religion, sexual orientation, gender identity, family or parental status, national origin, neurodiversity status or disability status.

Kindly find the Privacy Notice for our recruitment process by following the link here. This document provides important information regarding how we handle your personal data throughout the recruitment journey.

How we rate this

Staff Product Manager (Runtime Team) at Poly AI rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Product ManagementInferenceRuntime InfrastructureData PlatformAI Models

Also common in AI product manager jobs at this level

Pay

Typical AI product manager job
$178k

This posting doesn't list pay. Use the typical AI product manager figure when pay comes up. See AI product manager jobs

Questions you could be asked

  1. Tell me about a project where product management was part of your work. What did you do?
  2. Tell me about a project where inference was part of your work. What did you do?
  3. Tell me about a project where runtime infrastructure was part of your work. What did you do?
  4. Tell me about a project where data platform was part of your work. What did you do?
  5. Tell me about a project where ai models was part of your work. What did you do?

Adapt your resume

  • List these exact terms on your resume: Product Management, Inference, Runtime Infrastructure, Data Platform, and AI Models. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. You get your review by email within 24 hours.

Get new AI product manager jobs (Builds AI ●●●●) by email

One email a week with the new AI product manager jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Product roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Poly AI

More AI product manager jobs

Related searches

Same AI level

Jobs by city