AI Product Engineer
Capco is hiring an AI Product Engineer in New York, United States. It pays $93k-$112k a year and Level rates it ; you can apply on Capco.
Level's read on this job
- On Level's scale, this role is Works on AI ●●●○: the daily work is on AI products, without building the model.
- Tools and skills the posting cites include OpenAI, Anthropic and Gemini.
- Level classifies it as a mid-level role.
- Level lists 681 other open roles at Capco.
- The role was posted in the last few days.
AI in this role
Location: New York, NY | Practice Area: Technology & Engineering | Type: Permanent, Full-Time | Level: CO
Reimagine business processes and build the next generation of AI-powered solutions using Large Language Models, agentic AI, and Generative AI technologies.
The Role
Capco is seeking an AI Product Engineer to help design, develop, and deliver innovative AI-powered products and solutions that transform how businesses operate. This role combines product thinking, hands-on technical capabilities, and client engagement to identify opportunities where AI can streamline workflows, automate processes, and create meaningful business value.
You will work directly with clients, business stakeholders, product managers, and engineering teams to understand business challenges, reimagine existing processes, and translate opportunities into practical AI-powered solutions. You will help shape product requirements, develop prototypes, and guide solutions from initial concept through implementation.
This opportunity is suited to someone who enjoys solving business problems and working at the intersection of AI technology, product development, and business transformation. The role requires working proficiency in Python and SQL, with a primary focus on product innovation, problem-solving, and delivering business outcomes rather than traditional software engineering.
What You’ll Do
- Partner with clients and business stakeholders to understand existing processes, identify inefficiencies, and redesign workflows using AI, including Generative AI, intelligent automation, and agentic solutions.
- Identify, evaluate, and prioritize AI use cases based on business value, technical feasibility, user experience, and implementation complexity, translating opportunities into product requirements, user stories, and actionable development plans.
- Design and prototype AI-powered products using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI agents, Python, SQL, APIs, and modern AI tools to validate concepts and demonstrate business value.
- Collaborate with AI engineers, developers, designers, and business teams throughout the product lifecycle, facilitating client workshops, gathering requirements, testing solutions, and supporting implementation.
- Evaluate product performance, gather user feedback, and recommend improvements to usability, accuracy, efficiency, and business impact while staying informed about emerging AI technologies and capabilities.
What We’re Looking For
- 2–3 years of relevant professional experience in AI product development, product management, business analysis, technology consulting, AI engineering, or a related field.
- Hands-on experience with Generative AI technologies, Large Language Models, and platforms such as OpenAI, Anthropic, Gemini, Azure OpenAI, or comparable solutions, including familiarity with prompt engineering, RAG, AI agents, and LLM-based applications.
- Working proficiency in Python and SQL, including the ability to independently write scripts, manipulate data, interact with APIs, and develop lightweight prototypes or proof-of-concepts. Advanced software engineering expertise is not required.
- A product-focused approach with the ability to understand business needs, analyze processes, define requirements, prioritize features, and identify opportunities for AI-enabled workflow improvements and intelligent automation.
- Effective analytical, problem-solving, communication, and collaboration skills, with the ability to engage clients, explain technical concepts to non-technical stakeholders, and contribute across discovery, prototyping, testing, and deployment.
- Willingness to work hybrid, 3 days per week, in NY office.
Bonus Points For
- Experience in client-facing consulting environments, particularly within financial services, banking, or capital markets, including presenting AI demonstrations or product recommendations to stakeholders.
- Exposure to AI product management, product roadmaps, Agile methodologies, backlog prioritization, user stories, and tools such as Jira or Confluence.
- Experience developing AI prototypes or workflows using LangChain, LangGraph, CrewAI, Microsoft Copilot Studio, or comparable technologies, including low-code/no-code platforms such as Power Automate, n8n, or Zapier.
- Familiarity with RAG architectures, vector databases, enterprise knowledge management, cloud platforms such as AWS, Azure, or Google Cloud, and AI evaluation or responsible AI principles.
- Experience with process mapping, business process optimization, digital transformation, workflow automation, and human-in-the-loop approaches.
Why Join Capco
- Deliver high-impact technology solutions for Tier 1 financial institutions.
- Work in a collaborative, flat, and entrepreneurial consulting culture.
- Access continuous learning, training, and industry certifications.
- Be part of a team shaping the future of digital financial services.
- Help shape the future of digital transformation across FS & Energy.
Benefits
We offer a competitive, people-first benefits package designed to support every aspect of your life:
- Healthcare Coverage: Medical, dental, and vision benefits to support your health and wellbeing.
- Retirement Savings: 401(k) matching to help you plan for your financial future.
- Family-Friendly Benefits: Maternity and paternity leave, alongside dependent care benefits.
- Financial Wellbeing: Health Savings Accounts (HSA) and Flexible Spending Accounts (FSA).
- Continuous Learning: Tuition reimbursement to support your professional development.
- Wellness Support: Wellness reimbursement to support your personal wellbeing.
- Commuter Benefits: Support for eligible commuting expenses.
- Extra Perks: Access to Working Advantage, a discounted marketplace offering savings on a range of products and services.
Inclusion at Capco
We’re committed to making our recruitment process accessible and straightforward for everyone. If you need any adjustments at any stage, just let us know – we’ll be happy to help. We value each person’s unique perspective and contribution. At Capco, we believe that being yourself is your greatest strength. Our #BeYourselfAtWork culture encourages individuality and collaboration – a mindset that shapes how we work with clients and each other every day.
Use of Artificial Intelligence in Talent Acquisition
At Capco, we use artificial intelligence (AI) tools to support and enhance several parts of talent acquisition. This includes using AI-enabled features within LinkedIn to help source potential candidates, speeding up routine recruitment communications such as emails and creating compelling and brand-aligned job postings that accurately reflect role requirements, and AI-scheduling applications to improve the efficiency of interview coordination.
AI is used as a support tool only. All hiring decisions are made by talent acquisition and hiring teams.
We have been informed of several recruitment scams targeting the public. We strongly advise you to verify identities before engaging in recruitment related communication. All official Capco communication will be conducted via a Capco recruiter.
#LI-MB1
#LI-HYBRID
US Pay Range$93,000—$112,000 USDHow we rate this
AI Product Engineer at Capco rates 75 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How do you structure and test a prompt to get consistent output from a language model?
- How would you design a retrieval step so the model answers from real data instead of guessing?
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Tell me about a workflow you automated with AI tools, end to end.
- How do you decide that one model's output is better than another's for a given task?
Adapt your resume
- List these exact terms on your resume: Prompt engineering, RAG, AI agents, AI Automation, and AI Evaluation. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new software engineering jobs (Works on AI ●●●○ or higher) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step