Skip to content

Oscilar.com

Engineering Manager - AI Agents (Agent Platform, LLMs, Evals)

Oscilar.com is hiring an Engineering Manager - AI Agents (Agent Platform, LLMs, Evals) for a remote role open to applicants in United States. It pays $1/hr and Level rates it ; you can apply on Oscilar.com.

Level's read on this job

  • On Level's scale, this role is Builds AI ●●●●: the job is building AI systems.
  • This is listed as a remote role.
  • The posting mentions LangGraph, Bedrock and AI agents among its tools and skills.
  • Oscilar.com has 20 other open roles on Level.
  • Posted in the last few days.

AI in this role

LangGraphBedrock
ai-agents
Engineering Manager - AI Agents (Agent Platform, LLMs, Evals)

Shape the future of trust in the age of AI

At Oscilar, we're building the most advanced AI Risk Decisioning™ Platform. Banks, fintechs, and digitally native organizations rely on us to manage their fraud, credit, and compliance risk with the power of AI. If you're passionate about solving complex problems and making the internet safer for everyone, this is your place.

Why join us:

  • Mission-driven teams: Work alongside industry veterans from Meta, Uber, Citi, and Confluent, all united by a shared goal to make the digital world safer.

  • Ownership and impact: We believe in extreme ownership. You'll be empowered to take responsibility, move fast, and make decisions that drive our mission forward.

  • Innovate at the cutting edge: Your work will shape how modern finance detects fraud and manages risk.

Background

Oscilar is seeking a US-based Manager of AI Agents to lead a team of engineers building and operating the production agent systems at the heart of our Agentic Risk Platform.

In this role, you will own the technical and people leadership for a team focused on agent orchestration, tool-calling, evaluation frameworks, reliability, and observability. You will partner closely with product, FDE and core platform engineering to raise the bar on what production-grade agents can deliver for fraud, AML, credit, and onboarding use cases.

This is a hands-on leadership role for someone who has been a software engineer, has shipped real agent systems in production, and has successfully built and managed engineering teams at a growing startup or scale-up. The right person is energized by technical depth, operational excellence, and turning ambitious agent ideas into reliable, customer-facing systems.

Responsibilities

  • Team leadership: Build, lead, and grow a high-performing team of 5–10 engineers focused on AI agent systems. Hire, coach, and develop talent while establishing strong technical and cultural standards. Create an environment where strong engineers want to stay and grow.

  • Production agent systems: Drive the design, development, and continuous improvement of production agent capabilities including orchestration, tool-calling (including MCP and related protocols), evaluation frameworks, reliability, observability, and safe failure modes. Agents are built on a governed platform where every new agent inherits shared evals, guardrails, and auditability.

  • Technical quality and judgment: Raise the bar on architecture, design quality, reliability, and service ownership for agent systems that operate in high-stakes, regulated environments.

  • Cross-functional impact: Partner with Forward-Deployed Engineers and customer teams to ship agents into customer environments and turn field feedback into platform improvements.

  • Operational excellence: Establish clear planning, execution, and incident processes that support predictable delivery without unnecessary overhead. Own reliability and post-incident learning for agent systems.

  • Talent and leadership development: Recruit senior individual contributors and emerging leaders. Create an environment where strong engineers want to stay and grow.

  • Scale and reliability: Ensure AI agent systems meet the performance, security, auditability, and reliability standards required by financial institutions that rely on our platform to process billions of risk decisions.

Requirements

  • Significant hands-on software engineering experience, with a track record of shipping production systems.

  • Proven experience building and shipping agent systems in production, including hands-on work with tool-calling, orchestration, evaluation frameworks (evals), and reliability engineering.

  • Experience managing and building engineering teams of 5+ people (direct reports or equivalent), including hiring, coaching, and raising technical standards.

  • Experience at a growing startup or scale-up, with comfort operating in fast-moving, ambiguous environments and creating structure where needed.

  • Strong technical judgment and enough depth to evaluate agent architectures, system design, failure modes, and engineering quality with credibility.

  • Excellent written and verbal communication skills, with experience partnering across product, data science, and distributed teams.

  • Experience with reliability, observability, and production operations for complex AI or distributed systems.

  • Experience in fintech, fraud, credit risk, AML, compliance, or other regulated industries is a strong plus.

  • Prior experience with Model Context Protocol (MCP), multi-agent orchestration, or large-scale agent evaluation systems is highly valued.

  • Our Tech stack: LangGraph (or similar agent frameworks), AWS Bedrock, Python + Java, MCP

This is a remote senior engineering leadership role based in the US. You will report into engineering leadership and have direct ownership of a critical part of Oscilar’s agent platform.

Benefits

  • Compensation: Competitive salary and equity packages, including a 401k

  • Flexibility: Remote-first culture — work from anywhere

  • Health: Comprehensive health, dental, and vision insurance with a top tier plan for you and your dependents (US)

  • Balance: Unlimited PTO policy

  • Technical: AI First company; both Co-Founders are engineers at heart; and over 50% of the company is Engineering and Product

  • Culture: Family-Friendly environment; Regular team events and offsites

  • Development: Unparalleled learning and professional development opportunities

  • Impact: Making the internet safer by protecting online transactions

How we rate this

Engineering Manager - AI Agents (Agent Platform, LLMs, Evals) at Oscilar.com rates 88 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI agentsLangGraphBedrock

Questions you could be asked

  1. How do you decide when an AI agent can act on its own versus asking for approval first?
  2. Walk me through how you've used LangGraph in your day-to-day work.
  3. What are the limits of Bedrock that you've run into, and how did you work around them?
  4. How would you decide a model or AI system is ready to ship?
  5. Tell me about a time a model underperformed in production. How did you find out, and what did you change?

Adapt your resume

  • List these exact terms on your resume: AI agents, LangGraph, and Bedrock. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email usually within a few hours.

Get new remote software engineering jobs (Builds AI ●●●●) by email

One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free.

Similar roles

Software Engineering roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Oscilar.com

Related searches

Same AI level