Level

LaunchDarkly

Senior Full Stack Engineer, AgentControl

LaunchDarkly is hiring a Senior Full Stack Engineer, AgentControl for a remote role open to applicants in United States. Level rates it ; you can apply on Level.

AI in this role

openaibedrock
prompt-engineeringfine-tuning

About the Job:

As a Senior Full Stack Engineer on LaunchDarkly’s AgentControl team, you'll build critical systems such as the web application that customers interact with on a daily basis and distributed systems that power AI evaluations at scale. These systems enable customers to control, monitor, and optimize their agent’s functionality. 

LaunchDarkly’s AgentControl team is on a mission to manage the complete software development lifecycle for shipping agents to production, from configuring to benchmarking to observing and beyond. AgentControl enables teams to adjust agent behavior without needing a redeploy or code change, while also running experiments, monitoring agents in production, and putting guardrails around AI as usage scales. The product spans offline evals, real-time observability, prompt and workflow optimization, and decision-making around quality, accuracy, relevance, and cost. The AgentControl team has a huge opportunity ahead of it; it's a strategic bet for LaunchDarkly, and we need your help writing the next chapter in our story.

Responsibilities:

  • Build and maintain scalable backend services, distributed systems, and APIs that power the AgentControl product
  • You’ll primarily work in Go, Python, and TypeScript and will work directly with other technologies and tools such as AWS, CockroachDB, Datadog, DeepEval, and FastAPI.
  • Collaborate with internal stakeholders, including product managers, designers, and other LaunchDarkly engineering teams, to understand real-world challenges and improve GenAI workflows using our own platform.
  • Keep up to date with the latest developments in the AI field and in software development best practices
  • Continuously optimize the performance, reliability, and scalability of our systems
  • Drive architecture and design discussions, offering thoughtful input and collaborating with peer engineers to identify trade-offs and make well-informed decisions
  • Take ownership of code in production, participate in on-call rotations, and help improve the reliability and maintainability of our systems over time.
  • Support teammates through thoughtful design reviews, knowledge sharing, and informal mentorship.

Qualifications:

  • 7+ years of professional software engineering experience, with a track record of shipping production-quality full-stack features.
  • Understanding of prompt engineering, fine-tuning models, or deploying AI services in production environments.
  • Experience with designing, implementing, and maintaining RESTful APIs
  • Experience writing production-ready code with emphasis on quality and maintainability
  • Experience with distributed systems or data ingestion
  • Strong computer science fundamentals
  • Committed to working in a communicative, collaborative environment
  • Comfortable navigating ambiguous challenges in a rapidly evolving domain, and excited about staying at the forefront of AI advancements
  • Strong sense of ownership and accountability for delivering impactful solutions
  • Proven ability to work closely with Product and Design teams to define requirements for new features in a fast-paced iterative environment
  • Bonus: Hands-on experience building GenAI features, Agents, and/or working with Large Language Models (LLMs), either through direct model integration or leveraging AI APIs like OpenAI, Google Cloud AI, or AWS Bedrock.

Pay:

Target pay ranges based on Geographic Zones* for Level 4: 

  • Zone 1: San Francisco/Bay Area or NYC Metropolitan Area, Boston, Seattle - $187,000 - $257,000**
  • Zone 2: Irvine, LA, Monterey, Santa Barbara, Santa Rosa, Austin, Portland, Philadelphia, Chicago - $168,000 - $231,000**
  • Zone 3: All other US locations - $158,000 - $218,000**

LaunchDarkly operates from a place of high trust and transparency; we are happy to state the pay range for our open roles to best align with your needs. Exact compensation may vary based on skills, experience, and location.

*Within the United States, our geographic pay zones are defined by counties surrounding major metropolitan areas.
**Restricted Stock Units (RSUs), health, vision, and dental insurance, and mental health benefits in addition to salary.

About LaunchDarkly:

Modern software delivery was supposed to be the foundation for a thriving digital business but reality has proven otherwise. Slow, inefficient development cycles, costly outages, and fragmented customer experiences are preventing developers from building their best software. The LaunchDarkly platform helps developers innovate on new features faster while protecting them with a safety valve to instantly rewind when things go wrong. Developers can target product experiences to any customer segment and maximize the business impact of every feature. And by gradually rolling out new application components, they escape nightmare "big-bang" technology migrations. 

The LaunchDarkly platform was built to guide engineers to the next frontier of DevOps by:

  • Improving the velocity and stability of software releases, without the fear of end customer outages
  • Delivering targeted experiences by easily personalizing features to customer cohorts
  • Maximizing the business impact of every feature through the ability to experiment and optimize
  • Coordinating the release and optimization of software to provide consistent experiences across mobile platforms and device types
  • Improving the effectiveness and productivity of engineering teams, by providing insights into engineering cadence and stability

At LaunchDarkly, we believe in the power of teams. We're building a team that is humble, open, collaborative, respectful and kind. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, veteran status, or disability status. LD invites any applicant to review our written Affirmative Action Plan. To do so, contact People Ops at hr@launchdarkly.com. 

Do you need a disability accommodation?

Fill out this accommodations request form and someone from our People Operations team will contact you for assistance. 

Your safety matters to us. To protect yourself from potential scams, LaunchDarkly recruiters will only contact you from @launchdarkly.com email addresses or via LinkedIn from "Verified Recruiter" accounts. Be cautious of emails from other domains.  Legitimate LaunchDarkly recruiters will never ask for money, fees, or banking information before making a job offer. LaunchDarkly will never make a job offer without conducting a formal interview process. Our interview process does not involve asking detailed questions by email. If you are ever unsure about a communication that you receive, don't click any links—visit Careers | LaunchDarkly  directly for confirmed job openings and links to apply.

Please notify us of any fraudulent representation by sending an email to careers@launchdarkly.com.

How we rate this

Senior Full Stack Engineer, AgentControl at LaunchDarkly rates 71 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Prompt engineeringFine-tuningOpenAIBedrock

Also common in software engineer jobs at this level

Pay

Typical software engineer job
$168k

This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs

Questions you could be asked

  1. How do you structure and test a prompt to get consistent output from a language model?
  2. Walk me through fine-tuning a model: what data did you use, and how did you check the result?
  3. What are the limits of OpenAI that you've run into, and how did you work around them?
  4. What's a project where you used Bedrock hands-on?
  5. Describe a typical day in a role like this one: which parts run through AI directly?

Adapt your resume

  • List these exact terms on your resume: Prompt engineering, Fine-tuning, OpenAI, and Bedrock. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new remote software engineer jobs (Works on AI ●●●○ or higher) by email

One email a week with the new remote software engineer jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at LaunchDarkly

More software engineer jobs

Related searches

Same AI level