Support Engineer (DevTools & AI Reliability, remote)
Checkly is hiring a Support Engineer (DevTools & AI Reliability, remote) for a remote role open to applicants in United States. It pays $43k-$87k a year and Level rates it ; you can apply on Checkly.
Level's read on this job
- On Level's scale, this role is Works on AI ●●●○: the daily work is on AI products, without building the model.
- The posting lists this role as remote.
- Tools and skills the posting cites include Claude, Mistral and Cursor.
- Level lists 1 other open role at Checkly.
- The role was posted in the last few days.
AI in this role
Resolve developer customer issues and help optimize internal and external AI support processes at a remote DevTools startup.
(Remote, US East Coast or the same time zone. Series B. DevTools SaaS. Synthetic monitoring. 40h/week)
The best developers don’t wait for a customer to tell them something’s broken.
They catch it first, in the pull request, in staging, or in the checkout flow at 3am, before a single user notices. That instinct is Checkly’s whole reason to exist. Now that agents write and ship more and more code, they can carry that instinct too. Agents write, run, and maintain the monitoring setup that guards production, while developers stay in control. Everything is defined as code, powered by OpenTelemetry and Playwright, and versioned and reviewed like everything else that ships. From pull request to post-mortem, in one place.
AI agents are shipping more code than any team can review, and reliability is lagging behind. Checkly closes this gap. As a Support Engineer, you’ll support our most valuable customers, from modern AI companies like Mistral and resolve.ai to large engineering orgs like LinkedIn, Citi, and 1Password on that journey.
In 2024 we raised $20M in Series B funding from Balderton, CRV and Accel. We’re a remote-first startup that is low on meetings, high on productivity, and always shipping. If you love actually listening to and working with customers, working async, and keeping it lean, you’ll fit right in!
We care about building a team where people of all backgrounds are encouraged to do their best work. To achieve this we built a flexible and async-first startup environment with inclusive benefits and full transparency about how we pay.
What you’ll doSupport has always been about solving real problems for real people. What’s changing at Checkly is how we do it: AI lets us automate routine work and assist us with troubleshooting, so we can go deeper on hard cases and bring what customers tell us straight back to the product. Here’s where you come in:
Resolve customer issues. Debug Playwright tests (flaky selectors, timeouts, auth flows). Dig into API check failures with packet captures (PCAPs), traceroutes and timing breakdowns. Set up single sign-on (SSO) and SAML. When it’s a bug, bring engineering a clean reproduction, or open the pull request (PR) yourself.
Build an outstanding AI support process. Our internal and external support agents already resolve 80% of tickets. You’ll help lift the bar: what the agent answers, when it hands off to a human, and how good those answers are.
Turn tickets into product. Spot patterns across customers and bring product and engineering a reproduction. Your work becomes bug fixes and features.
Own the docs. If you’ve answered something twice, it belongs in the docs and in the agent, so customers and AI get the same right answer.
Work with modern tooling. We are continuously updating our workbench, and you’ll have modern tools like Plain, Linear, and Mintlify.
This won't be the right role if you...
Want a clear process for every situation before you act.
Would rather code all day than talk to customers.
See AI tools as something you’ll get around to eventually.
Want the structure and pace of a large company.
You will often speak with developers who need assistance understanding if their applications work well and if not, what caused the issue. This requires a solid technical background and a genuine motivation to help and learn.
Empathy: You love working with customers and solving their problems. Checkly is critical to them, and we genuinely want to unblock them.
Some experience in a technical role, for example, as a developer or in technical support.
You can read and debug JavaScript, TypeScript and Node.js code.
You’re comfortable with HTTP, REST APIs, browser dev tools, git and CI/CD practices.
AI is already how you work. Claude Code, Codex, Cursor or similar are part of your day. You’ve built your own workflows.
You write and speak clear, friendly English.
You can run your own day remotely and still enjoy working with your team.
You're based on the US East Coast or the same time zone.
Transparent salary because your salary shouldn't be dictated by how good a negotiator you are. (more info below)
Async-first (low meeting, high productivity) and transparent culture
Stock options
Flexible paid vacation
Paid sick leave & up to 14 weeks of paid parental leave
US: Medical, Dental, Vision, FSA, long- and short-term disability, life insurance, 401(k) and more
Annual company off-site
Find out more here.
What we payFair, competitive, and transparent pay is very important for us. Therefore we work with a standardized salary calculator that includes several factors such as seniority level as well as location.
For this role, the range is
$57,500 - $70,000 for someone in the US
$71,910 - $87,000 for someone in US Tier 1 locations like NYC, Boston
$43,000 - $52,000 for someone in e.g. South America
If this sounds interesting, please apply! Studies by several different sources have shown that on average men will apply for a job if they meet 60% of the application requirements. Women, non-binary people and POC will seek to match a much higher percentage of requirements before applying. If you're not sure you're the right fit, apply anyway and let us know what you bring to the table. We'd love to hear from you!
We're all about being transparent and setting clear expectations. That's why we've put together our hiring playbook and open-sourced our employee handbook. There you'll find a sneak peek of who we are, how we work and what you can expect in our hiring process.
How we rate this
Support Engineer (DevTools & AI Reliability, remote) at Checkly rates 60 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Tell me about a project where customer support was part of your work. What did you do?
- Tell me about a project where debugging was part of your work. What did you do?
- Tell me about a project where api troubleshooting was part of your work. What did you do?
- Tell me about a project where sso saml was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: AI agents, Customer Support, Debugging, API Troubleshooting, and Sso Saml. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new remote software engineering jobs (Works on AI ●●●○ or higher) by email
One email a week with the new remote software engineering jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step