Senior DevOps Engineer
Encord is hiring a Senior DevOps Engineer in New York, United States. It pays $180k-$230k a year and Level rates it ; you can apply on Level.
Level's read on this job
- Level rates this role Works on AI ●●●○: the daily work is on AI products, without building the model.
- Tools and skills the posting cites include PyTorch, Kubernetes and Google Cloud.
- Level files it as a senior role.
- Level lists 38 other open roles at Encord.
AI in this role
Builds and operates core cloud infrastructure and deployment pipelines for an AI data and model training platform.
About us
Encord is the universal data layer for AI that helps 300+ AI teams train and run models on the right data. Our platform indexes, curates, annotates, and evaluates data across the full AI lifecycle, from development through production.
Trusted by Woven by Toyota, AXA, UiPath, Zipline, and more. We're an ambitious team of 100+ working at the frontier of AI and have raised $60M in Series C funding from Wellington Management, CRV, Next47 and Y Combinator.
The role
We're looking for a Senior DevOps Engineer with 5+ years of experience to join our growing platform engineering team in New York. You'll be embedded in the teams building and operating Encord's core infrastructure, ensuring our platform is performant, reliable, observable, and scalable. You'll drive a culture of automation, performance, and resilience through individual contributions and collaboration with multiple squads.
What You'll Do
CI/CD & Deployment Own and continuously improve deployment pipelines; partner closely with developers to review infrastructure changes, streamline release processes, and champion DevOps best practices across the engineering group.
Infrastructure & Cloud Design, deploy, and maintain cloud infrastructure on GCP and AWS; manage Kubernetes clusters, networking, and storage at petabyte scale, with infrastructure-as-code as the default.
Automation & Tooling Drive developer productivity by building, guiding, and reviewing automation and internal tooling efforts across the engineering group; eliminate manual toil wherever it exists.
Performance & Capacity Profile and optimise services handling large-scale data pipelines; perform capacity planning for storage and compute-intensive workloads. Work with squads to establish performance benchmarks and expectations.
Reliability & Availability Define and own SLIs/SLOs/SLAs for critical services; build alerting, runbooks, and incident response processes; lead postmortems with a blameless culture.
Observability Instrument services with distributed tracing, logging, and metrics (Prometheus, Grafana, OpenTelemetry, GCP Dashboards or similar); build infrastructure, define best practices, and work with each squad to ensure every service is observable before it goes to production.
What We're Looking For
4+ years of hands-on DevOps, platform engineering, or SRE experience in a production environment.
Strong experience building and maintaining CI/CD pipelines and deployment automation at scale.
Proven experience with infrastructure-as-code tools (e.g., Terraform, Pulumi) and configuration management.
Strong fundamentals in designing, building, and maintaining resilient distributed and/or high performance systems.
Hands-on experience with Kubernetes and containerised workloads in cloud environments (GCP and/or AWS).
Solid understanding of networking, operating systems, and database technologies.
Experience with observability fundamentals metrics, logs, traces, and alerting.
Tech stack
We are technology agnostic at Encord and not looking for experience across all of these — as long as you're open to learning, please apply.
Backend: Python
Frontend: TypeScript and React
Deployment: Kubernetes
Infrastructure: GCP
Machine learning: PyTorch, CUDA, Ray
What We Offer
Competitive salary, commission, and meaningful equity in a high-growth start-up
Clear, accelerated growth opportunities as the company scales rapidly
Strong in-person culture: 4 days/week
Flexible PTO to fully recharge
Annual learning & development budget
Comprehensive health, dental, and vision coverage
Frequent travel opportunities across the U.S., London, and Europe
Bi-annual company offsites, twice-weekly team lunches, and monthly socials
Encord offers a unique opportunity to be part of a startup with a clear mission and vision. You will get to explore and build services enterprise AI use cases across many different industry verticals such as healthcare, surveillance, retail, agriculture, and many more.
Our work is at the cutting edge of computer vision and deep learning, which also includes working on solving unsolved problems within those fields.
How we rate this
Senior DevOps Engineer at Encord rates 75 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Walk me through a computer vision problem you solved, from raw data to a deployed model.
- Tell me about a project where devops was part of your work. What did you do?
- Tell me about a project where ci cd was part of your work. What did you do?
- Tell me about a project where infrastructure as code was part of your work. What did you do?
- Tell me about a project where sre was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: Computer vision, Devops, Ci Cd, Infrastructure As Code, and Sre. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new software engineering jobs (Works on AI ●●●○ or higher) by email
One email a week with the new software engineering jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step