Skip to content

Amazon

Senior Manager, EC2 Nitro, EC2 Nitro

Amazon is hiring a Senior Manager, EC2 Nitro, EC2 Nitro in Seattle, United States. It pays $220k-$298k a year and Level rates it ; you can apply on Amazon.

Level's read on this job

  • Builds AI ●●●● is how Level rates this role: the job is building AI systems.
  • Tools and skills the posting cites include Linux, C and Rust.
  • Level classifies it as an executive role.
  • Level lists 20,000+ other open roles at Amazon.

AI in this role

Lead engineering organizations building large-scale compute platforms and clusters for heavy AI training and inference workloads.

LinuxCRust
systems-softwaremachine-learning-infrastructurehardware-bringupengineering-management
EC2 Nitro drives the planet's largest, fastest growing, and most feature-rich compute cloud, and EC2 Machine Learning Systems (MLS) is where that platform meets the most demanding AI workloads on Earth. We build and scale the compute platforms behind AWS's largest ML training and inference clusters — integrating custom hardware, firmware, systems software, and services to turn AI accelerators (NVIDIA GB200/GB300/VeraRubin-class UltraServer/UltraCluster) into reliable, high-performance capacity for customers ranging from startups to the largest AI labs in the world.

We are looking for a seasoned engineering leader to own an existing, at-scale ML compute platform and to set and drive its multi-year technical strategy. As a Senior Manager leading a team of 3–5 managers and roughly 40–50 engineers, you will be responsible for the health, velocity, and long-term direction of an organization that spans hardware bring-up, firmware, cluster management, and application software. You will define where the platform needs to be several years out, make the architectural and investment bets that get us there, and build the org — leaders, senior engineers, and mechanisms — capable of delivering it.

In this role, you will operate at the intersection of a broad and deep set of technical teams. You will partner at a senior level with silicon and hardware partners (Annapurna and NVIDIA) to co-design and bring up NVIDIA GB200/GB300 platforms and UltraServer/UltraCluster systems, and with science, ML framework, and other AWS service organizations to remove ambiguity, align roadmaps, and land capabilities that no single team could deliver alone. You will be measured not only on what your organization ships, but on the clarity of the technical strategy you set and your ability to influence direction well beyond your immediate teams.

The ideal candidate:

- Has a deep technical background in systems software — sufficient to earn the trust of senior engineers and make sound architectural and design judgments in a Linux environment involving C, C++, and/or Rust. You will not be writing production code day-to-day, but you must be able to go deep, ask the right questions, and hold a high technical bar.
- Brings strong operational instincts for large-scale software delivery — version control, automated build and release, and software quality practices — and knows how to instill them across an organization.
- Has in-depth knowledge of ML frameworks and cluster management, and understands the workloads and failure modes of large-scale ML training and inference at cluster scale.
- Has a track record of setting multi-year technical strategy, driving org-level execution through other managers, and influencing partners across organizational boundaries.

Basic qualifications

- 10+ years of engineering experience
- 5+ years of engineering team management experience
- 10+ years of planning, designing, developing and delivering consumer software experience
- Experience partnering with product or program management teams
- Experience managing multiple concurrent programs, projects and development teams in an Agile environment

Preferred qualifications

- Experience partnering with product and program management teams
- Experience participating in or leading technical collaborations and creating alignment across diverse groups (e.g., hardware engineering, software engineering, program management)
- Experience hiring, developing and promoting engineering talent

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.



USA, WA, Seattle - 220,100.00 - 297,700.00 USD annually

How we rate this

Senior Manager, EC2 Nitro, EC2 Nitro at Amazon rates 90 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Systems SoftwareMachine Learning InfrastructureHardware BringupEngineering ManagementLinuxCRust

Questions you could be asked

  1. Tell me about a project where systems software was part of your work. What did you do?
  2. Tell me about a project where machine learning infrastructure was part of your work. What did you do?
  3. Tell me about a project where hardware bringup was part of your work. What did you do?
  4. Tell me about a project where engineering management was part of your work. What did you do?
  5. Walk me through how you've used Linux in your day-to-day work.

Adapt your resume

  • List these exact terms on your resume: Systems Software, Machine Learning Infrastructure, Hardware Bringup, Engineering Management, and Linux. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Get your CV reviewed before you apply

Send your CV and the role you want next. Your review arrives by email within 3 days.

Get new AI jobs (Builds AI ●●●●) by email

One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free.

Similar roles

Other roles that build AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Amazon

Related searches

Same AI level

Jobs by city