JobgetherRemote · Canada
1h ago
AmazonPosted 2d ago
L4
Machine Learning Performance Engineer, Annapurna Labs
Machine Learning Performance Engineer, Annapurna Labs at Amazon scores 90 out of 100 on AI centrality, which makes it a Level 4 role on this board.
IL, Tel Avivseniorfull-time
AI in this role
Profile and optimize deep learning workloads and build high-performance kernels for custom AWS AI accelerators.
pytorchtensorflowjaxaws-neuroninferentiatrainium
performance-engineeringmachine-learningcompiler-optimizationkernel-developmentprofiling
We are building the first Neuron performance engineering team in Tel Aviv. As a Machine Learning Performance Engineer, you'll help shape the direction of this team from the ground up — profiling and optimizing workloads across the full ML software stack, writing high-performance kernels, and improving the Neuron SDK that external developers depend on. You'll work at the boundary between software and hardware, collaborating directly with compiler, runtime, and chip design engineers to close performance gaps customers care about.
The team is new and small, which means broad scope, direct ownership, and real influence over the technical direction we take. If you enjoy digging into performance bottlenecks and turning analysis into measurable wins, this role is for you.
Key job responsibilities
Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models.
Profile ML workloads end-to-end to identify bottlenecks — memory, compute, or communication — and drive optimizations through to a measured improvement.
Enhance the programming model and tooling that kernel and model developers rely on, improving usability and debugging workflows.
Identify and drive optimization opportunities across the Neuron software stack (compiler, runtime, frameworks).
Document software designs, operational runbooks, and performance findings so the broader team can build on your work.
A day in the life
You might start your morning reviewing profiling data from a customer's large diffusion model training job, tracing a utilization gap back to a specific kernel. After a design discussion with compiler engineers about a new operator fusion strategy, you spend the afternoon writing and benchmarking a kernel prototype. Later, you review a teammate's pull request for a runtime optimization and share your findings in a short write-up for the broader Neuron organization. Your work directly translates into faster model execution and lower cost for AWS customers running ML workloads at scale.
About the team
The Neuron Performance Engineering team in Tel Aviv is part of Annapurna Labs within AWS. Our mission is to make sure every ML workload running on Inferentia and Trainium chips reaches its full performance potential. We partner closely with compiler, framework, and hardware teams across Annapurna Labs, and we work directly with AWS customers to understand their models and unblock their adoption.
We are a newly formed group which is part of the larger Neuron organization. If you want to shape a team's technical culture from its earliest days while working on problems that matter to the future of AI infrastructure, we'd love to hear from you.
Basic qualifications
- 3+ years of non-internship professional software development experience
- Knowledge of Python and/or C++ programming
- Knowledge of computer architecture, operating systems, and parallel computing
- Experience with PyTorch, TensorFlow, and/or JAX
Preferred qualifications
- Master's degree in Computer Science, Engineering, Mathematics, or a related field
- Experience optimizing performance for LLM, Vision, or other deep-learning models
- Experience with kernel writing or parallel programming (CUDA, Triton, CUTLASS, Pallas, Mojo, SIMD, MPI)
- Experience with compiler optimization or hardware-software co-design
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Performance EngineeringMachine LearningCompiler OptimizationKernel DevelopmentProfilingPyTorchTensorFlowJax
Questions you could be asked
- Tell me about a project where performance engineering was part of your work. What did you do?
- Tell me about a project where machine learning was part of your work. What did you do?
- Tell me about a project where compiler optimization was part of your work. What did you do?
- Tell me about a project where kernel development was part of your work. What did you do?
- Tell me about a project where profiling was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: Performance Engineering, Machine Learning, Compiler Optimization, Kernel Development, and Profiling. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.
Want your resume actually rewritten for this job?
The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.
Similar roles
Data roles rated Level 4 at other companies.