Software Engineer, Machine Learning-Backend
Fal AI is hiring a Software Engineer, Machine Learning-Backend in San Francisco, United States. It pays $150k-$200k a year and Level rates it ; you can apply on Level.
AI in this role
Build high-performance HTTP proxies and serverless backend infrastructure for 3rd party generative AI model providers.
fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products.
As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on.
About this role:
This role is ideal for engineers who want to be on the forefront of the GenAI media revolution. Utilize your deep experience with backend APIs, robust http client and server design to build high-performance, reliable proxies to our partner model providers.
What you’ll do:
Identify, design, and develop foundational HTTP proxies and fal serverless endpoints for 3rd party model providers
Write clear, well-tested, and maintainable software
Analyze and improve the robustness and scalability of our existing proxies, APIs and fallback infrastructure
Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
Qualifications:
3+ years of demonstrated experience in building HTTP services with Python
Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
Proficiency in version control practices and CI/CD pipelines.
What we offer at fal:
Interesting and challenging work
A lot of learning and growth opportunities
Health, dental, and vision insurance (US)
Regular team events and offsites
U.S. EQUAL EMPLOYMENT OPPORTUNITY INFORMATION:
fal provides equal employment opportunities to applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other classification protected by applicable law.
How we rate this
Software Engineer, Machine Learning-Backend at Fal AI rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.
Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where backend was part of your work. What did you do?
- Tell me about a project where api design was part of your work. What did you do?
- Tell me about a project where inference was part of your work. What did you do?
- Tell me about a project where serverless was part of your work. What did you do?
- Tell me about a project where generative ai was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: Backend, API Design, Inference, Serverless, and Generative AI. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new software engineer jobs (Builds AI ●●●●) by email
One email a week with the new software engineer jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step