Senior Software Engineer, AI Platform - Prism
SoFi is hiring a Senior Software Engineer, AI Platform - Prism in San Francisco and Seattle, United States. Level rates it ; you can apply on SoFi.
Level's read on this job
- Builds AI ●●●● is how Level rates this software engineer role: the job is building AI systems.
- The posting mentions Python, Kubernetes and prompt engineering among its tools and skills.
- Level classes it as a senior role.
- SoFi has 45 other open roles on Level.
- Posted in the last few days.
AI in this role
Senior Software Engineer to build and operate Prism, an internal AI platform for knowledge work and microservices.
Employee Applicant Privacy Notice
Who we are:
Shape a brighter financial future with us.
Together with our members, we’re changing the way people think about and interact with personal finance.
We’re a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an unprecedented transformation, and we’re at the forefront. We’re proud to come to work every day knowing that what we do has a direct impact on people’s lives, with our core values guiding us every step of the way. Join us to invest in yourself, your career, and the financial world.
The role:
As a Senior Software Engineer (IC3) on SoFi’s Prism team, you’ll help build Prism, SoFi’s internal AI platform for knowledge work. Prism connects employees with the AI models, business context, and tools they need to solve important problems more effectively. It also creates a continuous learning loop by capturing what works—and what doesn’t—so our workflows improve over time and employees can deliver better results faster.
In this role, you will pair hands-on software development with systems thinking. You will take technical ownership over feature delivery and key service components—translating partially defined technical problems into production-grade, highly available microservices. You will collaborate closely with partner teams (such as Autonomous Coding, CI/CD, and product squads), practice operational rigor, and use AI-assisted engineering tools responsibly to raise quality and delivery velocity across our engineering community.
What you’ll do:
- Design, implement, test, deploy, and operate foundational components of Prism and contribute to the underlying components.
- Build and maintain telemetry, usage instrumentation, and reporting pipelines to provide clear visibility into Prism and the learning feedback loop.
- Lead technical feature execution for assigned platform work streams, breaking down complex tasks to parallelize implementation with teammates and aligning dependencies with product and engineering managers.
- Participate actively in technical design reviews, reasoning through architectural trade-offs (such as latency, fault tolerance, concurrency, and security) and documenting clear technical specifications.
- Contribute to team engineering quality by following and refining coding conventions, automated testing patterns, and reusable service templates.
- Drive operational excellence by automating test and deployment workflows, participating in on-call service ownership, acting as an incident resolver, and implementing post-incident remediations to prevent recurrence.
- Engage directly with internal customers to understand their day-to-day workflows, support adoption of Prism, and incorporate feedback into iterative system improvements.
- Mentor early-career engineers through thoughtful code reviews, constructive design feedback, and pair programming to foster continuous team growth.
What you’ll need:
- Education & Minimum Experience Requirements: Bachelor’s Degree + 2–3 Years of Experience OR Master’s Degree + 2 Years of programming experience in software engineering, computer science, or a related field.
- Proven programming proficiency in at least one modern backend language (such as Java, Kotlin, Python, Go, or Scala).
- Solid experience building and operating distributed backend services in a microservices or cloud environment, with an understanding of concurrency, fault tolerance, idempotence, and API design.
- Practical experience working with relational databases, persistent data stores, and data modeling concepts.
- Practical understanding of operational excellence: logging, metrics, distributed tracing, automated unit/integration testing, and safe production deployment practices (canarying, feature flags).
- Hands-on experience developing with or integrating AI-assisted developer tools, LLM APIs, prompt engineering patterns, or tool-execution frameworks.
- Collaborative approach with clear written and verbal communication skills, including the ability to write structured technical design documents and share constructive code review feedback.
AI-Assisted Engineering Expectations:
- Use AI tools responsibly to prototype solutions, navigate codebases, and accelerate implementation velocity while upholding high security and safety standards.
- Critically inspect and validate AI-generated code, backing all implementations with comprehensive automated tests to ensure long-term maintainability.
- Maintain rigorous compliance with data governance and security policies, ensuring sensitive member data and proprietary assets are never exposed to unapproved tools.
- Elevate team productivity by sharing effective harnesses, prompt templates, and operational guardrails.
Nice to have:
- Experience engineering internal developer platforms (IDP), developer tooling, or CLI workflows.
- Familiarity with container orchestration (Docker, Kubernetes) and modern CI/CD pipeline automation.
- Experience in fintech or within another highly regulated industry environment.
- Deep understanding of LLM integration, context retrieval architectures (RAG), and AI evaluation frameworks.
How we rate this
Senior Software Engineer, AI Platform - Prism at SoFi rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in software engineer jobs at this level
Pay
- Typical software engineer job
- $167k
This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs
Questions you could be asked
- How do you structure and test a prompt to get consistent output from a language model?
- How would you design a retrieval step so the model answers from real data instead of guessing?
- How have you integrated a large language model into a production application?
- How do you decide that one model's output is better than another's for a given task?
- Tell me about a project where software engineering was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: Prompt engineering, RAG, LLM Integration, AI Evaluation, and Software Engineering. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Get your CV reviewed before you apply
Send your CV and the role you want next. Your review arrives by email within 3 days.
Get new software engineer jobs (Builds AI ●●●●) by email
One email a week, each job rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step