Level

Together AI

Senior Software Engineer, Customer Insights

Together AI is hiring a Senior Software Engineer, Customer Insights in San Francisco, United States. It pays $180k-$250k a year and Level rates it ; you can apply on Together AI.

Level's read on this job

  • Works on AI ●●●○ is how Level rates this software engineer role: the daily work is on AI products, without building the model.
  • Pay on this posting starts 7% higher than the typical software engineer posting on Level.
  • The posting mentions Cursor, Elevenlabs and Decagon among its tools and skills.
  • Level classes it as a senior role.
  • Together AI has 83 other open roles on Level.

AI in this role

Senior Software Engineer for Customer Insights to build visibility layers, anomaly tracing, and agent tooling.

cursorelevenlabsdecagon
ai-agentsfine-tuningdistributed-systemsdata-pipelinesbackendstream-processing

About the Role

Together.ai is looking for a Senior Software Engineer to join the Customer Insights team. Customer Insights owns the customer-facing visibility layer of Together's Cloud — the systems that help customers understand what's happening in their environment, trace back what happened and why, and act on it with confidence.

Every time a customer needs to understand their own activity — what happened, who did it, when, and whether it needs attention — they rely on the systems we build. Whether it's a developer inspecting recent activity, an enterprise team auditing their organization, or an operator diagnosing an anomaly, we make that visibility clear and trustworthy: simple for everyday cases, robust enough for complex organizational needs. We're turning today's fragmented visibility patterns into coherent product and platform foundations, and building toward a next generation of insight tooling that summarizes activity, explains anomalies, and correlates signals across surfaces — for both human operators and autonomous agents.

You'll take ambiguous problems and turn them into a clear technical direction. You'll set the technical approach for significant pieces of the system, weigh in on architecture beyond your immediate area, and help less experienced engineers navigate unfamiliar problem spaces. You'll have real autonomy over how problems get solved, paired with a team that reviews, debates, and learns in the open.

Responsibilities

  • Design and ship core features of Together's Customer Insights platform — the systems customers rely on to see, trace, and act on their own activity.
  • Drive the technical design for new capabilities, including proposing architecture, writing design docs, and getting buy-in across teams.
  • Partner with Data Platform and Observability engineering teams to leverage Together’s core data stack and capabilities to build out Customers Insights data collection and stream processing systems.
  • Own significant areas of the system end-to-end — from design through implementation, testing, rollout, and long-term health.
  • Write and maintain critical-path backend and product code used by multiple teams and customer-facing surfaces. Identify risks and blockers early, drive resolution across team boundaries.

Requirements

  • 4+ years building and operating production distributed systems or customer-facing backend platforms.
  • Experience designing and scaling data pipelines for high-volume ingestion and real-time querying specifically (the "at scale" specialization, distinct from #1's general systems experience).
  • Strong programming skills in one or more of Go, Python, Java,TypeScript, C++, or similar production languages.
  • Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
  • Strong data modeling instincts — comfort working with schemas, queries, and relational and/or non-relational data at scale.
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience.

 

Nice to Have

  • Interest in, or some exposure to, stream processing, data pipelines, notification systems, or analytical systems (this is a great team to learn them on)

About Together AI

Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $180k - 250k + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy.  

 

How we rate this

Senior Software Engineer, Customer Insights at Together AI rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

AI agentsFine-tuningDistributed SystemsData PipelinesBackendStream ProcessingCursorElevenlabs

Also common in software engineer jobs at this level

Pay

This job starts at
$180k
Typical software engineer job
$168k

This posting starts 7% above the typical software engineer job. See software engineer jobs

Questions you could be asked

  1. How do you decide when an AI agent can act on its own versus asking for approval first?
  2. Walk me through fine-tuning a model: what data did you use, and how did you check the result?
  3. Tell me about a project where distributed systems was part of your work. What did you do?
  4. Tell me about a project where data pipelines was part of your work. What did you do?
  5. Tell me about a project where backend was part of your work. What did you do?

Adapt your resume

  • List these exact terms on your resume: AI agents, Fine-tuning, Distributed Systems, Data Pipelines, and Backend. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new software engineer jobs (Works on AI ●●●○ or higher) by email

One email a week with the new software engineer jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Together AI

More software engineer jobs

Related searches

Same AI level

Jobs by city