Senior Network Engineer

Together AI is hiring a Senior Network Engineer in San Francisco, United States. It pays $190k-$280k a year and Level rates it ; you can apply on Together AI.

Level's read on this job

Level rates this role Builds AI ●●●●: the job is building AI systems.
The posting mentions Cursor, Elevenlabs and Decagon among its tools and skills.
Level classes it as a senior role.
Together AI has 83 other open roles on Level.

AI in this role

Design and operate global network infrastructure supporting high-performance AI compute environments and production services at Together AI.

cursorelevenlabsdecagonlinuxkuberneteswiresharktcpdumpmtrcurlnmappythonansible+7

fine-tuningnetworkingbgpospfvxlanevpnrdmaroceinfinibandci-cd

About the Role

Together AI is looking for a Senior Network Engineer to design, deploy, and operate the global network infrastructure supporting our production services and high-performance AI compute environments.

This is a hands-on engineering role for someone with deep networking expertise who can also troubleshoot across Linux, Kubernetes, automation, and application boundaries. You will work on large-scale, multi-vendor data center networks and help ensure they remain highly available, reliable, scalable, and performant.

The ideal candidate has strong networking fundamentals, experience operating complex networks at scale, and a structured, evidence-based approach to troubleshooting. You should be comfortable owning problems from initial investigation through root cause and resolution, including situations where the issue may extend beyond the network itself.

Requirements

8+ years of professional experience designing, building, and supporting large-scale production data center, cloud, service-provider, or high-performance computing networks (excluding enterprise networks).
Deep understanding of TCP/IP and strong experience with technologies such as BGP, OSPF, VXLAN, EVPN, ECMP, and QoS.
Experience designing and supporting multi-tenant network environments using technologies such as VRFs, VLANs, overlays, and policy-based segmentation.
Hands-on experience deploying and troubleshooting network platforms from vendors such as Arista, Cisco, Juniper, and NVIDIA.
Strong troubleshooting skills using tools such as Wireshark, tcpdump, MTR, curl, nmap, and standard Linux networking utilities.
Ability to diagnose connectivity, latency, packet-loss, routing, and performance issues across the network, host, and application layers.
Experience developing or maintaining network automation using Python, Ansible, or similar tools.
Experience working through a Git-based software development lifecycle, including branching, code review, validation, linting, testing, CI/CD, deployment, and rollback.
Working knowledge of Kubernetes networking, including pods, services, CNIs, and basic connectivity troubleshooting.
Foundational knowledge of RDMA networking and technologies such as RoCE or InfiniBand.
Experience with cloud networking in AWS, GCP, or Azure.
Strong Linux administration and troubleshooting skills.

Responsibilities

Design, deploy, operate, and maintain global, multi-vendor, multi-protocol networks supporting high-performance AI compute infrastructure.
Troubleshoot complex network and application-connectivity issues, identify root causes, and drive problems through resolution.
Analyze telemetry, packet captures, logs, and performance data to identify network degradation, congestion, packet loss, and capacity constraints.
Participate in architecture and design reviews to ensure solutions meet requirements for performance, availability, scalability, security, and operational supportability.
Develop and maintain automation, validation, and operational tooling that improves network reliability and reduces manual effort.
Evaluate network hardware, software, optics, and emerging technologies for use in production environments.
Establish standards and operational best practices for network design, deployment, monitoring, change management, and incident response.
Lead projects addressing complex technical challenges and contribute directly to the network engineering roadmap.
Partner with infrastructure, systems, security, and application teams to troubleshoot issues that cross traditional ownership boundaries.

Preferred

Hands-on experience deploying or operating RoCE and/or InfiniBand fabrics.
Experience supporting GPU clusters, HPC environments, distributed storage, or other high-bandwidth and latency-sensitive workloads.
Understanding of AI training and inference traffic patterns and the demands they place on network infrastructure.
Experience operating networks spanning thousands of devices, multiple data centers, and multiple geographic regions.
Familiarity with AI-assisted engineering tools and the ability to validate, test, and safely deploy AI-generated automation or code.

About Together AI

Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $190,000 - $280,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

How we rate this

Senior Network Engineer at Together AI rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.

Classification

Builds AI. The job is building AI systems.

●●●● Builds AI80 to 100
●●●○ Works on AI60 to 79
●●○○ Uses AI40 to 59
●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Key facts

Senior Network Engineer is an open job at Together AI.
Level rates this role AI Level 4 of 4: Builds AI.
The listed salary is $190k-$280k a year.
The role is based in San Francisco.
The job was posted on July 7, 2026.
Seniority: senior.
Applications are handled by Together AI. Apply on Together AI

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Fine-tuningNetworkingBgpOspfVxlanEvpnRdmaRoce

Questions you could be asked

Walk me through fine-tuning a model: what data did you use, and how did you check the result?
Tell me about a project where networking was part of your work. What did you do?
Tell me about a project where bgp was part of your work. What did you do?
Tell me about a project where ospf was part of your work. What did you do?
Tell me about a project where vxlan was part of your work. What did you do?

Adapt your resume

List these exact terms on your resume: Fine-tuning, Networking, Bgp, Ospf, and Vxlan. An applicant tracking system matches the wording, not the idea.
Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get a free CV review Get an express CV review Check your resume with the ATS resume checker

Get new software engineering jobs (Builds AI ●●●●) by email

One email a week with the new software engineering jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.