# Japan Chief Architect at SambaNova Systems

SambaNova Systems is hiring a Japan Chief Architect. It pays JPY 39900k a year and Level rates it Builds AI ●●●●; you can [apply on SambaNova Systems](https://jobsbylevel.com/go/838779fd-2c1c-46c4-9b04-71e7575fd7ec?utm_medium=ai-agent).

AI Level 4, AI centrality 87 out of 100. Tokyo Prefecture, Japan.

## Details

- Company: [SambaNova Systems](https://jobsbylevel.com/companies/sambanova-systems)
- AI level: AI Level 4 (score 87 out of 100)
- Location: Tokyo Prefecture, Japan
- Salary: JPY 39900k
- Posted: November 20, 2026
- Apply: https://jobsbylevel.com/go/838779fd-2c1c-46c4-9b04-71e7575fd7ec?utm_medium=ai-agent
- Free CV review for this job: https://jobsbylevel.com/cv-review?job=japan-chief-architect-at-sambanova-systems-8ab9b3

## Description

SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) — a chip built on a dataflow architecture rather than the traditional GPU model. Its decode performance is especially strong for agentic workloads like multi-turn agents, code generation, and long-running applications. RDUs are packaged into SambaRack, rack-scale hardware that lets customers deploy state-of-the-art models with better performance, greater energy efficiency, and faster time to value. We are building a next-generation AI inference accelerator and the rack-scale system around it, in Japan, on a leading-edge domestic 2nm process. The work is funded through a multi-year national programme to establish sovereign AI infrastructure, and runs from architecture definition through test silicon, full chip tape-out, and deployment of production racks. We are looking for the architect who will define the chip and technically lead the team that builds it, working with the US HQ engineering team. You will decide how compute, memory and interconnect are balanced for large language model inference, and what the hardware exposes to the compiler and runtime. You understand the software stack as well as the silicon, and you stay with the architecture through RTL, verification and physical implementation until it works in silicon. What you will own The chip architecture and microarchitecture specification for a reconfigurable dataflow accelerator: tile architecture, on-chip network, memory hierarchy, and the execution model that maps AI workloads onto them. The hardware and software interface: the programming model, control interfaces, and the assumptions the compiler and runtime are allowed to make about the hardware. Technical leadership of the implementation, from architecture through RTL, verification and physical design, to tape-out and silicon correlation. Responsibilities Architecture definition Define the chip and system architecture against inference performance requirements: tokens per second per user, aggregate throughput, and tokens per second per watt. Use performance models and architectural simulations to decide trade-offs, and keep them calibrated against measured silicon as it becomes available. Make the balance calls across compute capability, memory bandwidth and interconnect bandwidth, and defend each one with data. Hardware and software co-design Work directly with compiler, runtime and model optimization engineers so that the architecture is one the software stack can actually exploit. Own the interfaces that software depends on: mapping, scheduling, memory allocation, synchronization, power, and scale-up and scale-out networks. Analyse real LLM workloads (attention, KV cache, quantized and low-precision arithmetic, batching) on the architecture, and feed the results back into both the hardware and the software. Technical leadership of implementation Lead the team technically from specification to tape-out: microarchitecture specs, RTL design reviews, block interfaces, clocking, reset and power domains. Set verification goals with the verification lead, and ensure performance correlation between the architectural model and the RTL. Assess physical feasibility early and keep the design within it: area and timing budgets, floorplan partitioning, power, thermal limits, and die and package size. Lead technical design reviews at each integration milestone, and give the technical sign-off for tape-out. Support silicon bring-up, correlate measured silicon against the models, and carry the lessons into the next generation. Mentor architects and designers in Japan, and act as the technical counterpart to US HQ architecture so that the two teams build one architecture. Present the architecture in technical reviews with programme sponsors, the foundry, and IP and system partners. Minimum qualifications 20 or more

The description is cut here. Read the full offer: https://jobsbylevel.com/jobs/japan-chief-architect-at-sambanova-systems-8ab9b3

Source: https://jobsbylevel.com/jobs/japan-chief-architect-at-sambanova-systems-8ab9b3

## Cite this page

Level. https://jobsbylevel.com/jobs/japan-chief-architect-at-sambanova-systems-8ab9b3.

Get job alerts: https://jobsbylevel.com/newsletter
