AI Infrastructure Hardware Engineer
Pragmatike is hiring an AI Infrastructure Hardware Engineer. Level rates it ; you can apply on Pragmatike.
Level's read on this job
- Level rates this role Builds AI ●●●●: the job is building AI systems.
- Tools and skills the posting cites include Linux, CUDA and Nccl.
- Level classifies it as a senior role.
- Level lists 51 other open roles at Pragmatike.
AI in this role
Validate, test, and ensure quality control for GPU and HPC server hardware powering vertically integrated AI cloud infrastructure.
Job Description
Location: Hong Kong — Hybrid (factory floor, test lab and manufacturing sites; this is not a remote or desk-based role)
Start date: ASAP
Languages: Fluent English and fluent Mandarin are both mandatory
Industry: HPC / GPU Server Manufacturing / Sovereign Cloud Infrastructure
Pragmatike is recruiting on behalf of a European deep-tech company building a sovereign, energy-efficient alternative to traditional cloud providers. Unlike most cloud players, our client designs and manufactures its own HPC infrastructure end to end — chassis, boards and containerized units — and deploys it as the hardware layer of a vertically integrated AI cloud. The company is growing fast and is expanding its manufacturing and testing capability in Hong Kong.
Professional Background:
We're looking for a Server Engineer with hands-on GPU/HPC hardware experience who has tested and validated servers, not just operated them. You should be comfortable moving between the factory floor and the test lab, with a strong Linux background and real familiarity with firmware and GPU software stacks (CUDA, NCCL). You take ownership of quality: if a server ships, it is because you signed off on it.
Startup or hyper-growth experience is a strong plus. Autonomy, rigor and problem-solving are essential.
Your Responsibilities:
Own quality control across the client's manufacturing sites, on the factory floor.
Run the hardware test lab: board and system bring-up, validation and stress testing of new server builds.
Oversee the assembly and end-to-end testing of GPU servers before they are deployed into the client's sovereign cloud.
Define and maintain test procedures, acceptance criteria and QC checkpoints for chassis, boards and full systems.
Diagnose hardware, firmware and driver-level issues (BIOS/BMC, GPU firmware, PCIe, thermals, power) and drive root-cause analysis with the design and manufacturing teams.
Validate GPU compute and interconnect performance under Linux using CUDA, NCCL and related benchmarking tools.
Document failures, yields and test results, and feed findings back into hardware design and production processes.
Coordinate day to day with manufacturing partners and local suppliers in both English and Mandarin.
What You Bring:
Proven hands-on experience testing and validating GPU/HPC servers (bring-up, burn-in, validation), not only using them.
Strong Linux skills at the system and hardware level.
Firmware knowledge: BIOS/UEFI, BMC/IPMI, GPU and NIC firmware, flashing and troubleshooting.
Working knowledge of the NVIDIA GPU stack: drivers, CUDA, NCCL, and how to benchmark and diagnose multi-GPU systems.
Solid understanding of server hardware: motherboards, PCIe topology, power, cooling, storage and networking components.
Experience with QC or manufacturing test processes in a hardware production environment.
Fluent English and fluent Mandarin (both non-negotiable).
Willingness to work on-site in Hong Kong, on the factory floor and in the lab.
Nice To Have:
Experience with containerized or micro-datacenter deployments (power, thermal and environmental constraints).
Familiarity with high-speed interconnects (InfiniBand, RoCE, NVLink) and their validation.
Scripting skills (Bash/Python) to automate test sequences and reporting.
Exposure to hardware supply chains or contract manufacturers in Hong Kong / Southern China.
Cantonese.
Why Join Us:
Our client is one of the very few cloud companies that builds its own hardware from the board up. Their mission is to deliver a sovereign, energy-efficient, high-performance alternative to traditional cloud providers, and the servers you test and validate are the physical foundation of that platform.
Expect real ownership from day one, a fast-paced environment that values autonomy and problem-solving, and the chance to build something that doesn't exist yet.
Pragmatike• is dedicated to a fair, transparent, and inclusive recruitment process. We ensure that no applicant is discriminated against based on age, disability, gender, gender identity or expression, marital or civil partner status, pregnancy or maternity, race, religion or belief, sex, or sexual orientation. In accordance with the General Data Protection Regulation (GDPR), your personal data will be processed lawfully, fairly, and securely. We collect and use your personal data solely for recruitment purposes, including sharing it with our client(s) for employment consideration. You have the right to request access, correction, or deletion of your data at any time. We are committed to maintaining the confidentiality and security of your information throughout the recruitment process.
How we rate this
AI Infrastructure Hardware Engineer at Pragmatike rates 85 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- Tell me about a project where hardware validation was part of your work. What did you do?
- Tell me about a project where gpu servers was part of your work. What did you do?
- Tell me about a project where hpc was part of your work. What did you do?
- Tell me about a project where quality control was part of your work. What did you do?
- Tell me about a project where firmware was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: Hardware Validation, GPU Servers, Hpc, Quality Control, and Firmware. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. You get your review by email within 24 hours.
Get new software engineering jobs (Builds AI ●●●●) by email
One email a week with the new software engineering jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step