Principal Test Framework Software Engineer
Graphcore is hiring a Principal Test Framework Software Engineer in Austin, United States. Level rates it ; you can apply on Graphcore.
Level's read on this job
- Level rates this software engineer role Works on AI ●●●○: the daily work is on AI products, without building the model.
- Tools and skills the posting cites include Python, CI/CD and software engineering.
- Level classifies it as a lead role.
- Level lists 204 other open roles at Graphcore.
- The role was posted in the last few days.
AI in this role
Define and evolve the software architecture used to qualify and validate Graphcore's AI hardware platforms and automated test frameworks.
Graphcore is a leading innovator in artificial intelligence computing. We develop hardware, software, and systems infrastructure designed to support the next generation of AI systems and expand the practical use of AI across industries.
As part of SoftBank Group, Graphcore works alongside companies developing advanced technologies. Our teams bring together hardware, software, systems, and AI expertise to solve complex engineering problems across the computing stack.
The OpportunityAs Principal Test Framework Software Engineer, you will define and evolve the software architecture used to qualify and validate Graphcore's AI hardware platforms. You will combine hands-on software development with Principal-level technical leadership, creating common frameworks that help engineering teams run reliable, repeatable tests across development, system validation, and production environments.
Working within Test Software and Automation, you will translate hardware requirements into maintainable test solutions, improve the speed and quality of validation, and provide clear technical direction across hardware, firmware, systems, product, and manufacturing teams.
What You Will Do- Own the architecture and technical roadmap for shared test automation frameworks used in hardware bring-up, qualification, regression testing, and production validation.
- Design and implement framework components, interfaces, configuration models, and reusable libraries that support multiple hardware platforms and test environments.
- Translate hardware specifications, validation plans, and quality requirements into scalable automated test suites with clear coverage and traceability.
- Establish engineering standards for framework reliability, maintainability, versioning, documentation, observability, and test-result integrity.
- Integrate automated testing with continuous integration and delivery pipelines, source control, lab infrastructure, and test orchestration systems.
- Develop tools and data pipelines that collect, process, analyze, and visualize test results so teams can identify failures, trends, and quality risks.
- Lead complex debugging across test software, operating systems, firmware, hardware, and lab environments, and drive issues to clear technical resolution.
- Improve test execution time, reproducibility, resource use, and validation methods across development and production workflows.
- Partner with hardware, firmware, systems, product, quality, and manufacturing teams to align test coverage with product and business requirements.
- Provide technical guidance, conduct design and code reviews, mentor engineers, and communicate status, risks, tradeoffs, and recommendations to engineering leaders.
- A bachelor's or master's degree in computer science, electrical engineering, computer engineering, or a related field, or equivalent practical experience.
- Substantial professional experience building software for test automation, validation infrastructure, developer tooling, or related systems, including technical leadership at Principal, Staff, or Lead Engineer scope.
- Strong software development skills in Python and proficiency with Bash or comparable scripting languages.
- Demonstrated success designing modular, scalable, and maintainable frameworks, including stable interfaces, reusable components, configuration management, and automated verification.
- Experience with Linux or Unix environments, Git-based development, continuous integration and delivery pipelines, and software engineering practices for production-quality tools.
- Experience working at the boundary between software and hardware, including hardware test, system validation, or embedded platform environments.
- Strong debugging and systems-thinking skills, with the ability to isolate problems across software, firmware, hardware, networks, and lab infrastructure.
- Ability to turn technical specifications and quality goals into measurable coverage, repeatable tests, and actionable results.
- Proven ability to influence cross-functional technical decisions, mentor engineers, and communicate clearly with both technical teams and engineering leadership.
These qualifications are helpful, not required. We encourage you to apply even if you do not meet every preferred qualification.
- Experience with test orchestration, lab management, hardware farms, scheduling systems, or distributed automation infrastructure.
- Background in AI hardware, server platforms, embedded systems, baseboard management controllers, or related low-level environments.
- Experience integrating automated tests with manufacturing, deployment, or product-release workflows.
- Experience developing test-data pipelines, dashboards, or visualization tools for engineering analysis and quality reporting.
- Familiarity with containerized environments, remote execution, or infrastructure-as-code practices used to manage test systems.
Graphcore offers compensation and benefits designed to support employees' health, financial well-being, work-life needs, and professional growth. Benefits and programs for eligible U.S. employees may include:
- Medical, dental, and vision coverage, with options that may extend to eligible dependents.
- Mental health, wellness, and employee assistance resources.
- Retirement savings benefits and company contributions where applicable.
- Paid vacation, sick time, company holidays, and parental or family leave in accordance with applicable plans and policies.
- Life insurance and short-term or long-term disability coverage.
- Flexible working hours and hybrid working arrangements where compatible with the role and team requirements.
- Professional development resources, learning programs, office amenities, and team-led activities.
Benefits vary by work location, employment status, scheduled hours, and plan eligibility and are subject to the terms of the applicable plans and company policies. This overview is not a contract or guarantee of benefits.
Equal Opportunity and AccommodationsGraphcore is an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, creed, sex, pregnancy, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, veteran status, or any other status protected by applicable law.
Graphcore is committed to an inclusive and accessible hiring process. If you need a reasonable accommodation to participate in the application or interview process, please let the recruiting team know.
Candidate PrivacyPersonal information submitted during the recruiting process will be handled in accordance with Graphcore's applicable candidate privacy notices.
How we rate this
Principal Test Framework Software Engineer at Graphcore rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in software engineer jobs at this level
Pay
- Typical software engineer job
- $168k
This posting doesn't list pay. Use the typical software engineer figure when pay comes up. See software engineer jobs
Questions you could be asked
- Tell me about a project where software engineering was part of your work. What did you do?
- Tell me about a project where test automation was part of your work. What did you do?
- Tell me about a project where hardware validation was part of your work. What did you do?
- Tell me about a project where ci/cd was part of your work. What did you do?
- Walk me through how you've used Python in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Software Engineering, Test Automation, Hardware Validation, CI/CD, and Python. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. You get your review by email within 24 hours.
Get new software engineer jobs (Works on AI ●●●○ or higher) by email
One email a week with the new software engineer jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Software Engineering roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step