Level

Roblox

Senior Software Engineer, Test Frameworks & Tools

Roblox is hiring a Senior Software Engineer, Test Frameworks & Tools in San Mateo, United States. It pays $197k-$243k a year and Level rates it ; you can apply on Roblox.

Level's read on this job

  • Level rates this software engineer role Works on AI ●●●○: the daily work is on AI products, without building the model.
  • Pay on this posting starts 17% higher than the typical software engineer posting on Level.
  • The posting mentions visa sponsorship.
  • The posting mentions test automation, ci cd and infrastructure among its tools and skills.
  • Roblox has 268 other open roles on Level.

AI in this role

Build and scale AI-native test automation infrastructure, frameworks, and orchestration services for Roblox's testing lifecycle.

test-automationci-cdinfrastructureai-test-generationsoftware-engineering

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. 

At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. 

A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

We’re looking for an outstanding engineer to join our Test Frameworks & Tooling team where we design, build and scale tools and services that power the test automation lifecycle of Roblox services.  Our systems span test frameworks, execution, orchestration and debugging, AI test generation, canary analysis. 

You will:

  • Build and scale test automation infrastructure: Design, implement, and evolve the frameworks, runners, orchestration services, workflow integrations, and supporting infrastructure that power reliable testing across Roblox's supported platforms
  • Advance the AI-native test lifecycle: Develop intelligent tooling that improves test authoring, selection, execution, maintenance, and failure triage, using AI to reduce manual effort and make testing more accessible and effective
  • Develop test orchestration and intelligence: Build systems that connect test planning, test selection, execution, and failure analysis, enabling more efficient use of test infrastructure and faster feedback to engineers
  • Improve test reliability and debugging: Build tools and services that improve test stability, observability, failure diagnosis, and maintenance across a large and evolving test ecosystem
  • Shift quality earlier in the development lifecycle: Integrate automated quality checks and actionable test feedback into development and CI/CD workflows to help teams identify and resolve issues earlier
  • Drive projects end to end: Take ownership of technical initiatives from problem definition, design, and implementation through production deployment, adoption, measurement, and continuous improvement
  • Collaborate across engineering: Partner with application, platform, QA, infrastructure, and developer productivity teams to develop scalable solutions that address the needs of engineers across Roblox

You have:

  • 2+ years of experience building large-scale backend or infrastructure systems. An understanding of building systems that operate at high QPS with low-latency requirements is a plus. Experience working on infrastructure or performance-critical backend systems is a plus.
  • Knowledge: You are proficient in one or more programming languages (C#, Go, Python or similar programming language). 
  • Curiosity: You are curious and passionate about solving open-ended problems. You can identify challenges, develop a deep understanding of the systems involved, and drive solutions in collaboration with your team.
  • Strong Teamwork: You are able to collaborate in cross-functional and cross team projects to deliver the most curated technical solution.
  • Nice to have: familiarity with HashiCorp software stack (Nomad, Vault, Consul), infrastructure datacenter ops
  • Long-term Mindset: You are willing to take the long view to drive the collaboration and build the system.

For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits as described on this page.

Annual Salary Range$196,750—$243,290 USD

Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted).

Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process.

For US based roles only, please note the Company may not be able to employ candidates for this role who have United States work authorization related to certain U.S. visa categories, or support future H-1B sponsorship at this time.

How we rate this

Senior Software Engineer, Test Frameworks & Tools at Roblox rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

Test AutomationCI/CDInfrastructureAI Test GenerationSoftware Engineering

Also common in software engineer jobs at this level

Pay

This job starts at
$197k
Typical software engineer job
$168k

This posting starts 17% above the typical software engineer job. See software engineer jobs

Questions you could be asked

  1. Tell me about a project where test automation was part of your work. What did you do?
  2. Tell me about a project where ci/cd was part of your work. What did you do?
  3. Tell me about a project where infrastructure was part of your work. What did you do?
  4. Tell me about a project where ai test generation was part of your work. What did you do?
  5. Tell me about a project where software engineering was part of your work. What did you do?

Adapt your resume

  • List these exact terms on your resume: Test Automation, CI/CD, Infrastructure, AI Test Generation, and Software Engineering. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new software engineer jobs (Works on AI ●●●○ or higher) by email

One email a week with the new software engineer jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Roblox

More software engineer jobs

Related searches

Same AI level

Jobs by city