Level

Cognition

QA Engineer - APAC

Cognition is hiring a QA Engineer - APAC for a remote role open to applicants in India. Level rates it ; you can apply on Cognition.

Level's read on this job

  • Level rates this role Works on AI ●●●○: the daily work is on AI products, without building the model.
  • This is listed as a remote role.
  • The posting mentions Copilot, Cursor and Windsurf among its tools and skills.
  • Level classes it as a senior role.
  • Cognition has 104 other open roles on Level.

AI in this role

copilotcursorwindsurfdevin

We are an applied AI lab building end-to-end software agents.

We're the makers of Devin, the first AI software engineer.

Our team is extremely talent-dense. Among our founding team, we have world-class competitive programmers, former founders, and leaders from companies at the cutting edge of AI including Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub, Modal, Google DeepMind, and Nuro.

Building Devin is just the first step—our hardest challenges still lie ahead. If you’re excited to solve some of the world’s biggest problems and build AI that can reason on real-world tasks, apply to join us.

About the Role

Key Responsibilities

  • Own end-to-end product quality across AI workflows: Test Windsurf and Devin across onboarding flows, chat interactions, multi-file edits, agentic task execution, and autonomous workflows—thinking like a developer and testing like a user.

  • Design and execute comprehensive test strategies: Build and run functional, regression, integration, exploratory, and E2E test plans across product surfaces and releases.

  • Break down complex flows into testable scenarios: Identify edge cases, race conditions, state recovery failures, and real-world usage patterns that only emerge in production-like behavior.

  • Issue reproduction, documentation, and debugging: Reproduce, document, and debug issues across layers—distinguishing between UI defects, orchestration/system issues, and unexpected AI behavior; work with engineering and product to drive resolution.

  • Release readiness and quality bar ownership: Partner with engineering and product to define “done,” set quality standards, and ensure releases meet the expectations of real developers.

  • Build scalable QA processes and automation: Establish QA playbooks, test processes, and automation where it has leverage; help evolve CI/CD and testing practices as the product scales.

Qualifications

Must-Have

  • 5+ years of QA/Test Engineering experience testing complex product workflows (multi-step user journeys, cross-surface interactions, and E2E behavior).

  • Deep expertise in functional, regression, exploratory, integration, and end-to-end testing methodologies.

  • Strong developer mindset: comfortable reading/writing code (Python, TypeScript, or similar), navigating codebases, and reasoning about systems.

  • User-first testing approach: you test from the perspective of real users, not just against a spec.

  • Exceptional attention to detail and strong debugging instincts; able to communicate clearly and precisely in bug reports and triage.

  • Familiarity with CI/CD and test automation frameworks; comfort working in fast-moving, release-driven environments.

  • Schedule flexibility: overlap with US time zones required; release cycles may require weekend availability.

Strong Plus

  • Experience testing AI-powered products with non-deterministic outputs; ability to evaluate quality when responses vary.

  • Experience testing IDE plugins/extensions or developer tools (VS Code extensions, CLIs, code review systems).

  • Familiarity with AI coding tools (Windsurf, Copilot, Cursor, Devin, etc.) and informed opinions on what “good” looks like.

  • Prior software engineering background with shipped production code.



Our Commitment

Equal Opportunity. Cognition is an equal opportunity employer. We do not discriminate on the basis of any protected characteristic under applicable law. We are committed to providing reasonable accommodations for candidates with disabilities throughout the hiring process - please let us know if you need any. Cognition also considers applicants with criminal histories consistent with the SF Fair Chance Ordinance and similar local laws.

Data Privacy and Arbitration: By submitting your application, you agree to our Global Applicant and Job Candidate Privacy Notice. For US applicants, by submitting your application, you agree to the Applicant Arbitration Agreement.

How we rate this

QA Engineer - APAC at Cognition rates 70 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.

Classification

Works on AI. The daily work is on AI products, without building the model.

  1. ●●●● Builds AI80 to 100
  2. ●●●○ Works on AI60 to 79
  3. ●●○○ Uses AI40 to 59
  4. ●○○○ Little AI0 to 39

Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.

Prepare for this job

Built from this posting and from similar jobs on Level.

Skills and AI tools this role asks for

CopilotCursorWindsurfDevin

Questions you could be asked

  1. What's a project where you used Copilot hands-on?
  2. Walk me through how you've used Cursor in your day-to-day work.
  3. What are the limits of Windsurf that you've run into, and how did you work around them?
  4. What's a project where you used Devin hands-on?
  5. Describe a typical day in a role like this one: which parts run through AI directly?

Adapt your resume

  • List these exact terms on your resume: Copilot, Cursor, Windsurf, and Devin. An applicant tracking system matches the wording, not the idea.
  • Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
  • Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.

Want an expert to read your CV for this job?

Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.

Get new remote software engineering jobs (Works on AI ●●●○ or higher) by email

One email a week with the new remote software engineering jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.

Free. One email a week. Unsubscribe in one click.

Similar roles

Software Engineering roles that work on AI, at other companies.

What kind of AI work fits you?

Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.

Find my next step

More jobs at Cognition

Related searches

Same AI level