AI Quality Evaluator - Hindi (12-month contract)
Canva is hiring an AI Quality Evaluator - Hindi (12-month contract) for a remote role open to applicants in India. Level rates it ; you can apply on Canva.
Level's read on this job
- Works on AI ●●●○ is how Level rates this role: the daily work is on AI products, without building the model.
- This is listed as a remote role.
- The posting mentions Canva AI, AI content and data annotation among its tools and skills.
- Level classes it as a mid-level role.
- Canva has 96 other open roles on Level.
AI in this role
Evaluate and label AI-generated content and datasets in Hindi to support internationalisation features.
Join the team redefining how the world experiences design.
Hey, g'day, mabuhay, kia ora, 你好, hallo, vítejte, Namaste!
Thanks for stopping by. We know job hunting can be a little time consuming and you're probably keen to find out what's on offer, so we'll get straight to the point.
Where and how you can work
Alongside our global campuses, we also collaborate with talented contractors and freelancers from all over the world to help us achieve our crazy big goals. While we support flexible, remote-friendly ways of working, for this role we're focusing on India so we can best support our teams and keep collaboration flowing.
This role is a 12-month engagement, working full-time hours.
What you'd be doing in this role
As Canva scales change continues to be part of our DNA. But we like to think that's all part of the fun. So this will give you the flavour of the type of things you'll be working on when you start, but this will likely evolve. At the moment, this role is focused on:
- Labelling, annotating, and evaluating photos, graphics, videos, stickers, and designs in Hindi — assessing linguistic quality, accuracy, and cultural appropriateness
- Evaluating AI-generated content against Canva's quality bar for Hindi users, helping shape how AI experiences land in your language
- Building and contributing to Hindi-specific datasets to support the internationalisation of Canva AI features
- Delivering labelled assets on time, meeting output targets across a variety of task types and labelling guidelines
- Reviewing and refining your own labels based on feedback to maintain accuracy and consistency
- Collaborating with in-house Data Labelling teams across the Philippines and EU for ongoing quality alignment
You're probably a match if
- You're a native Hindi speaker with strong written and spoken English — you can move fluidly between both languages with confidence
- You sweat the details — inconsistencies catch your eye and you hold yourself to a high quality bar even on repetitive tasks
- You're self-directed and can manage your own time across multiple concurrent projects without needing to be chased
- You're adaptable — you can pick up new guidelines quickly and apply them consistently across different task types
- You're genuinely curious about AI and excited to be part of building language experiences that work for Hindi users
- You thrive in a fast-paced environment where the work evolves and no two weeks look exactly the same
About the team
Canva's Localisation team sits within the International Supergroup and is responsible for bringing Canva's product and AI experiences to users in their language, across the world. With international users representing almost 60% of Canva's user base, localisation is a core strategic priority. We partner closely with the CORE Research and AI Platform teams to deliver in-language AI evaluations, dataset creation, and quality assurance across Canva's pioneer markets.
Other stuff to know
We make hiring decisions to engage contractors based on your experience, skills and passion. When you signify interest in the Project, please tell us the pronouns you use and any reasonable adjustments you may need during the contractor-accreditation interview process. Please note that contractor-accreditation meetings are conducted virtually. We celebrate all types of skills and backgrounds at Canva so even if you don't feel like your skills quite match what's listed above — we still want to hear from you! Check out lifeatcanva.com for more info.
How we rate this
AI Quality Evaluator - Hindi (12-month contract) at Canva rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How do you check AI-generated content before it ships?
- Tell me about a project where data annotation was part of your work. What did you do?
- Tell me about a project where content evaluation was part of your work. What did you do?
- Tell me about a project where hindi was part of your work. What did you do?
- Tell me about a project where localisation was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: AI Content, Data Annotation, Content Evaluation, Hindi, and Localisation. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new remote AI jobs (Works on AI ●●●○ or higher) by email
One email a week with the new remote AI jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Other roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step