AI Data Quality Analyst

Your work days are brighter here.

We’re obsessed with making hard work pay off, for our people, our customers, and the world around us. As a Fortune 500 company and a leading AI platform for managing people, money, and agents, we’re shaping the future of work so teams can reach their potential and focus on what matters most. The minute you join, you’ll feel it. Not just in the products we build, but in how we show up for each other. Our culture is rooted in integrity, empathy, and shared enthusiasm. We’re in this together, tackling big challenges with bold ideas and genuine care. We look for curious minds and courageous collaborators who bring sun-drenched optimism and drive. Whether you're building smarter solutions, supporting customers, or creating a space where everyone belongs, you’ll do meaningful work with Workmates who’ve got your back. In return, we’ll give you the trust to take risks, the tools to grow, the skills to develop and the support of a company invested in you for the long haul. So, if you want to inspire a brighter work day for everyone, including yourself, you’ve found a match in Workday, and we hope to be a match for you too.

About the Team

About the Role

As an AI Data Quality Analyst, you will evaluate LLM-generated conversations and other text-based data, identify trends and regressions, and partner with AI Engineers and Product Managers to improve model performance. In this role, you will:

• Review and evaluate LLM-generated conversations and other text-based outputs against task-specific quality criteria and success metrics.
• Perform high-quality annotation and data labeling to create reliable datasets for model training, benchmarking, and evaluation.
• Monitor real production data to identify quality trends, regressions, and areas for improvement.
• Identify qualitative patterns, recurring failure modes, regressions, and opportunities to improve model behavior and user experience.
• Analyze evaluation results and clearly communicate insights, risks, and recommendations to cross-functional stakeholders.
• Work closely with our AI Engineers and Product Managers to understand the data needs and ensure data quality processes align with goals, ensuring Paradox and Workday products remain top in class.

Why you should work at Workday and Paradox: 

• Work side by side with passionate, purposeful people - Talent is our DNA and we pride ourselves on having the best!
• Ability to make a big impact on a growing organization and drive your own growth
• The opportunity to build the next big thing in Talent Acquisition technology
• Internal and external professional development, coaching, and continuous education opportunities

About You

Required Qualifications:

• Strong qualitative research and analytical skills, with the ability to detect meaningful patterns in large volumes of textual data.
• Strong attention to detail, sound judgment, and a high bar for consistency and quality.
• Creative, out-of-the-box thinking and a proactive approach to investigating ambiguous or unexpected model behavior.
• Technical curiosity and confidence working across web-based tools, labeling platforms, dashboards, and evolving internal interfaces.
• Strong English fluency, both written and verbal communication
• A research-oriented background, such as Linguistics, Human-Computer Interaction, Cognitive Science, Psychology, or a related field.
• Ability to work from our Tel Aviv, Israel office location.
• Authorization to work in Israel.

Nice to Have:

• 1+ years of experience with data labeling or annotation, ideally involving textual data, conversational data, or generative AI.
• Experience working directly with LLM analysis, model evaluation, conversation quality assessment, or related AI quality workflows.
• Experience using AI tools such as Claude Code, Cursor, or similar tools.

Our Approach to Flexible Work
 

With Hybrid Work, we’re combining the best of both worlds: in-person time and remote. Our approach enables our teams to deepen connections, maintain a strong community, and do their best work. We know that flexibility can take shape in many ways, so we require employees to work three days a week in the office and two days at home. This means you'll have the freedom to create a flexible schedule that caters to your business, team, and personal needs, while being intentional to make the most of time spent together.

Workday is committed to providing reasonable accommodations for qualified individuals during our application process, in order to perform one or more essential functions of their job, as well as regarding the use of AI tools for employment decision-making to any degree. Please see below for more details including how to request an accommodation as a qualified veteran, due to a disability or for religious reasons, or as otherwise provided under applicable law.

Workday prohibits taking adverse action against any candidate or employee for reporting a possible violation of this policy, requesting one or more work accommodations, exercising a privacy right, or cooperating in an investigation in accordance with applicable law. Any employee who retaliates against a candidate or employee for doing so may be subject to disciplinary action, up to and including termination of employment, to the fullest extent allowable under applicable law.

If you require a reasonable accommodation, you may email accommodations@workday.com, as far in advance as possible.

Are you being referred to one of our roles? If so, ask your connection at Workday about our Employee Referral process!

At Workday, we value our candidates’ privacy and data security.  Workday will never ask candidates to apply to jobs through websites that are not Workday Careers. 

Please be aware of sites that may ask for you to input your data in connection with a job posting that appears to be from Workday but is not.

In addition, Workday will never ask candidates to pay a recruiting fee, or pay for consulting or coaching services, in order to apply for a job at Workday.