AI Benchmark Engineer | Native Language Specialist - French

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a AI Benchmark Engineer | Native Language Specialist - French based in Canada.

This opportunity is designed for an experienced software engineer with native-level French expertise who wants to contribute to the evaluation of advanced Artificial Intelligence systems. You will design rigorous Terminal-Bench tasks that test how effectively large language models handle multilingual software challenges. Your work will focus on French-language prompts, datasets, files, and locale-specific edge cases without relying on English translation. You will build realistic environments, develop reference implementations, and create reliable verification scripts to assess model performance. The role combines software engineering, language expertise, benchmark design, and quality assurance in a highly technical environment. As an independent contractor, you will have flexibility while contributing to projects that advance multilingual AI capabilities.