(Senior) Machine Learning Scientist (Modeling & Evaluation)
Appier is hiring a (Senior) Machine Learning Scientist (Modeling & Evaluation) in Taipei, Taiwan. Level rates it ; you can apply on Appier.
Level's read on this job
- Builds AI ●●●● is how Level rates this role: the job is building AI systems.
- Level classifies it as a senior role.
- Level lists 66 other open roles at Appier.
AI in this role
About Appier
Appier (TSE: 4180) is an AI-native Agentic AI as a Service (AaaS) company that empowers businesses to create value through cutting-edge AdTech and MarTech solutions. Founded in 2012 with the vision of “Making AI Easy by Making Software Intelligent,” Appier helps businesses turn AI into ROI through its Ad Cloud, Personalization Cloud, and Data Cloud—each powered by Agentic AI that enables autonomous, adaptive, and real-time decision-making. Today, Appier operates 17 offices across APAC, the US, and EMEA, and is listed on the Tokyo Stock Exchange. Learn more at www.appier.com.
About the Role
We are looking for a Machine Learning Scientist (Modeling & Evaluation) to join the Enterprise Solution Science Team and help enterprises turn AI into real ROI.
In this role, you will be responsible for end-to-end development, from problem definition to driving models and solutions into production.
What You'll Work On
- Design, develop, and deploy optimization solutions built on ML models and evaluation, to improve efficiency and quality.
- Work with PMs and engineers to turn product goals and customer needs into clear problems and priorities, and integrate validated methods into the product.
- Build reliable evaluation methods for LLM output to measure the quality and impact of solutions, and decide if the results apply to real-world conditions.
- Form your own hypotheses, then design A/B tests that use real traffic to validate them.
- Follow the latest research and industry solutions, evaluate them in our own context, and propose new approaches. Decide what to build in-house and what to adopt.
- Monitor solutions after launch, and proactively communicate risks, trade-offs, and progress.
- (Optional) Mentor junior scientists and interns, if the need arises.
What We're Looking For (Minimum Qualifications)
- Master's or PhD degree in Computer Science, Machine Learning, Mathematics, Electrical Engineering, or related fields
- At least 2 years of experience in machine learning or engineering roles (5+ years preferred)
- Hands-on experience with ML models (including classification, regression, ranking, and retrieval) and quality evaluation (including LLM-as-a-judge), a solid foundation in statistics, and the ability to explain how these techniques relate to business impact
- Impact-driven mindset: able to judge task priority, collaborate across functions, and proactively drive work forward and surface risks
- AI-native development: work daily with coding agents that read the codebase, run tests, and iterate on their own, while you set the scope and review the diffs. Can explain and correct what the agent produced
Preferred Qualifications
- Experience leading projects
- Ability to form hypotheses and validate them: design experiments and A/B tests, interpret results, and take ownership of conclusions
- Background in embeddings and causal inference
- Engineering experience with AI / LLM applications (for example, serving and integration)
#LI-TC1
How we rate this
(Senior) Machine Learning Scientist (Modeling & Evaluation) at Appier rates 97 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Get new data jobs (Builds AI ●●●●) by email
One email a week with the new data jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Data roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step