AdyenChicago$177k-$230kjust now
Commonwealth Bank of AustraliaPosted today
Expression of Interest: Principal Data Scientist – ML, Gen AI Model Validation at Commonwealth Bank of Australia scores 93 out of 100 on AI centrality, which makes it AI Level 4 of 4 (Builds AI) on this board. The level measures how much of the work is AI, not seniority.
AI in this role
Expression of Interest: Principal Data Scientist – ML, Gen AI Model Validation
- Scope and design validation of complex ML and Gen AI Models at scale
- Shape model validation in collaboration with Data Science, Engineering and Governance stakeholders
- Drive and lead best validation practices, tooling and standards, and streams of work
Do Work That Matters
AI & General Model Validation (AIGMV) provides independent technical challenge and review of the Group's most important ML and AI models, across business and support units.
At CommBank, we're investing in AI to create better customer experiences and meaningful value for the communities we serve. We welcome international talent who would love the experience of working in Australia. We encourage you to apply if you're open to diversifying your global experience and solving world-class AI problems across the Group in collaboration with our own AI Research Labs.
We operate with a fintech mindset as we grow our global footprint and build our people's careers, including a diversified culture of international Tech Hubs established in Seattle and San Francisco, USA, working alongside unique partnerships with OpenAI, Anthropic, AWS and Microsoft to accelerate safer AI outcomes for Australia. Join us to experience this first-hand!
See yourself in our team
As a Principal Data Scientist within the team, you will lead independent review, challenge and validation of ML, statistical and AI models across the Group, including GenAI and agentic systems. You will assess whether they are fit for purpose and operate as intended, and whether the risks they introduce are understood and appropriately controlled.
We’re interested in hearing from people with:
- Technical foundation in ML/AI & statistics: Extensive experience developing, evaluating and validating ML/AI, GenAI or statistical models, traditional models (regression, random forests, XGBoost) and hands-on fine-tuning transformer models.
- Educational background: Degree in Statistics, Data Science, Computer Science, Actuarial Science or related field, or equivalent industry experience.
- Deep GenAI & agentic systems expertise: Working knowledge of GenAI and agentic architecture to validate and challenge orchestrators, sub-agents, RAG pipelines, tool use, guardrails, multi-agent routing, memory/persona handling and LLM-as-a-Judge backed by practical experience with PyTorch, AWS SageMaker and GenAI tooling such as LangChain, LangGraph, OpenAI Agents SDK, Pydantic and Langfuse/HoneyHive.
- Engineering & coding practice: Advanced hands-on coding in Python, R, TypeScript and use of AI coding agents - Claude Code, Codex, alongside GitHub, CI/CD, and skillfully read and navigate unfamiliar codebases, reproduce evaluation pipelines, write test harnesses and inspect trace data, and building/maintaining skills, sub-agents, hooks and plugins to automate workflows.
- Independent judgement & technical leadership: A courageous mindset with independent judgement, self-directed learning backed by curiosity and discipline to stay ahead of fast-changing AI techniques and risks, alongside technical leadership to lead projects, guide other data scientists through the work, turning complex systems into structured test plans.
- Communication across audiences: Strong communication skills to explain complex technical concepts clearly to mixed audiences, including senior stakeholders and governance forums.
Working with us
At CommBank, we foster a culture of inclusion and respect, celebrating diversity across cultures, abilities, capabilities, skills, global locations, genders, gender expressions and sexual orientations. If this role excites you but you don’t meet every requirement, we still encourage you to apply as you may be the right fit for this role or another opportunity with us.
We’re committed to making a meaningful difference for Australia’s First Nations peoples and welcome all applicants. We are open to international talent that would love to experience working in Australia.
APPLY NOW to live your best life and do your best work with the world's #4 AI Banking leader(Evident AI Index 2025) and Australia's #1 Employer of Choice for growing careers(LinkedIn Top Companies 2026)
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Advertising End Date: 10/10/2026Prepare for this job
A free preview built only from this posting: what it asks for, what you could be asked in an interview, and how to adjust your resume.
Skills and AI tools this role asks for
Questions you could be asked
- How would you design a retrieval step so the model answers from real data instead of guessing?
- Walk me through fine-tuning a model: what data did you use, and how did you check the result?
- Tell me about a research question you investigated. What did you find?
- What's a project where you used OpenAI hands-on?
- Walk me through how you've used Claude in your day-to-day work.
Adapt your resume
- List these exact terms on your resume: Rag, Fine Tuning, AI Research, OpenAI, and Claude. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them — a tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped — this role is judged on the AI system itself, not the tools around it.
Want your resume actually rewritten for this job?
The free preview above is everything we have today. A full resume rewrite is not live yet and has no price set. Join the waitlist and we will email you if we open it.
Get new data scientist jobs at AI Level 4+ by email
One email a week with the new data scientist jobs at AI Level 4+, each rated AI Level 1 to 4 for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Data roles rated AI Level 4 at other companies.
RobloxSan Mateo, CA, United States$419k-$458k1h ago
RedditRemote · Remote - United States$230k-$322k16h ago
NovartisCambridge (USA)$139k-$257k18h ago
PwCBengaluru Millenia18h ago
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next stepMore jobs at Commonwealth Bank of Australia
Commonwealth Bank of AustraliaSydney Northern Beaches Area18h ago
Commonwealth Bank of AustraliaEastern Suburbs Area18h ago
Commonwealth Bank of AustraliaSydney CBD Area18h ago

