Commonwealth Bank of Australia
Senior Analyst, Applied AI & Automation
Commonwealth Bank of Australia is hiring a Senior Analyst, Applied AI & Automation for a remote role open to applicants in Australia. Level rates it ; you can apply on Level.
Level's read on this job
- Works on AI ●●●○ is how Level rates this role: the daily work is on AI products, without building the model.
- This is listed as a remote role.
- The posting mentions Copilot, LangChain and LangGraph among its tools and skills.
- Commonwealth Bank of Australia has 193 other open roles on Level.
- This posting went up in the last few days.
AI in this role
Build intelligent automation and agentic AI solutions to transform fraud and scam quality assurance processes.
- Build intelligent automation with agentic AI
- Shape a new AI automation capability
- Transform Fraud and Scams quality assurance
See Yourself in the Team
The Fraud, Scams & Cyber Data, Analytics and AI team brings together data, analytics and emerging AI capabilities to help protect our customers and the Group from increasingly sophisticated threats. Working across complex customer, operational and risk environments, the team uses data and technology to generate deeper insights, strengthen decision-making and develop smarter, more scalable ways of detecting, preventing and responding to fraud and scams.
You’ll join the People Capability Automation team, an emerging capability focused on exploring how analytics, AI and intelligent automation can transform traditionally manual processes across Fraud and Scams. Reporting to the People Capability Automation Lead, you’ll be part of the foundational team helping shape how the capability evolves — bringing ideas, experimenting with new approaches and building solutions that combine strong analytical foundations with the possibilities created by Generative and agentic AI.
With an initial focus on Quality Assurance, you’ll work closely with specialists across Fraud Analytics, Operations, Technology, Risk and AI to explore how customer interactions, operational data and existing processes can be better analysed and automated. This is an opportunity to help build something from the ground up, applying emerging technology to real operational challenges while ensuring solutions remain measurable, reliable and appropriately governed.
Your Impact & Contribution
This is a unique role where you’ll combine analytics, data science and agentic AI to help transform quality assurance across fraud and scam operations. Working with communications and interaction data, call transcripts, case management information and operational datasets, you’ll explore how LLMs, intelligent agents and agentic workflows can transform traditionally manual QA processes, from classifying fraud and scam scenarios and assessing conversation quality through to evaluating process adherence and surfacing actionable insights.
Partnering with Fraud Analytics, Quality Assurance, Product and Technology teams, you'll help shape how agentic AI can be applied to improve quality, identify risks and translate promising concepts into practical, scalable solution, You’ll combine strong foundations in analytics with hands-on applied AI capability, using SQL and Python alongside LLMs, classification models, NLP and agentic orchestration frameworks to design workflows that can reason across information, interact with data and tools, and coordinate tasks across the QA lifecycle while maintaining appropriate human oversight.
You’ll also play an important role in determining whether these solutions genuinely work, developing evaluation approaches, testing model and agent behaviour, improving reliability, reducing hallucinations and translating AI outputs into clear, defensible recommendations for operational, risk and technology stakeholders.
In summary, you may expect to:
- Design and build agentic AI solutions that automate and enhance elements of the Fraud and Scams quality assurance lifecycle.
- Explore where LLMs, agents and intelligent automation can replace or augment manual QA processes and help shape the solution approach.
- Develop and orchestrate multi-step AI workflows that can reason across unstructured information, interact with data and tools, and coordinate tasks.
- Use SQL and Python to explore, prepare and analyse complex customer, interaction, case and operational data.
- Apply NLP, classification, predictive analytics and machine learning where appropriate to complement agentic solutions.
- Prototype and evaluate new approaches, determining what works before developing scalable and reusable solutions.
- Design testing and evaluation frameworks to measure performance, identify failure modes and improve the reliability of AI outputs.
- Partner with Fraud Analytics, Quality Assurance, Product, Technology and Risk specialists to take ideas from problem definition and experimentation through to implementation and continuous improvement.
Your Skills & Experience
You’ll be a curious and solution-oriented analytics professional who combines strong foundations in data and analytics with hands-on Applied AI capability. You thrive working with ambiguous problems, experimenting with emerging technologies and finding practical ways to turn ideas into reliable, scalable solutions. The ideal applicant will be comfortable interrogating complex data to understand what is happening and why, and exploring how AI, automation and intelligent agents can transform the way that work is performed.
In summary, you’ll bring:
- Strong hands-on analytics capability with SQL and Python, with experience extracting, preparing, analysing and interpreting complex structured and unstructured datasets.
- Strong foundations in analytics and data science, with experience applying techniques such as classification, predictive analytics, statistical modelling or machine learning to solve real-world problems.
- Practical experience designing and building solutions using Generative AI and LLMs, rather than solely consuming AI tools.
- Experience developing agentic or multi-step AI workflows, including orchestration, reasoning, retrieval, tool use or interaction between AI agents, data and systems.
- Experience applying NLP, conversation analytics or LLMs to classify, evaluate or extract meaningful insights from unstructured text.
- An understanding of AI evaluation and reliability, including testing model and agent behaviour, measuring performance, identifying failure modes and reducing hallucinations.
- Experience with Copilot Studio, LangGraph, LangChain, Semantic Kernel, AutoGen or similar agentic and orchestration frameworks would be highly valuable.
- Familiarity with modern development practices, including Git/version control, APIs and collaborative or AI-assisted development environments.
- A strong innovation and solution-design mindset, with the curiosity to challenge existing approaches, rapidly prototype ideas and determine where analytics, AI or automation can deliver a better outcome.
- Strong stakeholder and communication skills, with the ability to translate ambiguous business problems into technical solutions and explain complex analytical and AI concepts clearly to technical and non-technical audiences.
- Experience in fraud, scams, financial crime, quality assurance, risk, compliance or controls testing would be beneficial, but the priority is strong analytics and Applied AI capability with the ability to build solutions that are reliable, measurable and fit for purpose.
Working With Us
At CommBank, we're committed to creating an accessible, inclusive and respectful workplace. If you require support or adjustments, please let us know.
We welcome applications from people of all backgrounds and we're particularly committed to making a positive difference for Aboriginal and/or Torres Strait Islander Peoples. For support, please contact 1800 989 696.
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Advertising End Date: 31/10/2026How we rate this
Senior Analyst, Applied AI & Automation at Commonwealth Bank of Australia rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How do you decide when an AI agent can act on its own versus asking for approval first?
- Tell me about a workflow you automated with AI tools, end to end.
- How do you decide that one model's output is better than another's for a given task?
- What NLP problem have you worked on, and how did you measure whether it actually worked?
- Tell me about a project where data science was part of your work. What did you do?
Adapt your resume
- List these exact terms on your resume: AI agents, AI Automation, AI Evaluation, NLP, and Data Science. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new remote AI jobs (Works on AI ●●●○ or higher) by email
One email a week with the new remote AI jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Other roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step