Data Scientist, Senior Specialist
Vanguard is hiring a Data Scientist, Senior Specialist. Level rates it ; you can apply on Vanguard.
Level's read on this job
- Level rates this data scientist role Builds AI ●●●●: the job is building AI systems.
- The posting mentions visa sponsorship.
- The posting mentions RAG and NLP among its tools and skills.
- Vanguard has 366 other open roles on Level.
- Posted in the last few days.
AI in this role
Core Responsibilities
- Serve as a senior technical leader for traditional and agentic AI/ML capabilities supporting enterprise conversational AI across voice, chat, and emerging agentic experiences while providing technical direction and guiding complex solutions from design through production.
- Drive Data Science across the full AI lifecycle, from problem formulation, research and experimentation through solution design, development, evaluation, deployment readiness, production measurement, and continuous optimization.
- Lead development and optimization of traditional and agentic AI/ML solutions, including supervised and unsupervised learning, NLP, Generative AI, LLM-based applications, agentic systems, classification models, and knowledge/retrieval-based solutions.
- Advance evaluation and production intelligence for conversational AI, establishing rigorous methods to assess functional accuracy, user-need fulfillment, reliability, and other system-level behaviors.
- Develop scalable evaluation approaches that enable teams to identify failure modes, compare solutions, establish benchmarks, and make evidence-based release decisions.
- Apply strong analytical and statistical thinking to uncover patterns in large and complex datasets, diagnose model and system behavior, perform root-cause analysis, design experiments, quantify uncertainty, and translate findings into actionable product and engineering recommendations.
- Turn complex data into clear, cohesive stories and actionable insights, combining exploratory analysis, visualization, statistical reasoning, and business context to deliver diagnostic metrics and product improvements.
- Partner closely with Product, Engineering, Architecture, UX, Analytics, Risk and other stakeholders as an embedded technical leader, translating ambiguous business and client problems into measurable Data Science problems and scalable AI solutions
- Establish technical standards and best practices for model development, experimentation, evaluation, validation, observability, explainability, documentation, and responsible use of AI.
- Drive continuous improvement of conversational and agentic systems by converting evaluation and production signals into hypotheses, experiments, model/prompt/system improvements, and measurable outcomes.
- Communicate complex AI/ML concepts, findings, risks, and recommendations clearly to both technical and non-technical stakeholders and influence decisions across cross-functional teams.
- Stay current with advances in AI and Data Science and evaluate emerging methods, models, frameworks, and architectures.
Qualifications
- 10+ years of relevant Data Science, Machine Learning, or applied AI experience, with demonstrated experience leading complex technical work; prior people leadership or technical team leadership strongly preferred.
- Strong practical foundation in machine learning, including supervised and unsupervised learning, feature engineering, model development, validation, experimentation, and performance measurement.
- Demonstrated expertise in Natural Language Processing and Generative AI, with a strong understanding of transformer architectures, embeddings, LLMs, prompting, retrieval-augmented generation, and modern language-model development patterns.
- Hands-on experience designing, building, evaluating, or optimizing agentic AI systems, including areas such as orchestration/routing, tool use, knowledge retrieval, multi-turn conversational behavior, and agent evaluation.
- Strong Python and data-analysis skills, with experience working with large datasets and using modern ML/Data Science libraries and development environments.
- Experience with AI/ML evaluation and observability, including developing evaluation datasets, metrics, benchmarks, automated evaluations, production monitoring, failure analysis, and methods for connecting model/system behavior to client or business outcomes.
- Ability to move comfortably between technical depth and business context, translating loosely defined problems into hypotheses, analytical approaches, measurable success criteria, and actionable recommendations.
- Demonstrated ability to lead and develop Data Scientists, provide thoughtful technical review, establish engineering and modeling standards, manage competing priorities, and create an environment of accountability, learning, and experimentation.
- Strong data analytics, visualization, and storytelling skills to turn complex data into actionable insights.
- Strong communication and stakeholder-management skills, with the ability to explain complex AI concepts and influence Product, Engineering, Architecture, Analytics, Risk, and senior business stakeholders.
Education
- Undergraduate degree in Computer Science, Engineering, Data Science, Statistics, Applied Mathematics, Economics, Analytics, or a related quantitative discipline, or an equivalent combination of education and relevant experience.
- Advanced degree preferred.
Special Factors
Sponsorship
Vanguard is not offering visa sponsorship for this position.About Vanguard
At Vanguard, we don't just have a mission—we're on a mission.
To work for the long-term financial wellbeing of our clients. To lead through product and services that transform our clients' lives. To learn and develop our skills as individuals and as a team. From Malvern to Melbourne, our mission drives us forward and inspires us to be our best.
How We Work
Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.
How we rate this
Data Scientist, Senior Specialist at Vanguard rates 94 out of 100 for how much of the daily work is AI. That makes it Builds AI (AI Level 4 of 4). The level is about AI in the job, not seniority.
Builds AI. The job is building AI systems.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Also common in data scientist jobs at this level
Pay
- Typical data scientist job
- $166k
This posting doesn't list pay. Use the typical data scientist figure when pay comes up. See data scientist jobs
Questions you could be asked
- How would you design a retrieval step so the model answers from real data instead of guessing?
- What NLP problem have you worked on, and how did you measure whether it actually worked?
- How would you decide a model or AI system is ready to ship?
- Tell me about a time a model underperformed in production. How did you find out, and what did you change?
Adapt your resume
- List these exact terms on your resume: RAG and NLP. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Lead with what you built, trained or shipped. This role is judged on the AI system itself, not the tools around it.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new data scientist jobs (Builds AI ●●●●) by email
One email a week with the new data scientist jobs (Builds AI ●●●●), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Data roles that build AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step