Senior Data Engineer
AI in this role
Job Type:
PermanentBuild a brilliant future with Hiscox
Role Overview:
We are seeking an experienced Senior Data Engineer to design, build, and maintain enterprise data pipelines and data solutions across our Microsoft-centric platform. This hybrid role combines hands-on technical expertise with a strong focus on data governance, quality, and collaboration.
Key Responsibilities:
- ETL/ELT Pipelines: Design, develop, and maintain robust ETL/ELT pipelines ensuring data is efficiently extracted, transformed, and loaded across systems.
- Data Engineering Projects: Lead data refactoring and integration projects across the platform, optimising data flows and performance.
- Documentation & Governance: Maintain high-quality documentation for data pipelines and architecture. Contribute to data governance initiatives to ensure data quality, security, and compliance.
- Cross-Team Collaboration: Work closely with Dynamics 365, Power Platform, and other cross-functional teams to deliver integrated data solutions. Engage stakeholders to understand requirements and provide technical guidance.
Essential Skills & Experience:
- Database Proficiency: Deep expertise in Microsoft SQL (T-SQL) – able to write, optimise, and troubleshoot complex queries and stored procedures.
- Azure Data Factory (ADF): Hands-on experience developing and orchestrating pipelines with Azure Data Factory.
- Dynamics 365 & Power Platform: Proven experience working with Microsoft Dynamics 365 and the Power Platform ecosystem.
- Dataverse: Strong experience with Microsoft Dataverse (Common Data Service) – including data modelling and integration. (This is essential or a very strong advantage.)
- Data Architecture: Solid understanding of data modeling, data warehousing concepts, and ETL best practices in a cloud environment.
- Collaboration & Communication: Excellent communication skills with the ability to translate complex data concepts for technical and non-technical stakeholders. Team-oriented, proactive in knowledge sharing, and adept at documentation.
- Problem-Solving: Demonstrated ability to troubleshoot data issues, optimise performance, and ensure reliability and accuracy of data pipelines.
Desirable Skills:
- Microsoft Fabric: Experience with Microsoft Fabric (Azure) for advanced analytics and data integration.
- Cloud Analytics: Familiarity with Azure Synapse Analytics or Azure Data Lake for big data processing and warehousing.
- Scripting & Automation: Proficiency in a programming/scripting language (e.g., Python or C# PowerShell) for advanced data transformation and automation.
- CI/CD & DevOps: Experience implementing CI/CD pipelines and version control (e.g., Azure DevOps, Git) for data engineering projects.
- Data Quality & Governance Tools: Experience using data quality frameworks or data governance tools to enforce standards and compliance.
Nice-to-Have Skills:
- Big Data Tools: Exposure to Azure Databricks
- BI & Reporting: Knowledge of Power BI or similar data visualisation/BI tools for supporting analytics and reporting needs.
- ML Pipelines: Basic understanding of machine learning pipelines or model deployment in a data engineering context.
Other Information:
- Work Arrangement: This position is based in Lisbon with a hybrid working model (on-site at our Lisbon office approximately two days per week).
- Mindset: The ideal candidate is detail-oriented, self-driven, and passionate about clean, well-governed data. They thrive in a collaborative environment and take ownership of delivering high-quality solutions.
Work with amazing people and be part of a unique culture
How we rate this
Senior Data Engineer at Hiscox rates 9 out of 100 for how much of the daily work is AI. That makes it Little AI (AI Level 1 of 4). The level is about AI in the job, not seniority.
Little AI. AI is not part of the work.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Open the description and count.
Get new data engineer jobs by email
One email a week with the new data engineer jobs, each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Data roles that involve little AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next step