Creating ethical AI starts with responsible development. Discover strategies to address AI’s biggest ethical challenges.
Get the whitepaper now.

Data Engineer

London, UK
£75K - £85K
Permanent
Apply Now

The successful candidate will join a forward-thinking insurance business where they'll play a key role in evolving the organisation's data architecture and delivering innovative solutions to support underwriting, claims, and actuarial functions. 

Key Responsibilities: 

  • Enhance and maintain the insurance data lakehouse environment utilising Databricks 

  • Develop data transformation processes to support insurance-specific facts and dimensions 

  • Create robust data pipelines for processing policy, claims, and actuarial data 

  • Ensure proper documentation of all technical solutions and data flows 

  • Support continuous improvement of the BI technical environment 

Stakeholder Engagement 

  • Partner with insurance domain specialists across Actuarial, Underwriting, Claims, and Finance 

  • Provide technical guidance on self-service reporting capabilities 

  • Present innovative solutions for insurance data processing and analytics 

  • Gather and document business requirements from insurance subject matter specialists 

Technical Environment The client's technology stack comprises: 

  • Databricks for cloud-native insurance data processing 

  • Azure Data Factory for ETL orchestration 

  • Modern data lakehouse implementing medallion architecture 

  • Azure cloud services 

  • Advanced T-SQL development 

  • Python/PySpark implementation 

Advantageous Experience 

  • Azure DevOps practices 

  • Master Data Services 

  • Kimball dimensional modelling 

  • Power BI 

  • Unity Catalogue 

  • Microsoft Fabric 

APPLY FOR THIS ROLE