Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer

KDR Talent Solutions
City of London
1 week ago
Create job alert

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL.


The Opportunity

Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks.


This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer. You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions.


As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks. This platform will be built to scale, incorporating the latest advancements in data intelligence while supporting strategic business objectives.


Key Responsibilities

🔹 Build & Develop – Design and maintain a robust Databricks Data Platform, ensuring performance, scalability, and availability.

🔹 Data Pipelines – Connect APIs, databases, and data streams to the platform, implementing ETL/ELT processes.

🔹 Data Integrity – Embed quality measures, monitoring, and alerting mechanisms.

🔹 CI/CD & Automation – Create deployment pipelines and automate workflows.

🔹 Collaboration – Work with stakeholders across Global IT, Data, and Broking teams to translate business requirements into technical solutions.

🔹 Futureproofing – Drive the evolution of the data platform, ensuring adaptability for new data sources, analytical models, and emerging technologies.


What You’ll Bring

Extensive hands-on experience with Databricks, and Microsoft Azure data tools (must-have: Azure Data Factory, Azure Synapse, or Azure SQL).

Dimensional modelling / DWH Design

Medallion Architecture

✅ Strong ETL/ELT development skills.

Python scripting experience for data automation.

✅ Experience with CI/CD methodologies for data platforms.

✅ Previous London Market Insurance experience


Why Join?

🚀 Greenfield Project – Work on an all-new data platform, shaping its architecture from the ground up.

🌍 Collaborative Culture – Engage with global teams in an agile, innovative environment.

📈 Career Growth – Play a pivotal role in driving data excellence within a forward-thinking business.

💡 Cutting-Edge Tech – Work with the latest advancements in Azure, Databricks, and Data Engineering.


This is a fantastic opportunity for a Lead Data Engineer looking to make a tangible impact. If you’re ready to take on a challenging and rewarding role, apply today!

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data engineering hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise reliable pipelines, modern lakehouse/streaming stacks, data contracts & governance, observability, performance/cost discipline & measurable business outcomes. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for platform‑oriented DEs, analytics engineers, streaming specialists, data reliability engineers, DEs supporting AI/ML platforms & data product managers. Who this is for: Data engineers, analytics engineers, streaming engineers, data reliability/SRE, data platform engineers, data product owners, ML/feature‑store engineers & SQL/ELT specialists targeting roles in the UK.

Why Data Engineering Careers in the UK Are Becoming More Multidisciplinary

For many years, data engineering in the UK meant designing pipelines, moving data between systems, and ensuring analysts had what they needed. Today, the field is expanding. With cloud platforms, machine learning, real-time analytics and the explosion of sensitive personal data, employers expect data engineers to do much more. Modern data engineering is no longer just about code and storage. It requires legal awareness, ethical judgement, psychological insight, linguistic clarity and human-centred design. These disciplines shape how data is collected, processed, explained and trusted. In this article, we’ll explore why data engineering careers in the UK are becoming more multidisciplinary, how law, ethics, psychology, linguistics & design now influence job descriptions, and what job-seekers & employers must do to thrive.

Data Engineering Team Structures Explained: Who Does What in a Modern Data Engineering Department

Data has become the lifeblood of modern organisations. Every sector in the UK—finance, healthcare, retail, government, technology—is increasingly relying on insights derived from data to drive decisions, deliver products, and improve operations. But raw data on its own isn’t enough. To make data useful, reliable, secure, and scalable, companies must build strong data engineering teams. If you’re recruiting for data engineering or seeking a role, understanding the structure of such a team and who does what is essential. This article breaks down the typical roles in a modern data engineering department, how they collaborate, required skills and qualifications, expected UK salaries, common challenges, and advice on structuring and growing a data engineering team.