senior data engineer

Lorien
London, United Kingdom
3 weeks ago
Job Type
Contract
Work Location
Hybrid
Seniority
Senior
Education
Degree
Posted
7 May 2026 (3 weeks ago)

Principle Data Engineer

We are currently recruiting for a Principle Data Engineer with ECS experience to join one of our Insurance clients on a 6-month contract.

Inside IR35

Hybrid- 2 days a week onsite in Ipswich

  • Own and evolve the target architecture for enterprise data platforms across Systems of Record and Analytical Platforms, translating it into deliverable engineering work
  • Produce solution designs, patterns, and working examples (e.g., sample pipelines, reference notebooks) covering.
  • Act as a technical authority on architectural trade offs, helping teams balance timeliness, consistency, resilience, simplicity, and cost
  • Create, document, and help implement engineering standards and best practices (through templates, CI/CD checks, and working examples) for:
  • Lead platform modernisation by evaluating, adopting, and migrating to newer, more cost effective Microsoft first capabilities; retire legacy or over engineered ETL approaches and decommission redundant components
  • Promote AI driven development practices (e.g., AI assisted code generation, test creation, documentation, and refactoring) with appropriate guardrails around security, correctness, and maintainability
  • Enable integration with AI platforms by shaping data products for AI use cases and defining patterns for secure access to enterprise data
  • System of Record and Analytical Platform Boundaries
  • Define consistent patterns for how Systems of Record expose data for analytical consumption
  • Ensure Analytical Platforms provide trusted, explainable representations of enterprise data

Experience

  • Significant hands on experience designing, building, and operating enterprise scale data platforms using Microsoft first cloud technologies.
  • Able to deliver independently in a contractor context: shape work from problem statements, manage priorities, and drive to production outcomes with minimal
  • Hands-on experience with relevant data platform services and technologies, such as SQL (e.g., SQL Server/Azure SQL), Microsoft Fabric (Lakehouse/Warehouse, Data Factory), and Databricks (Spark)
  • Advanced SQL skills and experience working with complex datasets
  • Demonstrated ability to simplify and rationalise existing architectures
  • Comfortable working across multiple teams and stakeholder groups with varying priorities
  • Experience with modern data engineering practices such as version control, CI/CD, automated testing, and infrastructure-as-code
  • Experience integrating data platforms with AI services and tools (e.g., Azure OpenAI or equivalent), including secure data access patterns for analytics and AI workloads
  • Working knowledge of a general-purpose programming language used in data engineering (e.g., Python) and scripting/automation
  • Strong awareness of security, access control, and governance concepts for enterprise data platforms

Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.

Related Jobs

View all jobs

Senior Data Engineer

Opus Recruitment Solutions Bishopsgate, City And County Of the City Of London, EC2M 3UE, United Kingdom
£550 – £600 pd Hybrid

Senior Data Engineer

Fraser & Co. Talent Partners Limited London, United Kingdom
£60,000 – £80,000 pa Remote

Senior Data Engineer

Hays Technology Bridgend, Mid Glamorgan, United Kingdom
£55,000 – £63,249 pa Hybrid

Senior Data Engineer

Opus Recruitment Solutions London, United Kingdom
£60,000 – £70,000 pa Remote

Senior Data Engineer

Gleeson Recruitment Group Birmingham, West Midlands (county), United Kingdom
£70,000 – £80,000 pa Hybrid

Senior Data Engineer

Winsearch Broomhill, City Of Bristol, Bristol (county), BS4 4SE, United Kingdom
£68 ph On-site Clearance Required

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Where to Advertise Data Engineering Jobs in the UK (2026 Guide)

Where to advertise data engineering jobs UK in 2026: the specialist boards and channels that reach Spark, dbt, Snowflake and platform engineering talent. Data engineers occupy a distinct discipline that sits between software engineering, data science and cloud infrastructure — and the strongest candidates identify firmly with the data engineering community rather than with adjacent roles. General job boards consistently conflate data engineering with data analysis, data science and BI development, producing high application volumes but low candidate quality for specialist pipeline and platform roles. This guide, published by DataEngineeringJobs.co.uk, covers where to advertise data engineering roles in the UK in 2026, how the main platforms compare, what employers should expect to pay, and what the data says about hiring across different role types.

Data Engineering Jobs UK 2026: What to Expect Over the Next 3 Years

Data Engineering Jobs UK 2026: roles, salaries and the trends shaping UK data engineering hiring over the next three years — Spark, dbt, lakehouse and AI. Data engineering has become one of the most strategically important disciplines in the entire technology sector — and one of the most reliably in-demand. Every organisation that wants to use data to make decisions, train AI models, personalise products, manage risk, or understand its customers depends on data engineers to build the infrastructure that makes any of that possible. Without well-designed, reliable data pipelines, the most sophisticated machine learning model is worthless and the most ambitious analytics strategy is undeliverable. That foundational importance has made data engineering hiring remarkably resilient through the technology market corrections of the past few years. Where headcount reductions fell heavily on some engineering disciplines, demand for data engineers held firm — because the work of building and maintaining data infrastructure cannot be deferred in the way that some product development can. The data keeps coming. The pipelines need to work. But the data engineering jobs market of 2026 is not simply a stable version of what it was three years ago. The discipline has undergone a series of architectural shifts — from batch to streaming, from on-premise data warehouses to cloud-native lakehouses, from hand-rolled pipelines to declarative transformation frameworks, and most recently toward AI-augmented data engineering workflows that are beginning to reshape what the role looks like in practice. The employers hiring data engineers today are asking for a meaningfully different skill set than those hiring three years ago. The candidates who will thrive over the next three years are those who understand where the discipline is heading — which architectural patterns are becoming standard, which technologies are defining the modern data stack, and how the definition of a data engineering career is evolving toward a richer intersection of infrastructure, analytics, and AI enablement. This article breaks down what the UK data engineering jobs market is likely to look like through to 2028 — covering the titles emerging right now, the technologies driving employer demand, the skills that will matter most, and how to position your career ahead of the curve.