Data Engineering Lead

Tatton Recruitment
South Bank, London, SE1 9PZ, United Kingdom
Today
£750 – £800 pd

Salary

£750 – £800 pd

Seniority
Lead
Posted
11 May 2026 (Today)

Data Engineering Lead

Certain Advantage are hiring for a Data Engineering Lead based in London.

This role is on an initial contract till the end of the year and is required to be onsite 3 days a week.

The successful candidate will lead the data acquisition function by defining ingestion strategy and building Azure-based data pipelines.

You will translate end-user requirements into scalable engineering solutions, act as the domain’s primary Data Manager for data governance, lineage, quality, and master data management, and lead a team of data engineers in delivering reliable, compliant, and high-value data solutions to Trading, Risk, Finance, and Operations.

Your responsibilities:

Own ingestion strategy and define scalable batch/streaming data patterns

Design and deliver Azure-based data pipelines and platform solutions

Standardize connectors, schemas, controls, CI/CD, IaC, and automated testing

Lead onboarding of enterprise and market data sources with SLAs and observability

Partner with Product Owners, Architects, and business stakeholders on data design and governance

Act as domain Data Manager for lineage, metadata, quality, access, and master data ownership

Ensure compliance with data lifecycle, audit, records management, and governance standards

Drive engineering best practices, operational excellence, and continuous improvement

Manage capacity planning, skills development, and vendor contributions

The individual:

Expertise in Azure data services (ADLS, ADF, Databricks, Synapse, Event Hub/Kafka), Python, SQL, Spark/PySpark.

Experience with data modeling, metadata and lineage tooling; performance & cost optimization.

Proven leadership in engineering teams; Agile/DevOps ways of working; CI/CD; test automation.

Exposure to energy trading systems (ETRM/Endur), market data (ICE, Platts, Bloomberg), SAP.

Degree in Computer Science/Engineering or equivalent experience; Azure Data Engineer or Databricks certifications a plus.

Does this sound like your next career move? Apply today.

Working with Certain Advantage

We go the extra mile to find the best people for the job. If you’re hunting for a role where you can make an impact and grow your career, we’ll work with you to find it.

We work with businesses across the UK to find the best people in Finance, Marketing, IT and Engineering. If this job isn’t for you, head to (url removed) and register for job alerts and career guidance tips

Related Jobs

View all jobs

Data Engineering Lead

ECS Resource Group Newark on Trent, Nottinghamshire, NG24 1EA, United Kingdom
£60,000 – £90,000 pa Hybrid

Data Engineering Lead

Corecom Consulting York, North Yorkshire, YO1 8RS, United Kingdom
£75,000 – £90,000 pa

BI and Data Engineering Lead

Technify Talent Limited Leeds, West Yorkshire, United Kingdom
£40,000 – £50,000 pa

Business Intelligence & Data Engineering Lead

Jackson Hogg Pickering, North Yorkshire, United Kingdom
£40,000 – £45,000 pa

Data Platform Manager

Deerfoot Recruitment Solutions Luton, Bedfordshire, United Kingdom
£70,000 pa Remote

Senior Staff Software Engineer - FrontEnd

Matillion Manchester, United Kingdom
Hybrid

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Where to Advertise Data Engineering Jobs in the UK (2026 Guide)

Advertising data engineering jobs in the UK requires a different approach to most technical hiring. Data engineers occupy a distinct discipline that sits between software engineering, data science and cloud infrastructure — and the strongest candidates identify firmly with the data engineering community rather than with adjacent roles. General job boards consistently conflate data engineering with data analysis, data science and BI development, producing high application volumes but low candidate quality for specialist pipeline and platform roles. This guide, published by DataEngineeringJobs.co.uk, covers where to advertise data engineering roles in the UK in 2026, how the main platforms compare, what employers should expect to pay, and what the data says about hiring across different role types.

Data Engineering Jobs UK 2026: What to Expect Over the Next 3 Years

Data engineering has become one of the most strategically important disciplines in the entire technology sector — and one of the most reliably in-demand. Every organisation that wants to use data to make decisions, train AI models, personalise products, manage risk, or understand its customers depends on data engineers to build the infrastructure that makes any of that possible. Without well-designed, reliable data pipelines, the most sophisticated machine learning model is worthless and the most ambitious analytics strategy is undeliverable. That foundational importance has made data engineering hiring remarkably resilient through the technology market corrections of the past few years. Where headcount reductions fell heavily on some engineering disciplines, demand for data engineers held firm — because the work of building and maintaining data infrastructure cannot be deferred in the way that some product development can. The data keeps coming. The pipelines need to work. But the data engineering jobs market of 2026 is not simply a stable version of what it was three years ago. The discipline has undergone a series of architectural shifts — from batch to streaming, from on-premise data warehouses to cloud-native lakehouses, from hand-rolled pipelines to declarative transformation frameworks, and most recently toward AI-augmented data engineering workflows that are beginning to reshape what the role looks like in practice. The employers hiring data engineers today are asking for a meaningfully different skill set than those hiring three years ago. The candidates who will thrive over the next three years are those who understand where the discipline is heading — which architectural patterns are becoming standard, which technologies are defining the modern data stack, and how the definition of a data engineering career is evolving toward a richer intersection of infrastructure, analytics, and AI enablement. This article breaks down what the UK data engineering jobs market is likely to look like through to 2028 — covering the titles emerging right now, the technologies driving employer demand, the skills that will matter most, and how to position your career ahead of the curve.

New Data Engineering Employers to Watch in 2026: UK and Global Companies Driving the Data Revolution

Data engineering is at the heart of the digital economy, transforming raw data into actionable insights, powering analytics, AI systems, and cloud infrastructure. As the UK and global markets continue to invest heavily in data platforms, pipelines, and real-time analytics, demand for skilled data engineers is growing rapidly. For professionals exploring opportunities on www.DataEngineeringJobs.co.uk , the critical question is: which companies are expanding, hiring, and shaping the future of data-driven business? This article highlights new data engineering employers to watch in 2026, including UK startups, scale-ups, and international firms expanding in the UK.