Data Engineering Jobs in London

• London
• Lead · manages people

Hands-on technical leader who guides a small team of around five engineers while staying deep in the engineering work, driving architecture, design and code on the hardest problems. The team builds Lakebase, a managed Postgres transactional layer, across areas such as platform reliability, the network proxy data path, or distributed storage in Rust.

Databricks · Lakebase · Postgres +6

• London

Design, build and own a generalized reporting system that generates business-critical outputs from a backend data platform for a global prime brokerage and financing business. The role demands deep ownership of correctness, reliability and performance, with tight SLO workflows on scheduling systems and heavy Python, Pandas and SQL work across Snowflake and Postgres.

Datadog · Grafana · Prometheus +5

• London
• Senior

Hands-on data QA role leading automated migration testing for a core data move from eFront Invest FIA into an Azure Databricks Lakehouse. Day to day involves source-to-target reconciliation, validating private equity calculation logic (NAV, cash flows, valuations), building PyTest/PySpark/SQL test suites, and embedding quality gates into Azure DevOps pipelines.

eFront · Azure Databricks · Delta Lake +3

• London
• Hybrid · 3 days in office
• £110,000 pa
• Lead · manages people

Lead technical direction across a modern cloud data platform built on AWS, Snowflake and dbt, staying hands-on while unblocking engineers on complex issues. Combines mentoring a team of engineers with influencing senior stakeholders and shaping engineering standards in a federated data model.

AWS · Snowflake · dbt

• London
• Hybrid · 1 day in office
• £150,000 – £180,000 pa
• Director · manages people

Executive role owning the data vision for a private equity-backed financial services firm, leading a large-scale transformation of its data and analytics function. Responsibilities span reshaping the operating model, building a modern cloud data platform with lake and warehousing capabilities, and driving data engineering, governance and self-service analytics. Also involves applying AI to engineering productivity and improving customer onboarding and personalisation.

Azure · Microsoft Data Ecosystem

• London
• Hybrid
• £90,000 – £120,000 pa
• Senior
• Permanent

Lead the strategy, design and evolution of a large-scale cloud data and integration ecosystem, owning enterprise-wide platform architecture, standards and best practices. Drive modernisation roadmaps across data, integration and platform engineering, designing event-driven and streaming architectures while shaping CI/CD, automation and infrastructure-as-code strategies. Work with senior stakeholders across Azure, AWS or GCP, Snowflake and Kubernetes.

Snowflake · Azure · AWS +2

• London
• Hybrid
• £70,000 – £85,000 pa
• Senior

Builds and maintains scalable data pipelines in Databricks, developing batch and streaming workflows and designing Lakehouse architectures with medallion models. Works alongside data scientists, analysts and product teams in a cloud-first Azure environment, implementing data quality, governance and observability frameworks while driving engineering best practice through code reviews.

Databricks · Apache Spark · Delta Lake +10

• London
• Hybrid · 2–3 days in office
• £500 – £650 pd
• Mid-level
• Contract

Hands-on contract role building, automating and securing cloud and data infrastructure in live production environments. You'll write Terraform IaC, maintain GitHub CI/CD pipelines, and support Azure modernisation, Snowflake operations, Zero Trust access and secure networking. Candidates may come from an Azure/Kubernetes or Snowflake DataOps background, provided IaC and automation experience is strong.

Azure · Terraform · Kubernetes +2

• London
• Hybrid · 2–3 days in office
• £650 – £750 pd
• Senior
• Contract

Designs and delivers secure, scalable cloud and data platform architectures in an Azure environment, working closely with security and enterprise architecture teams. Translates business requirements into technical designs while staying hands-on through implementation and handover, applying Terraform, GitHub and Zero Trust principles. Snowflake and DataOps experience is desirable.

Azure · Snowflake · Terraform +1

• London
• Hybrid · 3 days in office
• £94,000 pa
• Lead · manages people
• Permanent

Senior strategic role shaping data linkage, data architecture and digital technology initiatives across the UK health data ecosystem. Involves identifying emerging technologies and investment opportunities, assessing existing programmes, building partnerships with research, government and funding bodies, and providing technical leadership across complex multidisciplinary programmes.

• London
• Remote
• £700 pw
• Senior
• Contract

Six-month contract guiding technical design for a data migration discovery within a Legacy Tech Debt programme. Involves assessing data extraction feasibility, analysing 54 Oracle database instances, overseeing reverse engineering and assuring technical artefacts, while aligning design decisions with wider architecture standards.

Oracle

• London
• Hybrid
• £85,000 – £95,000 pa
• Lead

Hands-on role owning the design and operation of a modern data integration environment, building pipelines, connectors, APIs and ETL/ELT processes with Microsoft Fabric, OneLake and Azure Data Factory. Also covers SQL transformation, data quality monitoring, lineage and documentation, plus supporting Power BI analytics and future AI work.

Microsoft Fabric · OneLake · Azure +6

• London
• Hybrid · 4 days in office
• £700 – £771 pd
• Senior
• Contract

Contract role rebuilding legacy SQL Server transformation logic (SSIS, SSRS, SSAS) into Snowflake, dbt and Python pipelines, with Power BI reporting on top, for a credit risk reporting function. The developer designs scalable Snowflake solutions, tunes query performance and cost, and provides technical leadership while engaging senior business stakeholders on regulatory reporting programmes.

Snowflake · dbt · Python +7

• London
• Hybrid · 3 days in office
• £750 – £1,000 pd
• Lead
• Contract

Hands-on Staff-level engineer modernising a large enterprise data estate, migrating thousands of pipelines and building new data products. Requires deep Python/PySpark and Spark internals expertise, AWS Glue and Airflow, plus architectural leadership and AI-assisted development practices. Hybrid, three days per week on-site in London.

AWS Glue · Apache Spark · PySpark +4

• London
• On-site
• £600 – £650 pd
• Senior
• Contract

Design and build scalable Snowflake data pipelines and cloud-native platforms on AWS, including resilient document ingestion for unstructured healthcare records. Develop ETL frameworks to transform clinical data into analytics-ready datasets while meeting GDPR and healthcare governance standards, using Snowflake Cortex, Python, SQL, dbt, Airflow and Terraform.

Snowflake · Snowflake Cortex · AWS +9