Data Engineering Jobs

• Cuxton
• Hybrid · 3 days in office
• Mid-level
• Contract

Designs, builds and supports cloud-based data solutions on Microsoft Fabric, developing ingestion pipelines, lakehouses, warehouses and reporting for finance stakeholders. Implements Medallion Architecture and ETL/ELT with Data Factory, Notebooks and Spark, plus SQL modelling and Power BI semantic models. Works with analysts and architects on a 12-month contract in a hybrid London team.

Microsoft Fabric · Azure Data Services · Power BI +7

• London
• Hybrid
• £70,000 – £85,000 pa
• Senior

Builds and maintains scalable data pipelines in Databricks, developing batch and streaming workflows and designing Lakehouse architectures with medallion models. Works alongside data scientists, analysts and product teams in a cloud-first Azure environment, implementing data quality, governance and observability frameworks while driving engineering best practice through code reviews.

Databricks · Apache Spark · Delta Lake +10

• Berkshire
• Hybrid
• £61,000 – £67,000 pa
• Senior

Lead the modernisation of a legacy reporting environment into a cloud-native analytics platform, combining hands-on engineering with platform architecture. You'll own critical reporting platforms and business-facing data products, working with Azure Databricks and the wider Azure stack while managing senior stakeholders through transformation programmes.

Azure Databricks · Azure · SQL +2

• Hillingdon East
• Hybrid · 3 days in office
• Mid-level
• Contract

Designs, builds and supports cloud-based data solutions on Microsoft Fabric, creating scalable ingestion pipelines, lakehouses and warehouses using Medallion Architecture. Develops ETL/ELT with Data Factory, Notebooks and Spark, plus SQL models and Power BI reporting, while handling governance, security and CI/CD. Sits in the Group Finance Technical Analysts team, working with multi-currency financial data and Elite 3E systems.

Microsoft Fabric · Azure Data Services · Power BI +7

• Cambridge
• Hybrid · 3 days in office
• £500 – £600 pd
• Lead
• Contract

Hands-on technical lead for an established Microsoft Fabric data engineering environment, providing day-to-day direction and oversight of pipelines, Lakehouse solutions and transformations. The focus is on troubleshooting, improving data quality and governance, strengthening development and deployment standards, and reviewing work from internal and offshore engineers. Hybrid role with three days per week onsite in Cambridge.

Microsoft Fabric · Power BI

• London
• On-site
• Senior
• Permanent

Build an internal data platform from the ground up, defining architecture for petabyte-scale robot telemetry pipelines, compute infrastructure and orchestration. Work spans backend services, data warehousing, BI dashboards and MLOps evaluation workflows, collaborating closely with machine learning teams on humanoid robot training data.

Kubernetes

• London
• Hybrid · 3 days in office
• £600 – £650 pd
• Senior
• Contract

Designs, builds and supports end-to-end ETL integrations from source systems into Oracle ERP, primarily General Ledger, using IBM DataStage and Azure Data Factory. Leads technical architecture for an on-prem to cloud migration and cloud consolidation, building large-scale batch and real-time pipelines with Databricks, ADLS and Azure SQL. Works in an Agile team alongside architects, analysts and business stakeholders.

Azure Data Factory · IBM DataStage · Azure Databricks +7

• London
• Hybrid
• £40,000 – £80,000 pa
• Permanent

Builds and supports data products on a modern cloud platform, developing and optimising scalable batch and real-time pipelines while integrating large datasets with strong governance. Works in a collaborative agile squad of data and AI engineers, scientists and architects, using Databricks or Snowflake on AWS, Python, PySpark, Airflow and Terraform, with scope to experiment with ML and generative AI.

Databricks · Snowflake · AWS +7

• United Kingdom
• £70,000 – £90,000 pa
• Senior

Build secure, cloud-native Java platforms for UK National Security programmes, working on large-scale data ingestion, distributed systems and analyst tooling. Day to day involves Java services, Apache NiFi pipelines, Spring Boot microservices on OpenShift and Kubernetes, and event-driven architectures. Requires current or recently active DV/eDV clearance.

Java · Spring Boot · Apache NiFi +5

• London
• £57,000 – £69,000 pa
• Senior
• Permanent

Designs and operates robust data pipelines that ingest, validate and structure large, heterogeneous datasets, and builds analyst-facing data products such as curated datasets, data models, serving layers and query interfaces. Establishes and maintains the data platform across cloud and on-premise environments, covering storage, compute, orchestration, access control and infrastructure-as-code, within Defence and partner security constraints. A senior individual contributor role setting data engineering standards, mentoring colleagues and shaping data architecture.

Cloud · On-Premise

• Newcastle upon Tyne
• Hybrid · 2–3 days in office
• £390 – £500 pd
• Mid-level
• Contract

Designs, builds and maintains scalable cloud data pipelines and ETL processes across AWS, Kafka, Kubernetes, Java and Big Data platforms. Provides technical leadership, contributes to architectural decisions and mentors junior engineers while working with cross-functional stakeholders in an Agile delivery environment.

AWS · Kafka · Kubernetes +1

• Guildford
• Hybrid · 2 days in office
• £55,000 – £75,000 pa
• Senior

Designs, builds and optimises enterprise-scale data pipelines, ETL/ELT processes and lakehouse/warehouse solutions using Microsoft Fabric and Azure services. Works closely with analysts, developers and business stakeholders on data quality, governance and architecture, and mentors junior team members. Hybrid role with two days on-site.

Microsoft Fabric · Azure · Azure Synapse Analytics +3

• Ipswich
• Mid-level

Design, build and maintain scalable data pipelines across structured and unstructured sources, developing data lakes, warehouses and enterprise data models. Manage cloud-based platforms primarily on Azure, embedding DevOps, CI/CD and automation into ETL/ELT processes while ensuring governance, quality and UK GDPR compliance. Partner with BI teams to deliver trusted datasets and Power BI semantic models supporting a major nuclear infrastructure programme.

Azure · Power BI · Power Platform +6

• Uxbridge
• Hybrid · 1–2 days in office
• £600 – £625 pd
• Senior
• Contract · Flexible

Hands-on technical leadership across a major airline's Data & AI team, driving a 2026 data engineering workstream. You will design scalable AWS data pipelines, implement CI/CD and DevOps practices, and mentor data and software engineers. Snowflake and AI-assisted development are desirable, with 1-2 days per week on-site at Heathrow.

AWS · Snowflake · Git

• Chester
• Hybrid · 3 days in office
• Senior
• Contract

Hands-on engineering role building and maintaining scalable data platforms for compliance assurance in a regulated enterprise. You own the full data lifecycle, from ingesting source systems via Kafka and NiFi to streaming, processing and automated reconciliation controls that flag missing records, mismatches and exceptions. Developer-led, with Python, PySpark, Hadoop/Hive and CI/CD, plus production troubleshooting and auditability.

Apache Kafka · Apache NiFi · Hadoop +7