Data Engineering Jobs

• London
• Hybrid
• £95,000 – £125,000 pa
• Lead
• Permanent

Architect and implement Databricks Lakehouse solutions covering ingestion, processing, storage, governance and analytics for enterprise clients. Lead architectural engagements, tune workloads for performance and cost, and build CI/CD pipelines with Databricks Repos, GitHub Actions and Azure DevOps. Work hybrid in London within a consultancy's architecture practice, advising clients on data strategy and governance.

Databricks · Delta Lake · Spark +7

• Cambridge
• Remote
• £90,000 – £110,000 pa
• Lead

Hands-on senior role designing and building scalable data platforms, ETL/ELT pipelines and Data-as-a-Service capabilities that power analytics, machine learning and AI products for enterprise clients. Involves setting standards for data quality, governance, lineage and observability, plus secure data services and APIs, with scope to build and lead a wider data function.

AWS

• Manchester
• Hybrid
• £60,000 – £75,000 pa
• Senior

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role in Manchester supporting client data engineering and integration engagements.

Quantexa · Spark · Scala +7

• Birmingham
• Hybrid
• £60,000 – £75,000 pa
• Senior

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role in Birmingham supporting client data engineering and integration engagements.

Quantexa · Spark · Scala +7

• Derby
• Hybrid · 2 days in office
• £40,000 pa
• Permanent

Builds and establishes modern data engineering solutions on Microsoft Fabric, working hands-on with OneLake, Lakehouses, Warehouses, Data Pipelines, Dataflows, Notebooks and Eventstreams. Uses SQL, T-SQL, Spark SQL, PySpark and Python for ingestion, transformation, modelling and converting source data into validated Delta tables, plus Power BI for semantic models. Integrates third-party APIs and migrates legacy data platforms, joining an established team with hybrid working.

Microsoft Fabric · OneLake · Lakehouses +7

• Farnborough
• Hybrid · 3 days in office
• £550 – £600 pd
• Senior
• Contract

Build and optimise cloud-based data integration and analytics solutions for a defence-sector client, focusing on scalable ETL pipelines, data lakes and processing frameworks in AWS. Day-to-day work centres on AWS Glue jobs using PySpark and Python, Glue Data Catalog, crawlers, workflows and triggers, plus S3 data lake management and IAM security. Three roles, outside IR35, with three days a week onsite.

AWS Glue · AWS Glue Data Catalog · Amazon S3 +7

• Manchester
• Hybrid
• £90,000 – £100,000 pa
• Director · manages people
• Permanent

Owns the data engineering strategy, architecture and roadmap for an established online business, leading a team of ten through a migration from on-prem SQL to Azure. Sets engineering standards across data modelling, pipelines, governance and automated deployments, and makes the calls on tooling, budget and suppliers while reporting into the C-suite. Microsoft Fabric adoption and practical AI use are open questions the role holder will shape.

Azure · Microsoft Fabric · Azure Data Factory +1

• Manchester
• Hybrid · 2 days in office
• £60,000 – £100,000 pa
• Senior

End-to-end data architecture role owning the full data lifecycle, from ingestion to consumption, across secure client environments. Involves designing lakehouse and medallion architectures, defining batch and streaming pipelines, and making decisions on storage, orchestration, governance and security. Cloud-agnostic, working with AWS, Azure or GCP alongside Databricks, Snowflake, Spark and Kafka.

AWS · Azure · GCP +7

• Birmingham
• Hybrid · 2–3 days in office
• Director · manages people

Build an entire Data & AI function from scratch for a growing technology business, starting with data foundations, governance and reporting before moving into AI initiatives such as agentic AI and embedding AI into a customer-facing platform. Lead a new team of data architects and analysts, own the existing data migration team, and work with Product, Architecture and senior leadership to commercialise data and drive adoption.

Salesforce · Excel

• Hertfordshire
• Director · manages people

Lead the Data & Analytics strategy for a major civil engineering and construction group, building a high-performing team and modern cloud data ecosystem. Own data governance, MDM, and Power BI environments while acting as senior technical authority across Microsoft Fabric, Databricks, SQL, DAX and ETL pipelines. Distinct for combining strategic leadership with hands-on delivery to support future AI ambitions.

Microsoft Fabric · Databricks · Power BI +1

• Berkshire
• Hybrid
• £55,000 – £67,000 pa
• Senior
• Permanent

Owns the end-to-end data journey for a financial services business, building Azure Databricks pipelines with PySpark, SQL, ADF and ADLS Gen2, and governed lakehouse solutions using Delta Lake, medallion architecture and Unity Catalog. Also owns Power BI semantic models, DAX measures and row-level security, translating marketing and contact-centre requirements into trusted metrics while mentoring colleagues and improving engineering standards.

Azure Databricks · Unity Catalog · Power BI +7

• Langley Mill
• £55,000 pa
• Senior
• Contract

Hands-on engineering role building a greenfield AWS Analytics and AI platform on a 12-month fixed term contract, turning operational, telematics and third-party data into governed, reusable data products. You'll build lakehouse pipelines with S3, Glue, Athena, Lake Formation, DMS and Step Functions, embedding data quality, lineage, metadata and access controls, and mentor others in the team.

AWS · S3 · AWS Glue +7

• London
• Senior

Drive large-scale enterprise data warehouse migrations to the Databricks Intelligence Platform across EMEA, acting as the tier-3 technical escalation point for complex, strategic accounts. Build assessment tooling, programmatic migration assets and guardrails, while mentoring the regional Solutions Architect community and feeding field insights back to Product and Engineering.

Databricks · Apache Spark · Teradata +7

• United Kingdom
• Remote
• £400 – £500 pd
• Contract

Multiple contract roles across a large-scale technology programme, spanning data, ML and AI platform engineering, architecture, governance, security and operations. Work includes building and running platforms using Python, SQL, Trino/Starburst, DataHub, JupyterHub, OpenSearch, Entra ID/OIDC, FluxCD/Argo CD and Helm, with both hands-on and technical leadership openings.

DataHub · Trino · Starburst +9

• London
• US$104,435 – US$182,604 pa
• Director · manages people

Serves as primary business partner for the Market Intelligence division, owning the data platform lifecycle for large, complex sales compensation datasets. Leads database build-out, schema design, ETL workflows and governance, translating commercial contracts into structured data constructs while mentoring a team of analysts. Acts as first point of contact for sales leadership on data anomalies and SOX-compliant reporting.

SQL · Python · Pandas +3