Data Engineering Jobs

• London
• Hybrid
• £100,000 – £110,000 pa
• Lead
• Permanent

Hands-on data engineering lead role at a private equity firm, designing and scaling modern data platforms across a portfolio of companies. Combines technical delivery, data architecture and senior stakeholder advisory, with direct C-suite exposure and a focus on making infrastructure AI-ready for advanced analytics and agentic AI use cases.

• London
• On-site
• £100,000 – £120,000 pa
• Senior
• Permanent

Hands-on data engineering lead designing scalable, AI-ready data platforms and architectures across an investment firm's portfolio. Combines building end-to-end infrastructure in SQL and Python with advising C-suite teams on data strategy, prioritisation and commercial impact, working tech-agnostically across varied environments.

• Birmingham
• Remote
• Mid-level
• Permanent

Hands-on role taking technical ownership of data migration workstreams for law firms moving from legacy systems to cloud platforms, primarily Actionstep. Involves analysing legacy databases, building SQL scripts and ETL routines, profiling and cleansing data, running trial migrations, UAT and production cutovers, and reconciling financial records across concurrent client projects.

Actionstep · Python · PowerShell +7

• London
• Hybrid · 3 days in office
• Senior

Defines and delivers a group-wide data architecture strategy underpinning BI and self-service analytics across multiple operating units. Sets technical vision, standards and frameworks for scalable, secure data solutions, acting as technical authority alongside BI engineers and senior stakeholders. Involves evaluating and adopting new technologies in a large multi-country transport business.

AWS · Databricks · Snowflake +4

• London
• Senior

Hands-on data QA role leading automated migration testing for a core data move from eFront Invest FIA into an Azure Databricks Lakehouse. Day to day involves source-to-target reconciliation, validating private equity calculation logic (NAV, cash flows, valuations), building PyTest/PySpark/SQL test suites, and embedding quality gates into Azure DevOps pipelines.

eFront · Azure Databricks · Delta Lake +3

• London
• Hybrid
• £55,000 – £65,000 pa
• Mid-level
• Permanent

Design, build and maintain ETL/data pipelines and secure cloud-based data platforms using Python and SQL, applying DataOps and DevOps practices. Work with architects, analysts and software engineers on high-impact projects supporting UK national security, covering data modelling, orchestration and governance.

AWS

• Oxford
• Hybrid · 2 days in office
• £55,000 – £65,000 pa
• Mid-level

Hands-on role building and maintaining scalable data pipelines on Databricks, integrating new sources and optimising ETL and transformation processes. You will develop SQL and Python/PySpark transformations, tune queries, stored procedures and database objects, and help mature a modern Microsoft data platform within a Data & Innovation team, contributing to CI/CD and Git practices.

Databricks · Microsoft · Git

• London
• Hybrid
• £40,000 – £85,000 pa
• Mid-level
• Permanent

Builds and maintains cloud data platforms that support analytics, AI and business-critical decision-making for financial services clients. Works within a growing consultancy delivering modern data solutions, in a hybrid UK-based setup. The description is truncated, so day-to-day tooling is not detailed.

• United Kingdom
• Hybrid

Hands-on engineering of secure, enterprise-scale data platforms for defence and national security programmes, building production-grade pipelines across ingestion, processing and serving layers. You'll work with Python, SQL, Spark, Java or Scala on AWS, Azure or GCP, integrating structured and unstructured data at scale in live operational environments.

AWS · Azure · GCP +1

• Newark
• Hybrid · 2 days in office
• £30,000 – £36,000 pa
• Mid-level

Hands-on role improving the validity, reliability and accessibility of data across a data warehouse and data lake. Day to day involves running quality checks, root-cause analysis of ingestion failures, data profiling and cleansing, building data quality scoring and a data catalogue, and automating checks and alerts with Python. Also creates dashboards in Qlik and works with data owners and business stakeholders to agree definitions and ownership.

SQL · Excel · Python +4

• London
• Remote
• £76,000 – £90,000 pa
• Senior
• Permanent

Owns data modelling and pipelines powering customer-facing features like predicted grades and adaptive learning, working with BigQuery, dbt, Airflow and CockroachDB. As the go-to data specialist in a small cross-functional team, sets modelling standards, improves data quality and observability, and mentors other engineers.

BigQuery · dbt · Airflow +5

• Birmingham
• Hybrid
• £60,000 pa
• Senior

Builds and maintains ETL pipelines and an in-house ingestion framework on a cloud-based data platform, administering Databricks with a focus on data governance. Supports BI reporting, analytics and AI initiatives, including preparing feature tables for machine learning, within a small collaborative team.

Databricks · PySpark · Python +7

• Warrington
• Hybrid
• £60,000 pa
• Senior

Develops and maintains ETL pipelines and an in-house ingestion framework, administers the Databricks platform including data governance, and supports BI, analytics and AI initiatives. Works in a small collaborative team on a cloud-based data platform, using PySpark, Python and SQL, with opportunities to mentor and prepare feature tables for machine learning.

Databricks · PySpark · Python +7

• London
• Hybrid · 2–3 days in office
• Senior
• Contract

Hands-on engineering role building scalable data pipelines and entity resolution capabilities on the Quantexa platform for a major financial crime and AML transformation programme. Day to day involves Scala, Spark, Python and SQL work across Azure, Databricks and Elasticsearch, developing reusable frameworks and supporting testing, deployment and automation alongside global technology, product and business stakeholders.

Quantexa · Azure · Databricks +4

• London
• Hybrid · 2–3 days in office
• Lead · manages people
• Contract

Hands-on technical leadership role driving a newly established Quantexa capability for AML and financial crime initiatives across EMEA. Leads and mentors a small team of data engineers while designing and building scalable pipelines and ETL processes using Scala, Spark, Python and SQL, with cloud architecture on Azure and Databricks.

Quantexa · Scala · Spark +8