Data Engineering Jobs

Harnham - Data and Analytics Recruitment · London · £75,000 – £85,000 pa

Owns the infrastructure, deployment and operational excellence of production machine learning systems within a growing AI function. Builds ML orchestration pipelines with Dagster, Airflow or Prefect, runs Kubernetes and Terraform/Bicep infrastructure, and maintains CI/CD and observability for models and LLM-powered services. Works closely with data scientists, engineers and client-facing teams, and influences platform standards.

Harnham - Data and Analytics Recruitment · London · £65,000 – £75,000 pa

Technical lead for a modern cloud data platform at a major cultural organisation, designing and building a Microsoft Fabric Lakehouse with Medallion-architecture pipelines and semantic layers. Defines engineering standards and governance, mentors a small data engineering team, and partners with stakeholders to enable Power BI analytics and future AI initiatives.

Palantir Technologies · London

Builds the lowest layers of Palantir's Foundry and Gotham platforms, spanning database technologies, distributed systems, large-scale data, security and application infrastructure. Work includes designing opinionated APIs, tracing performance in high-scale microservice architectures, and automating systems like Cassandra, Elasticsearch and Kafka.

R3vamp · Milton Keynes · £65,000 – £75,000 pa

You'll lead the Data & MI team and own the organisation's Business Intelligence capability, driving the migration from legacy Cognos reporting to a modern Microsoft Azure environment. The role combines hands-on work with Power BI, Azure Data Lake, Databricks and SQL with data governance, mentoring and translating business requirements into insight for Finance and senior stakeholders.

Circle Recruitment · Leeds · £100,000 – £120,000 pa

Lead a law firm's enterprise, technology and data architecture, owning principles, standards, roadmaps and design governance. Shape strategy, security and responsible AI adoption while managing Solutions Architects, Consultants and Data Architects, with two days a week in the Leeds office.

Intec Select · London · £94,000 pa

Senior strategic role leading data linkage, data architecture and digital technology initiatives across the UK health data ecosystem. Involves evaluating emerging technologies, shaping technical standards and investment priorities, and building partnerships with research, government and funding bodies. Combines technical leadership with external representation and matrix management of multidisciplinary programmes.

Circle Recruitment · Dudley · £65,000 – £85,000 pa

Technical owner of a Microsoft Fabric data platform, building and maintaining data lakes, pipelines and ETL/ELT processes from APIs, flat files and ERP systems. Works with Finance, Commercial and BI teams to deliver scalable reporting while bringing data engineering knowledge in-house during a major Fabric migration.

eFinancialCareers · London · £45,000 – £70,000 pa

Design, build and maintain scalable data pipelines and cloud-based data platforms on AWS, working with data architects, scientists and analysts to turn complex data into reliable, accessible information. Combines hands-on engineering with technical leadership, shaping data solutions and guiding delivery across national security, government and public-sector environments.

Avanti Recruitment · Manchester · £60,000 – £100,000 pa

End-to-end data architecture role owning the full data lifecycle, from ingestion to consumption, across secure client environments. Involves designing lakehouse and medallion architectures, defining batch and streaming pipelines, and making decisions on storage, orchestration, governance and security. Cloud-agnostic, working with AWS, Azure or GCP alongside Databricks, Snowflake, Spark and Kafka.

Opus Recruitment Solutions · London · £500 – £525 pd

Hands-on contract role migrating a large legacy ETL estate of several thousand Ab Initio batch jobs to a serverless AWS data platform. You'll define migration patterns, convert Ab Initio transformations into scalable PySpark, and deliver production-ready AWS Glue solutions, with heavy Spark performance tuning across S3, Athena and serverless pipelines in a financial services cloud transformation programme.

SGN · Portsmouth

Oversee the full lifecycle of data projects, from stakeholder engagement and data collection through transformation to final delivery, acting as the primary point of contact for delivery. Lead a delivery silo or large project within a team of business analysts, data engineers, analysts and testers, managing E2E data migration including ETL and reconciliation, and driving Agile practices and Jira-based reporting.

eFinancialCareers · London

Lead the strategy, architecture and hands-on engineering of a cross-asset market data platform spanning crypto and traditional markets, including a central Market Data API, low-latency feed handlers and a firm-wide messaging layer. Manage a small development team while owning vendor relationships, data quality, cost control and regulatory entitlements across a hybrid on-premise and cloud environment.

Ashdown Group · London · £120,000 – £150,000 pa

Owns the enterprise data architecture, engineering strategy and cloud data platform, setting the technical roadmap and leading a data engineering function. Drives DataOps, CI/CD, observability and governance while building foundations for AI/ML, vector search and advanced analytics, partnering with Product, Data Science and senior leadership.

Tenth Revolution Group · London · £85,000 – £115,000 pa

Lead architecture and technical strategy for enterprise-scale Databricks programmes, designing Lakehouse solutions on Azure and overseeing engineering delivery, quality and governance. The role combines hands-on Databricks expertise with mentoring data engineers and shaping roadmaps with senior stakeholders, spanning analytics, ML and GenAI workloads.

Cedar · London · £65,000 – £70,000 pa

Hands-on role acting as OneStream SME, supporting system development, optimisation and governance, and contributing to implementation projects from a Finance perspective. Works across OneStream, NetSuite, Databricks, Navan and Power BI, covering consolidation, reporting, planning, data mapping, reconciliation and master data. Suits a qualified accountant combining Finance, Systems, Data and Transformation in a PE-backed business.