Data Engineering Jobs

Palantir Technologies · London

Works deep inside the data processing infrastructure behind Palantir Foundry, on how computations are represented, query plans optimised, operators executed, and data read and written efficiently. Builds on and extends Apache Spark, DataFusion and Iceberg, taking on production problems such as writing planning rules or speeding up large table scans through design, code review, testing and release.

Palantir Technologies · London · US$10,500 pm

Works deep inside the data processing infrastructure behind Foundry, covering query plan optimisation, execution operators, and efficient data reads and writes. Extends open-source engines and table formats such as Apache Spark, DataFusion, and Iceberg, with work spanning design, code review, testing, and release. An internship aimed at students graduating in 2028.

Rise Technical Recruitment · London · £35,000 – £50,000 pa

Hands-on role developing and maintaining software with Python, Go and TypeScript, processing and validating live and historical sports datasets, and supporting AWS cloud infrastructure and production systems. Works closely with experienced engineers on SQL databases, troubleshooting and technical projects within the sports and betting sector.

Circle Recruitment · Dudley · £65,000 – £85,000 pa

Technical owner of a Microsoft Fabric data platform, building and maintaining data pipelines, ETL/ELT processes and integrations from APIs, flat files and ERP systems. Works with Finance, Commercial and BI teams to shape data architecture during a major Fabric migration, with Databricks, Azure data lakes and warehousing in the stack.

Harnham - Data and Analytics Recruitment · Oxford · £65,000 – £75,000 pa

Lead the development of a greenfield AWS capability while supporting an existing Azure estate, acting as the AWS subject matter expert. Hands-on work spans architecture, Landing Zones, governance, Terraform IaC, CI/CD pipelines with GitHub Actions and Azure DevOps, plus automation, security and mentoring junior engineers.

Deerfoot Recruitment Solutions · United Kingdom · £90,000 – £115,000 pa

Designs and delivers secure, scalable cloud-native data platforms across AWS, Azure and GCP for enterprise clients, leading migrations to Snowflake, Databricks, BigQuery, Synapse and Redshift. Builds PoCs and MVPs for AI and advanced analytics, automates infrastructure with Terraform and CI/CD, and advises senior stakeholders on data strategy, Data Mesh and Data Fabric architecture.

Harnham - Data and Analytics Recruitment · London · £100,000 – £120,000 pa

Own the design, build and delivery of a modern enterprise cloud data platform for a large UK financial services organisation, leading migration off legacy environments. Responsibilities span platform strategy and architecture, building and scaling a data engineering function, supplier management, and embedding governance, security and data quality standards in a regulated setting.

Matillion · Hyderabad, India

You'll work in a small cross-functional team writing, testing and releasing new features and fixing problems across Matillion's data automation products, from design through CI/CD deployment to ongoing production support. The stack spans Java, Spring microservices, React, GraphQL, Docker, Kubernetes and AWS, with code reviews, research projects and mentoring built into the role.

Tenth Revolution Group · London · £70,000 – £85,000 pa

Builds and maintains scalable data pipelines in Databricks, developing batch and streaming workflows and designing Lakehouse architectures with medallion models. Works alongside data scientists, analysts and product teams in a cloud-first Azure environment, implementing data quality, governance and observability frameworks while driving engineering best practice through code reviews.

Tenth Revolution Group · London · £90,000 – £120,000 pa

Lead the strategy, design and evolution of a large-scale cloud data and integration ecosystem, owning enterprise-wide platform architecture, standards and best practices. Drive modernisation roadmaps across data, integration and platform engineering, designing event-driven and streaming architectures while shaping CI/CD, automation and infrastructure-as-code strategies. Work with senior stakeholders across Azure, AWS or GCP, Snowflake and Kubernetes.

TEKsystems · London · £300 – £370 pd

Documents and redesigns a complex, high-volume transactional platform for a large payments company, producing conceptual, logical and physical data models and defining data standards. Works closely with developers and engineers to implement OLTP and system-of-record database architecture, with a focus on relational technologies such as PostgreSQL, Oracle or SQL Server.

Noir · Manchester · £60,000 – £75,000 pa

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role in Manchester supporting client data engineering and integration engagements.

Noir · Birmingham · £60,000 – £75,000 pa

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role in Birmingham supporting client data engineering and integration engagements.

Data Idols · London · £500 – £650 pd

Design, develop and optimise scalable data pipelines and cloud-based data warehousing solutions, improving platform performance, reliability and scalability. Work with Data and Analytics Engineers on ETL/ELT processes, data architecture and reusable data solutions, with GCP and BigQuery highly desirable alongside Python and SQL.

Fuel Recruitment · Farnborough · £550 – £600 pd

Build and optimise cloud-based data integration and analytics solutions for a defence-sector client, focusing on scalable ETL pipelines, data lakes and processing frameworks in AWS. Day-to-day work centres on AWS Glue jobs using PySpark and Python, Glue Data Catalog, crawlers, workflows and triggers, plus S3 data lake management and IAM security. Three roles, outside IR35, with three days a week onsite.