Data Engineering Jobs

Harnham - Data and Analytics Recruitment · London · £80,000 – £100,000 pa

Builds internal AI agents, tools and prototypes within a small central technical team, turning complex group data into usable products. Work spans Python, TypeScript and SQL, modernising legacy systems, wrapping them in scalable APIs and generating tests and migration tooling. High autonomy with weekly demonstrable output.

Harnham - Data and Analytics Recruitment · London · £60,000 – £65,000 pa

Own enterprise and project-level data architecture for a UK health-sector regulator, driving data modelling, governance and lineage across a Microsoft stack including Azure, Fabric and D365. Work with engineering, governance and business teams to deliver scalable data solutions and champion best practice.

Circle Recruitment · Dudley · £65,000 – £85,000 pa

Technical owner of a Microsoft Fabric data platform, building and maintaining data lakes, pipelines and ETL/ELT processes from APIs, flat files and ERP systems. Works with Finance, Commercial and BI teams to deliver scalable reporting while bringing data engineering knowledge in-house during a major Fabric migration.

eFinancialCareers · London · £45,000 – £70,000 pa

Design, build and maintain scalable data pipelines and cloud-based data platforms on AWS, working with data architects, scientists and analysts to turn complex data into reliable, accessible information. Combines hands-on engineering with technical leadership, shaping data solutions and guiding delivery across national security, government and public-sector environments.

Avanti Recruitment · Manchester · £60,000 – £100,000 pa

End-to-end data architecture role owning the full data lifecycle, from ingestion to consumption, across secure client environments. Involves designing lakehouse and medallion architectures, defining batch and streaming pipelines, and making decisions on storage, orchestration, governance and security. Cloud-agnostic, working with AWS, Azure or GCP alongside Databricks, Snowflake, Spark and Kafka.

Opus Recruitment Solutions · London · £500 – £525 pd

Hands-on contract role migrating a large legacy ETL estate of several thousand Ab Initio batch jobs to a serverless AWS data platform. You'll define migration patterns, convert Ab Initio transformations into scalable PySpark, and deliver production-ready AWS Glue solutions, with heavy Spark performance tuning across S3, Athena and serverless pipelines in a financial services cloud transformation programme.

SGN · Portsmouth

Oversee the full lifecycle of data projects, from stakeholder engagement and data collection through transformation to final delivery, acting as the primary point of contact for delivery. Lead a delivery silo or large project within a team of business analysts, data engineers, analysts and testers, managing E2E data migration including ETL and reconciliation, and driving Agile practices and Jira-based reporting.

Tenth Revolution Group · London · £85,000 – £115,000 pa

Lead architecture and technical strategy for enterprise-scale Databricks programmes, designing Lakehouse solutions on Azure and overseeing engineering delivery, quality and governance. The role combines hands-on Databricks expertise with mentoring data engineers and shaping roadmaps with senior stakeholders, spanning analytics, ML and GenAI workloads.

Cedar · London · £65,000 – £70,000 pa

Hands-on role acting as OneStream SME, supporting system development, optimisation and governance, and contributing to implementation projects from a Finance perspective. Works across OneStream, NetSuite, Databricks, Navan and Power BI, covering consolidation, reporting, planning, data mapping, reconciliation and master data. Suits a qualified accountant combining Finance, Systems, Data and Transformation in a PE-backed business.

Akkodis · Stevenage

Design and deliver end-to-end data engineering solutions, building scalable ETL/ELT and streaming pipelines and optimising warehouses, lakehouses and reporting. Create Power BI dashboards and drive data governance, quality and DataOps automation with CI/CD and containerised deployments, partnering with engineering, manufacturing and supply chain stakeholders.

Datatech · Berkshire · £55,000 – £67,000 pa

Owns the end-to-end data journey for a financial services business, building Azure Databricks pipelines with PySpark, SQL, ADF and ADLS Gen2, and governed lakehouse solutions using Delta Lake, medallion architecture and Unity Catalog. Also owns Power BI semantic models, DAX measures and row-level security, translating marketing and contact-centre requirements into trusted metrics while mentoring colleagues and improving engineering standards.

Palantir Technologies · New York, United States

Builds the tools and interfaces within Palantir Foundry that let users create data-intensive applications, architecting state management, access patterns and APIs. Works closely with users, designers and backend engineers, and may join a short-term embedded Frontline rotation with customers.

Palantir Technologies · New York, United States

Builds the lowest layers of Palantir's Foundry and Gotham platforms, working on database technologies, distributed systems, large-scale data, security and application infrastructure. Engineers design opinionated APIs, automate systems like Cassandra, Kafka and Kubernetes, and may join a short-term Frontline rotation embedded with customers.

Oliver James · East Sussex · £70,000 – £75,000 pa

Owns business-critical MI including legacy Excel/VBA reporting, then modernises it into governed Power BI, Power Query and Power Automate solutions. Supports a data platform programme introducing Databricks, Ataccama and Timbr, focusing on data validation and mapping, and acts as a senior voice coaching colleagues in a team of eight.

Salt Search · London · £70,000 – £100,000 pa

Administer, maintain and optimise Linux server environments across production and development platforms, managing VMware vSphere/ESXi infrastructure and building automation with Ansible and Bash. The role sits in a specialist security team supporting a secure, large-scale big data platform for a UK critical national infrastructure programme, using DevOps methodologies to deliver continuous improvements. It is predominantly on-site and requires active DV clearance.