Data Engineering Jobs

Synapri · London · £460 – £470 pd

Hands-on role building and optimising scalable ETL/ELT pipelines with Databricks, Python, SQL and Oracle, supporting migration of legacy data assets into modern cloud platforms for a large banking organisation. Delivered through a consultancy on a major data transformation and cloud modernisation programme, with work in a highly regulated environment covering data quality, performance and production support.

Socium Recruitment · Manchester · £90,000 – £100,000 pa

Owns the data engineering strategy, architecture and roadmap for an established online business, leading a team of ten through a migration from on-prem SQL to Azure. Sets engineering standards across data modelling, pipelines, governance and automated deployments, and makes the calls on tooling, budget and suppliers while reporting into the C-suite. Microsoft Fabric adoption and practical AI use are open questions the role holder will shape.

Palantir Technologies · New York, United States · US$145,000 – US$155,000 pa

Works deep inside the data processing infrastructure behind Palantir Foundry, covering query plan optimization, operator execution, and efficient data reads and writes. Extends open-source engines and table formats including Apache Spark, DataFusion, and Iceberg, taking changes through design, code review, testing, and release. Correctness, compatibility, and predictable performance are central to the work.

Noir · London · £60,000 – £80,000 pa

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role in London supporting client data engineering and integration engagements.

WeDoTech · London · £120,000 – £150,000 pa

Senior architectural role shaping enterprise-scale data architecture across AWS during a major modernisation programme. You will define standards and reusable patterns, design batch and streaming solutions, and guide engineering teams on Spark, PySpark, AWS Glue and Airflow while influencing senior stakeholders in a regulated environment.

McGregor Boyall · London · £750 – £850 pd

Senior architecture role on a large-scale modernisation programme across a Custody and Securities Services platform, covering Securities Settlements, Corporate Actions, Transaction Management, Tax Processing and Cash & FX. You act as technical authority within delivery teams, designing microservices and event-driven architectures with Kafka, REST APIs and cloud, leading governance, NFRs and technical debt management, and building PoCs including Generative AI.

Harvey Nash · London · £800 – £850 pd

Designs scalable, resilient solutions across custody and securities services domains including settlements, asset servicing, transaction management, tax and cash/FX processing. Works with engineering teams, technology leaders and business stakeholders on a major technology modernisation programme, covering solution architecture, event-driven design, data/cloud and architecture governance.

Picture More · London · £100,000 – £120,000 pa

Design-led architecture role owning target-state integration and data flows across legal platforms such as Elite 3E Cloud and Intapp Cloud, plus the Microsoft and Azure estate. You design interfaces, APIs and reconciliation patterns, assure delivery by internal and third-party teams, and present designs to the business, advising on AI and legal technology standards.

Comtecs · London · £90,000 – £110,000 pa

Owns the target-state integration architecture across iManage Cloud, Elite 3E Cloud, Intapp Cloud and Microsoft 365/Azure, defining integration patterns, APIs and data flows between document, practice management, finance, risk and time systems. Also sets data architecture, governance and lifecycle standards, designs Azure IaaS/PaaS and hybrid solutions, and provides architectural leadership to internal teams and vendors.

Coburg Banks · London · £75,000 – £90,000 pa

Hands-on role building and maintaining data pipelines that ingest, clean and standardise transport data from APIs, GIS files and spreadsheets. You will design spatial models in PostgreSQL/PostGIS covering parking bays, traffic restrictions and congestion zones, and develop geofencing and location-recognition models, with occasional field verification via GNSS surveys across London.

Palantir Technologies · London

Works deep inside the data processing infrastructure behind Palantir Foundry, on how computations are represented, query plans optimised, operators executed, and data read and written efficiently. Builds on and extends Apache Spark, DataFusion and Iceberg, taking on production problems such as writing planning rules or speeding up large table scans through design, code review, testing and release.

Rise Technical Recruitment · London · £35,000 – £50,000 pa

Hands-on role developing and maintaining software with Python, Go and TypeScript, processing and validating live and historical sports datasets, and supporting AWS cloud infrastructure and production systems. Works closely with experienced engineers on SQL databases, troubleshooting and technical projects within the sports and betting sector.

Circle Recruitment · Dudley · £65,000 – £85,000 pa

Technical owner of a Microsoft Fabric data platform, building and maintaining data pipelines, ETL/ELT processes and integrations from APIs, flat files and ERP systems. Works with Finance, Commercial and BI teams to shape data architecture during a major Fabric migration, with Databricks, Azure data lakes and warehousing in the stack.

Harnham - Data and Analytics Recruitment · Oxford · £65,000 – £75,000 pa

Lead the development of a greenfield AWS capability while supporting an existing Azure estate, acting as the AWS subject matter expert. Hands-on work spans architecture, Landing Zones, governance, Terraform IaC, CI/CD pipelines with GitHub Actions and Azure DevOps, plus automation, security and mentoring junior engineers.

Deerfoot Recruitment Solutions · United Kingdom · £90,000 – £115,000 pa

Designs and delivers secure, scalable cloud-native data platforms across AWS, Azure and GCP for enterprise clients, leading migrations to Snowflake, Databricks, BigQuery, Synapse and Redshift. Builds PoCs and MVPs for AI and advanced analytics, automates infrastructure with Terraform and CI/CD, and advises senior stakeholders on data strategy, Data Mesh and Data Fabric architecture.