Data Engineering Jobs

GCS · London · £600 – £850 pd

Hands-on contract role building and optimising enterprise-scale data pipelines with Python, Databricks, PySpark and SQL, including Delta Lake and Lakehouse architectures. You will design ETL/ELT solutions, tune distributed workloads, implement data quality controls and mentor junior engineers within an Agile banking data function.

Hays Technology · London · £100,000 – £110,000 pa

Hands-on role building the backend services, APIs and data integrations behind a new AI layer for an investment management platform. Involves LLM application work such as agent workflows, tool use and RAG, plus security controls, automated tests and AI evaluations, monitoring accuracy, latency and cost in production. Works alongside a Frontend Engineer and product colleagues, releasing iteratively.

Interface Recruitment · Leeds

Lead the design, build and optimisation of scalable data pipelines and platforms supporting analytics, reporting, AI and machine learning in a regulated asset manager. Sets data engineering standards, mentors engineers, and ensures solutions meet security, governance, quality and resilience requirements, working hybrid in Leeds.

EF Recruitment · London · £250 – £260 pd

Joins a global SaaS client's Customer Success Data Science team on a 10-month contract, building data pipelines, metric definitions and governance with engineering. Creates scalable dashboards, runs root-cause and A/B test analysis, and applies Gen AI tools to automate insight generation and anomaly detection. Hybrid role with three days a week in the London office.

Synapri · London · £460 – £470 pd

Hands-on role building and optimising scalable ETL/ELT pipelines with Databricks, Python, SQL and Oracle, supporting migration of legacy data assets into modern cloud platforms for a large banking organisation. Delivered through a consultancy on a major data transformation and cloud modernisation programme, with work in a highly regulated environment covering data quality, performance and production support.

Socium Recruitment · Manchester · £90,000 – £100,000 pa

Owns the data engineering strategy, architecture and roadmap for an established online business, leading a team of ten through a migration from on-prem SQL to Azure. Sets engineering standards across data modelling, pipelines, governance and automated deployments, and makes the calls on tooling, budget and suppliers while reporting into the C-suite. Microsoft Fabric adoption and practical AI use are open questions the role holder will shape.

Palantir Technologies · New York, United States · US$145,000 – US$155,000 pa

Works deep inside the data processing infrastructure behind Palantir Foundry, covering query plan optimization, operator execution, and efficient data reads and writes. Extends open-source engines and table formats including Apache Spark, DataFusion, and Iceberg, taking changes through design, code review, testing, and release. Correctness, compatibility, and predictable performance are central to the work.

Noir · London · £60,000 – £80,000 pa

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role in London supporting client data engineering and integration engagements.

WeDoTech · London · £120,000 – £150,000 pa

Senior architectural role shaping enterprise-scale data architecture across AWS during a major modernisation programme. You will define standards and reusable patterns, design batch and streaming solutions, and guide engineering teams on Spark, PySpark, AWS Glue and Airflow while influencing senior stakeholders in a regulated environment.

Elastic · United Kingdom

Consulting architect delivering Elasticsearch and Lucene solutions to UK public sector clients, combining hands-on solution design, data modelling, cluster tuning and proof-of-concept development with strategic stakeholder engagement at senior government levels. Requires existing or obtainable UK security clearance and involves a high percentage of on-site customer work and travel.

McGregor Boyall · London · £750 – £850 pd

Senior architecture role on a large-scale modernisation programme across a Custody and Securities Services platform, covering Securities Settlements, Corporate Actions, Transaction Management, Tax Processing and Cash & FX. You act as technical authority within delivery teams, designing microservices and event-driven architectures with Kafka, REST APIs and cloud, leading governance, NFRs and technical debt management, and building PoCs including Generative AI.

Harvey Nash · London · £800 – £850 pd

Designs scalable, resilient solutions across custody and securities services domains including settlements, asset servicing, transaction management, tax and cash/FX processing. Works with engineering teams, technology leaders and business stakeholders on a major technology modernisation programme, covering solution architecture, event-driven design, data/cloud and architecture governance.

Picture More · London · £100,000 – £120,000 pa

Design-led architecture role owning target-state integration and data flows across legal platforms such as Elite 3E Cloud and Intapp Cloud, plus the Microsoft and Azure estate. You design interfaces, APIs and reconciliation patterns, assure delivery by internal and third-party teams, and present designs to the business, advising on AI and legal technology standards.

Comtecs · London · £90,000 – £110,000 pa

Owns the target-state integration architecture across iManage Cloud, Elite 3E Cloud, Intapp Cloud and Microsoft 365/Azure, defining integration patterns, APIs and data flows between document, practice management, finance, risk and time systems. Also sets data architecture, governance and lifecycle standards, designs Azure IaaS/PaaS and hybrid solutions, and provides architectural leadership to internal teams and vendors.

Coburg Banks · London · £75,000 – £90,000 pa

Hands-on role building and maintaining data pipelines that ingest, clean and standardise transport data from APIs, GIS files and spreadsheets. You will design spatial models in PostgreSQL/PostGIS covering parking bays, traffic restrictions and congestion zones, and develop geofencing and location-recognition models, with occasional field verification via GNSS surveys across London.