Data Engineering Jobs

Socium Recruitment · Manchester · £90,000 – £100,000 pa

Owns the data engineering strategy, architecture and roadmap for an established online business, leading a team of ten through a migration from on-prem SQL to Azure. Sets engineering standards across data modelling, pipelines, governance and automated deployments, and makes the calls on tooling, budget and suppliers while reporting into the C-suite. Microsoft Fabric adoption and practical AI use are open questions the role holder will shape.

Palantir Technologies · New York, United States · US$145,000 – US$155,000 pa

Works deep inside the data processing infrastructure behind Palantir Foundry, covering query plan optimization, operator execution, and efficient data reads and writes. Extends open-source engines and table formats including Apache Spark, DataFusion, and Iceberg, taking changes through design, code review, testing, and release. Correctness, compatibility, and predictable performance are central to the work.

hireful · West Yorkshire · £80,000 – £90,000 pa

Owns the design and build of scalable data pipelines and data products on Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT optimisation and enterprise data architecture. Partners with Finance, Product, Sales, Marketing and Engineering to enable trusted self-service data, embeds governance and quality, and mentors a junior engineer in a small, high-impact team.

ClickHouse · United Kingdom

Leads the team building and operating ClickHouse Managed Postgres, owning provisioning, high availability, backup and recovery, upgrades, observability, performance and security. Combines people leadership, technical direction and product thinking, partnering with Product, Design, Infrastructure and Security across a distributed organisation. Also involves hiring and coaching engineers and working directly with customers.

Noir · London · £60,000 – £80,000 pa

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role in London supporting client data engineering and integration engagements.

Grafana Labs · United Kingdom · £123,000 – £148,000 pa

Customer-facing product expert partnering with Sales to run demos, technical evaluations and enablement for Grafana Cloud prospects. Owns the technical engagement to close complex observability deals, feeding customer insight back to Product and Engineering. Requires 5+ years of technical pre-sales and UK location.

WeDoTech · London · £120,000 – £150,000 pa

Senior architectural role shaping enterprise-scale data architecture across AWS during a major modernisation programme. You will define standards and reusable patterns, design batch and streaming solutions, and guide engineering teams on Spark, PySpark, AWS Glue and Airflow while influencing senior stakeholders in a regulated environment.

Elastic · United Kingdom

Consulting architect delivering Elasticsearch and Lucene solutions to UK public sector clients, combining hands-on solution design, data modelling, cluster tuning and proof-of-concept development with strategic stakeholder engagement at senior government levels. Requires existing or obtainable UK security clearance and involves a high percentage of on-site customer work and travel.

McGregor Boyall · London · £750 – £850 pd

Senior architecture role on a large-scale modernisation programme across a Custody and Securities Services platform, covering Securities Settlements, Corporate Actions, Transaction Management, Tax Processing and Cash & FX. You act as technical authority within delivery teams, designing microservices and event-driven architectures with Kafka, REST APIs and cloud, leading governance, NFRs and technical debt management, and building PoCs including Generative AI.

Harvey Nash · London · £800 – £850 pd

Designs scalable, resilient solutions across custody and securities services domains including settlements, asset servicing, transaction management, tax and cash/FX processing. Works with engineering teams, technology leaders and business stakeholders on a major technology modernisation programme, covering solution architecture, event-driven design, data/cloud and architecture governance.

Picture More · London · £100,000 – £120,000 pa

Design-led architecture role owning target-state integration and data flows across legal platforms such as Elite 3E Cloud and Intapp Cloud, plus the Microsoft and Azure estate. You design interfaces, APIs and reconciliation patterns, assure delivery by internal and third-party teams, and present designs to the business, advising on AI and legal technology standards.

Comtecs · London · £90,000 – £110,000 pa

Owns the target-state integration architecture across iManage Cloud, Elite 3E Cloud, Intapp Cloud and Microsoft 365/Azure, defining integration patterns, APIs and data flows between document, practice management, finance, risk and time systems. Also sets data architecture, governance and lifecycle standards, designs Azure IaaS/PaaS and hybrid solutions, and provides architectural leadership to internal teams and vendors.

Coburg Banks · London · £75,000 – £90,000 pa

Hands-on role building and maintaining data pipelines that ingest, clean and standardise transport data from APIs, GIS files and spreadsheets. You will design spatial models in PostgreSQL/PostGIS covering parking bays, traffic restrictions and congestion zones, and develop geofencing and location-recognition models, with occasional field verification via GNSS surveys across London.

First Military Recruitment · United Kingdom

Leads the design and implementation of complex data flows, pipelines and integrations to support an enterprise AI buildout, setting data engineering best practices and ensuring data readiness and security. Bridges technical engineering partners and business leads, translating data risks into clear choices for stakeholders. Requires SC clearance and works remotely on a contract until 30/04/2027.

Palantir Technologies · London

Works deep inside the data processing infrastructure behind Palantir Foundry, on how computations are represented, query plans optimised, operators executed, and data read and written efficiently. Builds on and extends Apache Spark, DataFusion and Iceberg, taking on production problems such as writing planning rules or speeding up large table scans through design, code review, testing and release.