Data Engineering Jobs

GCS · London · £600 – £850 pd

Hands-on contract role building and optimising enterprise-scale data pipelines with Python, Databricks, PySpark and SQL, including Delta Lake and Lakehouse architectures. You will design ETL/ELT solutions, tune distributed workloads, implement data quality controls and mentor junior engineers within an Agile banking data function.

Hays Technology · London · £100,000 – £110,000 pa

Hands-on role building the backend services, APIs and data integrations behind a new AI layer for an investment management platform. Involves LLM application work such as agent workflows, tool use and RAG, plus security controls, automated tests and AI evaluations, monitoring accuracy, latency and cost in production. Works alongside a Frontend Engineer and product colleagues, releasing iteratively.

Interface Recruitment · Leeds

Lead the design, build and optimisation of scalable data pipelines and platforms supporting analytics, reporting, AI and machine learning in a regulated asset manager. Sets data engineering standards, mentors engineers, and ensures solutions meet security, governance, quality and resilience requirements, working hybrid in Leeds.

Artis Recruitment · Bristol · £80,000 – £85,000 pa

Lead a team of data engineers while staying hands-on with complex data challenges, providing technical direction and coaching. Drive the migration and modernisation of legacy platforms into a Databricks lakehouse environment, building pipelines, models and curated datasets, and championing engineering best practice within Agile delivery.

EF Recruitment · London · £250 – £260 pd

Joins a global SaaS client's Customer Success Data Science team on a 10-month contract, building data pipelines, metric definitions and governance with engineering. Creates scalable dashboards, runs root-cause and A/B test analysis, and applies Gen AI tools to automate insight generation and anomaly detection. Hybrid role with three days a week in the London office.

Synapri · London · £460 – £470 pd

Hands-on role building and optimising scalable ETL/ELT pipelines with Databricks, Python, SQL and Oracle, supporting migration of legacy data assets into modern cloud platforms for a large banking organisation. Delivered through a consultancy on a major data transformation and cloud modernisation programme, with work in a highly regulated environment covering data quality, performance and production support.

Vaerdi Recruitment Limited · London · £750 pd

Hands-on lead architecture role shaping data architecture for a major financial services technology programme. Involves designing scalable, distributed data solutions, developing complex data models, and applying Domain-Driven Design, with heavy use of NoSQL technologies, particularly Cassandra. Provides architectural direction while remaining technically hands-on, working closely with technical teams.

Palantir Technologies · New York, United States · US$145,000 – US$155,000 pa

Works deep inside the data processing infrastructure behind Palantir Foundry, covering query plan optimization, operator execution, and efficient data reads and writes. Extends open-source engines and table formats including Apache Spark, DataFusion, and Iceberg, taking changes through design, code review, testing, and release. Correctness, compatibility, and predictable performance are central to the work.

hireful · West Yorkshire · £80,000 – £90,000 pa

Owns the design and build of scalable data pipelines and data products on Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT optimisation and enterprise data architecture. Partners with Finance, Product, Sales, Marketing and Engineering to enable trusted self-service data, embeds governance and quality, and mentors a junior engineer in a small, high-impact team.

ClickHouse · United Kingdom

Leads the team building and operating ClickHouse Managed Postgres, owning provisioning, high availability, backup and recovery, upgrades, observability, performance and security. Combines people leadership, technical direction and product thinking, partnering with Product, Design, Infrastructure and Security across a distributed organisation. Also involves hiring and coaching engineers and working directly with customers.

Noir · London · £60,000 – £80,000 pa

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role in London supporting client data engineering and integration engagements.

Grafana Labs · United Kingdom · £123,000 – £148,000 pa

Customer-facing product expert partnering with Sales to run demos, technical evaluations and enablement for Grafana Cloud prospects. Owns the technical engagement to close complex observability deals, feeding customer insight back to Product and Engineering. Requires 5+ years of technical pre-sales and UK location.

WeDoTech · London · £100,000 – £140,000 pa

Hands-on Staff-level role leading a large-scale data engineering modernisation, migrating thousands of pipelines across AWS. You'll stay deeply technical in Python, PySpark and Spark, shape scalable frameworks and standards, and champion AI-assisted development across multiple engineering teams.

WeDoTech · London · £120,000 – £150,000 pa

Senior architectural role shaping enterprise-scale data architecture across AWS during a major modernisation programme. You will define standards and reusable patterns, design batch and streaming solutions, and guide engineering teams on Spark, PySpark, AWS Glue and Airflow while influencing senior stakeholders in a regulated environment.

Elastic · United Kingdom

Consulting architect delivering Elasticsearch and Lucene solutions to UK public sector clients, combining hands-on solution design, data modelling, cluster tuning and proof-of-concept development with strategic stakeholder engagement at senior government levels. Requires existing or obtainable UK security clearance and involves a high percentage of on-site customer work and travel.