Data Engineering Jobs

Databricks · United Kingdom

Owns and grows Databricks' public sector business across the Republic of Ireland and Scotland, inheriting an established book of strategic government accounts. Runs a consumption-led sales motion, building an Ireland-wide go-to-market plan, expanding platform usage, and pursuing net-new departments and agencies with cloud and partner co-sell teams.

Databricks · London

Hands-on technical leader who guides a small team of around five engineers while staying deep in the engineering work, driving architecture, design and code on the hardest problems. The team builds Lakebase, a managed Postgres transactional layer, across areas such as platform reliability, the network proxy data path, or distributed storage in Rust.

VIQU IT · London · £85,000 – £90,000 pa

Player-manager role leading the Data Engineering function, defining standards, tooling and team structure while personally delivering complex pipeline work. You'll manage and mentor data engineers, own data infrastructure, and build high-performance ETL/ELT pipelines across operational, analytical and AI layers using SQL, Python and cloud platforms. Also drives AI tooling adoption and CI/CD for data pipelines.

Interface Recruitment · Leeds

Lead the design, build and optimisation of scalable data pipelines and platforms supporting analytics, reporting, AI and machine learning in a regulated asset manager. Sets data engineering standards, mentors engineers, and ensures solutions meet security, governance, quality and resilience requirements, working hybrid in Leeds.

Artis Recruitment · Bristol · £80,000 – £85,000 pa

Lead a team of data engineers while staying hands-on with complex data challenges, providing technical direction and coaching. Drive the migration and modernisation of legacy platforms into a Databricks lakehouse environment, building pipelines, models and curated datasets, and championing engineering best practice within Agile delivery.

EF Recruitment · London · £250 – £260 pd

Joins a global SaaS client's Customer Success Data Science team on a 10-month contract, building data pipelines, metric definitions and governance with engineering. Creates scalable dashboards, runs root-cause and A/B test analysis, and applies Gen AI tools to automate insight generation and anomaly detection. Hybrid role with three days a week in the London office.

Synapri · London · £460 – £470 pd

Hands-on role building and optimising scalable ETL/ELT pipelines with Databricks, Python, SQL and Oracle, supporting migration of legacy data assets into modern cloud platforms for a large banking organisation. Delivered through a consultancy on a major data transformation and cloud modernisation programme, with work in a highly regulated environment covering data quality, performance and production support.

Vaerdi Recruitment Limited · London · £750 pd

Hands-on lead architecture role shaping data architecture for a major financial services technology programme. Involves designing scalable, distributed data solutions, developing complex data models, and applying Domain-Driven Design, with heavy use of NoSQL technologies, particularly Cassandra. Provides architectural direction while remaining technically hands-on, working closely with technical teams.

Palantir Technologies · New York, United States · US$145,000 – US$155,000 pa

Works deep inside the data processing infrastructure behind Palantir Foundry, covering query plan optimization, operator execution, and efficient data reads and writes. Extends open-source engines and table formats including Apache Spark, DataFusion, and Iceberg, taking changes through design, code review, testing, and release. Correctness, compatibility, and predictable performance are central to the work.

hireful · West Yorkshire · £80,000 – £90,000 pa

Owns the design and build of scalable data pipelines and data products on Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT optimisation and enterprise data architecture. Partners with Finance, Product, Sales, Marketing and Engineering to enable trusted self-service data, embeds governance and quality, and mentors a junior engineer in a small, high-impact team.

Forsyth Barnes · United Kingdom · £50,000 – £65,000 pa

Hands-on role designing, building and scaling an AWS-native data platform, migrating data from a large on-premise estate into the cloud. Involves building ingestion frameworks using CDC, event-driven and batch patterns, ETL/ELT with Python and SQL, plus data modelling, governance and observability. Also provides technical leadership and mentoring while remaining hands-on.

ClickHouse · United Kingdom

Leads the team building and operating ClickHouse Managed Postgres, owning provisioning, high availability, backup and recovery, upgrades, observability, performance and security. Combines people leadership, technical direction and product thinking, partnering with Product, Design, Infrastructure and Security across a distributed organisation. Also involves hiring and coaching engineers and working directly with customers.

Noir · London · £60,000 – £80,000 pa

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role in London supporting client data engineering and integration engagements.

Grafana Labs · United Kingdom · £123,000 – £148,000 pa

Customer-facing product expert partnering with Sales to run demos, technical evaluations and enablement for Grafana Cloud prospects. Owns the technical engagement to close complex observability deals, feeding customer insight back to Product and Engineering. Requires 5+ years of technical pre-sales and UK location.

WeDoTech · London · £100,000 – £140,000 pa

Hands-on Staff-level role leading a large-scale data engineering modernisation, migrating thousands of pipelines across AWS. You'll stay deeply technical in Python, PySpark and Spark, shape scalable frameworks and standards, and champion AI-assisted development across multiple engineering teams.