Data Engineering Jobs

• London
• Entry level

New-grad engineers join a cohort to build infrastructure and products across backend, full stack, infrastructure, databases, systems, cloud and customer-facing teams. You own the full development lifecycle from design and testing to running services in production, with a dedicated mentor supporting your onboarding.

Databricks · Unity Catalog · Lakehouse +4

• United Kingdom
• Remote
• Senior
• Permanent

Own the official ClickHouse .NET client end to end: define its roadmap from user evidence, build and ship NuGet packages, and support ADO.NET, Dapper and EF Core users. The role also involves reviewing other language clients, contributing to the ODBC driver, and shaping APIs and docs for AI coding agents.

ClickHouse · NuGet · ASP.NET Core +7

• New York, United States
• Hybrid
• US$145,000 – US$155,000 pa
• Entry level

Works deep inside the data processing infrastructure behind Palantir Foundry, covering query plan optimization, operator execution, and efficient data reads and writes. Extends open-source engines and table formats including Apache Spark, DataFusion, and Iceberg, taking changes through design, code review, testing, and release. Correctness, compatibility, and predictable performance are central to the work.

Apache Spark · Apache DataFusion · Apache Iceberg +7

• London
• Hybrid
• Entry level

Works deep inside the data processing infrastructure behind Palantir Foundry, on how computations are represented, query plans optimised, operators executed, and data read and written efficiently. Builds on and extends Apache Spark, DataFusion and Iceberg, taking on production problems such as writing planning rules or speeding up large table scans through design, code review, testing and release.

Apache Spark · Apache DataFusion · Apache Iceberg +7

• London
• £80,000 – £115,000 pa
• Senior
• Permanent

Hands-on engineering role migrating a Futures algorithmic trading platform's market data integration from the legacy LSEG/Refinitiv RFA to the Real-Time SDK (RTSDK). Involves analysing existing RFA integrations, developing Java applications and shared frameworks, and working with Futures and Options market data across exchanges while maintaining backward compatibility and trading workflows.

LSEG · Refinitiv · RFA +2

• London
• Senior

Founding backend engineer role building the Lakebase managed Postgres transactional layer, spanning control plane, proxy data path, and platform reliability. Work covers large-scale distributed systems, high-throughput connection handling, and AI-powered automation to meet SLIs and SLOs across AWS, GCS, and Azure storage.

AWS S3 · GCS · Azure Blob Storage +6

• United Kingdom
• Remote
• Senior
• Permanent

Design, deploy and maintain a multi-cloud, multi-region distributed infrastructure powering ClickHouse Cloud's data plane, covering compute, networking and security. The role involves building cloud-native platform components, routing and traffic systems, and security tooling such as firewalls, PKI and zero-trust networking, working closely with the core database and security teams.

AWS · Azure · GCP +6

• United Kingdom
• £70,000 – £90,000 pa
• Senior

Build secure, cloud-native Java platforms for UK National Security programmes, working on large-scale data ingestion, distributed systems and analyst tooling. Day to day involves Java services, Apache NiFi pipelines, Spring Boot microservices on OpenShift and Kubernetes, and event-driven architectures. Requires current or recently active DV/eDV clearance.

Java · Spring Boot · Apache NiFi +5

• United Kingdom
• Lead

Designs and operates core distributed systems for a serverless Elasticsearch offering, focusing on cluster coordination, shard allocation, and consistent indexing across nodes. Involves debugging concurrency and performance issues at petabyte scale, owning operational investigations end-to-end, and collaborating asynchronously across a distributed team.

Elasticsearch · Lucene · JDK +1

• London
• Hybrid · 3 days in office
• £500 – £600 pd
• Mid-level
• Contract

Designs, builds and maintains scalable data pipelines and ETL processes, working hands-on with Scala, Java or Python alongside Spark, Elastic, REST APIs and Tomcat. Builds reusable shared libraries and platform capabilities, with Azure Data Factory, Databricks and Elasticsearch exposure, collaborating with Technology, Product and Business stakeholders on data quality and reliability.

Spark · Apache Airflow · Azure +7

• London
• Remote
• £432 – £484 pd
• Senior
• Contract

Design and deploy production-grade Generative AI workflows and backend security guardrails for a global financial institution's AI Centre of Excellence. The role blends Python/Java engineering, AWS/Azure cloud pipelines with Airflow, and roughly 20-25% frontend/UI work for guardrail tooling, plus production support and ML evaluation metrics.

AWS · Azure · Apache Airflow

• Manchester
• Hybrid · 4 days in office
• £800 – £1,000 pd
• Lead
• Contract

Hands-on technical leadership role shaping a strategic data platform for an investment management firm, with Snowflake at its core. Responsibilities span designing scalable platform solutions, building and optimising end-to-end ELT pipelines, defining engineering standards and governance, and developing Infrastructure as Code with Cloud Engineering. Works in an Agile team supporting analytics, AI and ML adoption.

Snowflake · Snowpark · dbt +7

• United Kingdom
• Remote
• £103,958 – £124,750 pa
• Senior

Backend-focused role on the Grafana Alerting squad, working at the core of the open-source Grafana project and the SLOs product. Engineers design, build and operate distributed systems that scale Prometheus-based alert ingestion, evaluation and delivery, including systems reaching over 500 evaluations per second in production, with on-call ownership and mentoring duties.

Grafana · Grafana Cloud · Prometheus +5

• Manchester
• Remote
• £84,160 – £126,240 pa
• Senior

Owns complex Maia rollouts end to end, running discovery, architecting multi-cloud deployments and writing production-grade code, including modifying Matillion's own product codebase where features are missing. Acts as a cross-functional escalation point across Sales, Product and Customer Success, mentors junior FDEs and works agentic-first with AI tools.

AWS · Azure · GCP +6

• London

Design, build and own a generalized reporting system that generates business-critical outputs from a backend data platform for a global prime brokerage and financing business. The role demands deep ownership of correctness, reliability and performance, with tight SLO workflows on scheduling systems and heavy Python, Pandas and SQL work across Snowflake and Postgres.

Datadog · Grafana · Prometheus +5