Data Engineering Jobs

Harnham - Data and Analytics Recruitment · London · £75,000 – £85,000 pa

Owns the infrastructure, deployment and operational excellence of production machine learning systems within a growing AI function. Builds ML orchestration pipelines with Dagster, Airflow or Prefect, runs Kubernetes and Terraform/Bicep infrastructure, and maintains CI/CD and observability for models and LLM-powered services. Works closely with data scientists, engineers and client-facing teams, and influences platform standards.

Harnham - Data and Analytics Recruitment · London · £80,000 – £100,000 pa

Builds internal AI agents, tools and prototypes within a small central technical team, turning complex group data into usable products. Work spans Python, TypeScript and SQL, modernising legacy systems, wrapping them in scalable APIs and generating tests and migration tooling. High autonomy with weekly demonstrable output.

Palantir Technologies · London · US$10,500 pm

Works deep inside the data processing infrastructure behind Foundry, covering query plan optimisation, execution operators, and efficient data reads and writes. Extends open-source engines and table formats such as Apache Spark, DataFusion, and Iceberg, with work spanning design, code review, testing, and release. An internship aimed at students graduating in 2028.

Palantir Technologies · London

Works deep inside the data processing infrastructure behind Palantir Foundry, on how computations are represented, query plans optimised, operators executed, and data read and written efficiently. Builds on and extends Apache Spark, DataFusion and Iceberg, taking on production problems such as writing planning rules or speeding up large table scans through design, code review, testing and release.

Databricks · London

Founding backend engineer role building the Lakebase managed Postgres transactional layer, spanning control plane, proxy data path, and platform reliability. Work covers large-scale distributed systems, high-throughput connection handling, and AI-powered automation to meet SLIs and SLOs across AWS, GCS, and Azure storage.

Databricks · London

Owns the core write-path operations for Delta Lake, the open-source storage layer behind the Databricks Lakehouse, driving performance innovations like Low Shuffle Merge and Deletion Vectors. Designs and maintains high-QPS, low-latency backend systems at massive scale while providing technical leadership, mentoring engineers and leading complex cross-team projects.

Holt Executive · London

Hands-on full-stack role building data-driven applications, cloud platforms and AI-enabled tools. Day to day involves Python and TypeScript development, AWS services, Terraform, CI/CD and integrating LLM features, within a small collaborative team that contributes to technical design decisions.

Profile 29 · London · £50,000 – £70,000 pa

Design, build and operate resilient AWS cloud infrastructure for public-sector casework and AI orchestration platforms, working across platform and delivery teams. The role spans Terraform and Kubernetes, CI/CD pipelines, Kafka event-driven systems, IdAM with Keycloak, and observability stacks, with a strong DevSecOps and automation focus plus incident response duties.

eFinancialCareers · London · £200,000 – £500,000 pa

Generalist engineering role building trading, execution, risk and research systems for Tier-1 quantitative trading firms, spanning distributed compute, event-driven architectures, real-time applications and large-scale data platforms. Language-agnostic, so Java, C++, Python, Rust, Go, OCaml or C# backgrounds are all relevant, with ownership from design through deployment in small teams close to commercial outcomes.

Experis · Baltimore, United States · £700 pw

Six-month contract guiding technical design for a data migration discovery within a Legacy Tech Debt programme. Involves assessing data extraction feasibility, analysing 54 Oracle database instances, overseeing reverse engineering and assuring technical artefacts, while aligning design decisions with wider architecture standards.

EF Recruitment · London

Our Global SaaS client is now seeking an experienced Data Analyst to join their Global Customer Success Data Science Team for a 10-month contract.You’ll play a pivotal role in improving how they measure and deliver customer success, driving impact across...

Innova Solutions · London · £50 pa

Documents and designs enterprise data architectures for large financial systems, spanning Oracle/PostgreSQL relational platforms and distributed NoSQL stores like Cassandra and YugabyteDB. Produces domain, conceptual, logical and physical models, defines integration patterns, and supports governance, migration and modernisation planning in a hybrid team.

Randstad Technologies Recruitment · Dartford · £600 – £650 pd

Lead the data strategy for a major engineering programme, defining enterprise data models, governance and architectural roadmaps that connect product design to shop-floor operations. The role focuses on integrating PLM and MES platforms (Teamcenter, Windchill, SAP PLM, Opcenter, SAP ME/MII) to deliver a unified digital thread across engineering, IT and operational teams.

Appcastenterprise · London · £700 pd

Six-month contract guiding technical design for a data migration discovery within a Legacy Tech Debt programme. Involves assessing data extraction feasibility, analysing 54 Oracle database instances, overseeing reverse engineering and assuring technical artefacts, while aligning design decisions with wider architecture standards.

Randstad Technologies Recruitment · London · £432 – £484 pd

Design and deploy production-grade Generative AI workflows and backend security guardrails for a global financial institution's AI Centre of Excellence. The role blends Python/Java engineering, AWS/Azure cloud pipelines with Airflow, and roughly 20-25% frontend/UI work for guardrail tooling, plus production support and ML evaluation metrics.