Data Engineering Jobs

Harnham - Data and Analytics Recruitment · London · £75,000 – £85,000 pa

Owns the infrastructure, deployment and operational excellence of production machine learning systems within a growing AI function. Builds ML orchestration pipelines with Dagster, Airflow or Prefect, runs Kubernetes and Terraform/Bicep infrastructure, and maintains CI/CD and observability for models and LLM-powered services. Works closely with data scientists, engineers and client-facing teams, and influences platform standards.

Harnham - Data and Analytics Recruitment · London · £80,000 – £100,000 pa

Builds internal AI agents, tools and prototypes within a small central technical team, turning complex group data into usable products. Work spans Python, TypeScript and SQL, modernising legacy systems, wrapping them in scalable APIs and generating tests and migration tooling. High autonomy with weekly demonstrable output.

Avanti Recruitment · Manchester · £60,000 – £100,000 pa

End-to-end data architecture role owning the full data lifecycle, from ingestion to consumption, across secure client environments. Involves designing lakehouse and medallion architectures, defining batch and streaming pipelines, and making decisions on storage, orchestration, governance and security. Cloud-agnostic, working with AWS, Azure or GCP alongside Databricks, Snowflake, Spark and Kafka.

Opus Recruitment Solutions · London · £500 – £525 pd

Hands-on contract role migrating a large legacy ETL estate of several thousand Ab Initio batch jobs to a serverless AWS data platform. You'll define migration patterns, convert Ab Initio transformations into scalable PySpark, and deliver production-ready AWS Glue solutions, with heavy Spark performance tuning across S3, Athena and serverless pipelines in a financial services cloud transformation programme.

eFinancialCareers · London

Lead the strategy, architecture and hands-on engineering of a cross-asset market data platform spanning crypto and traditional markets, including a central Market Data API, low-latency feed handlers and a firm-wide messaging layer. Manage a small development team while owning vendor relationships, data quality, cost control and regulatory entitlements across a hybrid on-premise and cloud environment.

Circle Recruitment · Leeds · £100,000 – £120,000 pa

Lead a law firm's enterprise, technology and data architecture, owning principles, standards, roadmaps and design governance. Shape technology and data strategy, set guardrails for AI adoption, and lead a team of Solutions Architects, Consultants and Data Architects. Hybrid role with two days a week in the Leeds office.

Ashdown Group · London · £120,000 – £150,000 pa

Owns the enterprise data architecture, engineering strategy and cloud data platform, setting the technical roadmap and leading a data engineering function. Drives DataOps, CI/CD, observability and governance while building foundations for AI/ML, vector search and advanced analytics, partnering with Product, Data Science and senior leadership.

Circle Recruitment · Birmingham · £100,000 – £120,000 pa

A new senior leadership role owning enterprise and data architecture for a law firm, covering principles, standards, roadmaps and design governance. You will lead solution design for major initiatives, set guardrails for AI and emerging tech, and manage a team of solutions architects, consultants and data architects across cloud and SaaS environments.

Cedar · London · £65,000 – £70,000 pa

Hands-on role acting as OneStream SME, supporting system development, optimisation and governance, and contributing to implementation projects from a Finance perspective. Works across OneStream, NetSuite, Databricks, Navan and Power BI, covering consolidation, reporting, planning, data mapping, reconciliation and master data. Suits a qualified accountant combining Finance, Systems, Data and Transformation in a PE-backed business.

Akkodis · Stevenage

Design and deliver end-to-end data engineering solutions, building scalable ETL/ELT and streaming pipelines and optimising warehouses, lakehouses and reporting. Create Power BI dashboards and drive data governance, quality and DataOps automation with CI/CD and containerised deployments, partnering with engineering, manufacturing and supply chain stakeholders.

Datatech · Berkshire · £55,000 – £67,000 pa

Owns the end-to-end data journey for a financial services business, building Azure Databricks pipelines with PySpark, SQL, ADF and ADLS Gen2, and governed lakehouse solutions using Delta Lake, medallion architecture and Unity Catalog. Also owns Power BI semantic models, DAX measures and row-level security, translating marketing and contact-centre requirements into trusted metrics while mentoring colleagues and improving engineering standards.

Palantir Technologies · New York, United States

Builds the tools and interfaces within Palantir Foundry that let users create data-intensive applications, architecting state management, access patterns and APIs. Works closely with users, designers and backend engineers, and may join a short-term embedded Frontline rotation with customers.

Palantir Technologies · New York, United States

Builds the lowest layers of Palantir's Foundry and Gotham platforms, working on database technologies, distributed systems, large-scale data, security and application infrastructure. Engineers design opinionated APIs, automate systems like Cassandra, Kafka and Kubernetes, and may join a short-term Frontline rotation embedded with customers.

Oliver James · East Sussex · £70,000 – £75,000 pa

Owns business-critical MI including legacy Excel/VBA reporting, then modernises it into governed Power BI, Power Query and Power Automate solutions. Supports a data platform programme introducing Databricks, Ataccama and Timbr, focusing on data validation and mapping, and acts as a senior voice coaching colleagues in a team of eight.

Salt Search · London · £70,000 – £100,000 pa

Administer, maintain and optimise Linux server environments across production and development platforms, managing VMware vSphere/ESXi infrastructure and building automation with Ansible and Bash. The role sits in a specialist security team supporting a secure, large-scale big data platform for a UK critical national infrastructure programme, using DevOps methodologies to deliver continuous improvements. It is predominantly on-site and requires active DV clearance.