Data Engineering Jobs

Harnham - Data and Analytics Recruitment · London · £75,000 – £85,000 pa

Owns the infrastructure, deployment and operational excellence of production machine learning systems within a growing AI function. Builds ML orchestration pipelines with Dagster, Airflow or Prefect, runs Kubernetes and Terraform/Bicep infrastructure, and maintains CI/CD and observability for models and LLM-powered services. Works closely with data scientists, engineers and client-facing teams, and influences platform standards.

Harnham - Data and Analytics Recruitment · London · £80,000 – £100,000 pa

Builds internal AI agents, tools and prototypes within a small central technical team, turning complex group data into usable products. Work spans Python, TypeScript and SQL, modernising legacy systems, wrapping them in scalable APIs and generating tests and migration tooling. High autonomy with weekly demonstrable output.

Noir · Leeds · £60,000 – £75,000 pa

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role based in Leeds supporting client data engineering and integration engagements.

Interface Recruitment · Leeds

Lead the design, build and optimisation of scalable data pipelines and platforms supporting analytics, reporting, AI and machine learning in a regulated asset management environment. Sets data engineering standards, mentors engineers, and ensures solutions meet security, governance, quality and resilience requirements while partnering with risk, technology and business teams.

Cathcart Technology · Edinburgh · £500 – £525 pd

Owns the end-to-end data architecture for a major ERP transformation, leading migration design, governance, master data and reporting while challenging vendor designs. Works with senior tech leaders and implementation partners from build through to go-live, requiring deep ERP data migration and MDM expertise.

Exalto Consulting · Bradford

Design and build end-to-end ETL/ELT solutions on Microsoft Fabric, including Dataflow Gen2 pipelines, Fabric Notebooks and Lakehouse with Medallion architecture. Work with SQL, Python, Spark SQL and Delta Lake, integrating APIs, databases, CRM and ERP sources, plus CI/CD, monitoring and data quality. Collaborate with Data Architects and BI teams on a modern platform supporting analytics, AI and operational use cases.

Palantir Technologies · London

Builds the tools and interfaces within Palantir Foundry that let users create data-intensive applications, working with TypeScript, React and GraphQL. Involves architecting state management and access patterns, owning frontend APIs and schemas, and iterating with users and designers. May include a Frontline rotation embedded with customers.

Palantir Technologies · London

Builds the lowest layers of Palantir's Foundry and Gotham platforms, spanning database technologies, distributed systems, large-scale data, security and application infrastructure. Work includes designing opinionated APIs, tracing performance in high-scale microservice architectures, and automating systems like Cassandra, Elasticsearch and Kafka.

Circle Recruitment · Leeds · £100,000 – £120,000 pa

Lead a law firm's enterprise, technology and data architecture, owning principles, standards, roadmaps and design governance. Shape strategy, security and responsible AI adoption while managing Solutions Architects, Consultants and Data Architects, with two days a week in the Leeds office.

Circle Recruitment · Dudley · £65,000 – £85,000 pa

Technical owner of a Microsoft Fabric data platform, building and maintaining data lakes, pipelines and ETL/ELT processes from APIs, flat files and ERP systems. Works with Finance, Commercial and BI teams to deliver scalable reporting while bringing data engineering knowledge in-house during a major Fabric migration.

eFinancialCareers · London · £45,000 – £70,000 pa

Design, build and maintain scalable data pipelines and cloud-based data platforms on AWS, working with data architects, scientists and analysts to turn complex data into reliable, accessible information. Combines hands-on engineering with technical leadership, shaping data solutions and guiding delivery across national security, government and public-sector environments.

Avanti Recruitment · Manchester · £60,000 – £100,000 pa

End-to-end data architecture role owning the full data lifecycle, from ingestion to consumption, across secure client environments. Involves designing lakehouse and medallion architectures, defining batch and streaming pipelines, and making decisions on storage, orchestration, governance and security. Cloud-agnostic, working with AWS, Azure or GCP alongside Databricks, Snowflake, Spark and Kafka.

Opus Recruitment Solutions · London · £500 – £525 pd

Hands-on contract role migrating a large legacy ETL estate of several thousand Ab Initio batch jobs to a serverless AWS data platform. You'll define migration patterns, convert Ab Initio transformations into scalable PySpark, and deliver production-ready AWS Glue solutions, with heavy Spark performance tuning across S3, Athena and serverless pipelines in a financial services cloud transformation programme.

eFinancialCareers · London

Lead the strategy, architecture and hands-on engineering of a cross-asset market data platform spanning crypto and traditional markets, including a central Market Data API, low-latency feed handlers and a firm-wide messaging layer. Manage a small development team while owning vendor relationships, data quality, cost control and regulatory entitlements across a hybrid on-premise and cloud environment.

Ashdown Group · London · £120,000 – £150,000 pa

Owns the enterprise data architecture, engineering strategy and cloud data platform, setting the technical roadmap and leading a data engineering function. Drives DataOps, CI/CD, observability and governance while building foundations for AI/ML, vector search and advanced analytics, partnering with Product, Data Science and senior leadership.