Data Engineering Jobs

Harnham - Data and Analytics Recruitment · London · £75,000 – £85,000 pa

Owns the infrastructure, deployment and operational excellence of production machine learning systems within a growing AI function. Builds ML orchestration pipelines with Dagster, Airflow or Prefect, runs Kubernetes and Terraform/Bicep infrastructure, and maintains CI/CD and observability for models and LLM-powered services. Works closely with data scientists, engineers and client-facing teams, and influences platform standards.

Harnham - Data and Analytics Recruitment · London · £80,000 – £100,000 pa

Builds internal AI agents, tools and prototypes within a small central technical team, turning complex group data into usable products. Work spans Python, TypeScript and SQL, modernising legacy systems, wrapping them in scalable APIs and generating tests and migration tooling. High autonomy with weekly demonstrable output.

Palantir Technologies · Sydney, Australia

Forward Deployed Software Engineers embed with government customers to understand open-ended problems and build data-driven solutions, spanning architecture discussions, large-scale data wrangling, custom web apps and executive briefings. Interns work in small teams with minimal supervision and own end-to-end delivery of high-stakes projects, using languages such as Python, Java, C++ or TypeScript.

Palantir Technologies · Washington, United States · US$10,000 pm

Interns deploy and operate Palantir software across production environments, handling monitoring, alerting, configuration management and upgrades. They debug distributed systems, automate manual runbooks and build infrastructure solutions using Foundry and Apollo, working in small teams with real ownership.

Exalto Consulting · Bradford

Design and build end-to-end ETL/ELT solutions on Microsoft Fabric, including Dataflow Gen2 pipelines, Fabric Notebooks and Lakehouse with Medallion architecture. Work with SQL, Python, Spark SQL and Delta Lake, integrating APIs, databases, CRM and ERP sources, plus CI/CD, monitoring and data quality. Collaborate with Data Architects and BI teams on a modern platform supporting analytics, AI and operational use cases.

Dns Info Ltd · London · £350 – £450 pd

Day-to-day work centres on designing and maintaining data warehousing and data modelling solutions — star, snowflake and data vault patterns — plus producing data dictionaries and models managed through Bitbucket and Liquibase deployments. The role sits with a banking and trade management focus, covering vanilla macro, credit and securitisation products, and requires AI-driven development alongside Sybase, Oracle, Postgres, some Python and basic AWS.

Circle Recruitment · Leeds · £100,000 – £120,000 pa

Lead a law firm's enterprise, technology and data architecture, owning principles, standards, roadmaps and design governance. Shape strategy, security and responsible AI adoption while managing Solutions Architects, Consultants and Data Architects, with two days a week in the Leeds office.

Circle Recruitment · Dudley · £65,000 – £85,000 pa

Technical owner of a Microsoft Fabric data platform, building and maintaining data lakes, pipelines and ETL/ELT processes from APIs, flat files and ERP systems. Works with Finance, Commercial and BI teams to deliver scalable reporting while bringing data engineering knowledge in-house during a major Fabric migration.

eFinancialCareers · London · £45,000 – £70,000 pa

Design, build and maintain scalable data pipelines and cloud-based data platforms on AWS, working with data architects, scientists and analysts to turn complex data into reliable, accessible information. Combines hands-on engineering with technical leadership, shaping data solutions and guiding delivery across national security, government and public-sector environments.

Avanti Recruitment · Manchester · £60,000 – £100,000 pa

End-to-end data architecture role owning the full data lifecycle, from ingestion to consumption, across secure client environments. Involves designing lakehouse and medallion architectures, defining batch and streaming pipelines, and making decisions on storage, orchestration, governance and security. Cloud-agnostic, working with AWS, Azure or GCP alongside Databricks, Snowflake, Spark and Kafka.

Opus Recruitment Solutions · London · £500 – £525 pd

Hands-on contract role migrating a large legacy ETL estate of several thousand Ab Initio batch jobs to a serverless AWS data platform. You'll define migration patterns, convert Ab Initio transformations into scalable PySpark, and deliver production-ready AWS Glue solutions, with heavy Spark performance tuning across S3, Athena and serverless pipelines in a financial services cloud transformation programme.

eFinancialCareers · London

Lead the strategy, architecture and hands-on engineering of a cross-asset market data platform spanning crypto and traditional markets, including a central Market Data API, low-latency feed handlers and a firm-wide messaging layer. Manage a small development team while owning vendor relationships, data quality, cost control and regulatory entitlements across a hybrid on-premise and cloud environment.

Ashdown Group · London · £120,000 – £150,000 pa

Owns the enterprise data architecture, engineering strategy and cloud data platform, setting the technical roadmap and leading a data engineering function. Drives DataOps, CI/CD, observability and governance while building foundations for AI/ML, vector search and advanced analytics, partnering with Product, Data Science and senior leadership.

Cedar · London · £65,000 – £70,000 pa

Hands-on role acting as OneStream SME, supporting system development, optimisation and governance, and contributing to implementation projects from a Finance perspective. Works across OneStream, NetSuite, Databricks, Navan and Power BI, covering consolidation, reporting, planning, data mapping, reconciliation and master data. Suits a qualified accountant combining Finance, Systems, Data and Transformation in a PE-backed business.

Akkodis · Stevenage

Design and deliver end-to-end data engineering solutions, building scalable ETL/ELT and streaming pipelines and optimising warehouses, lakehouses and reporting. Create Power BI dashboards and drive data governance, quality and DataOps automation with CI/CD and containerised deployments, partnering with engineering, manufacturing and supply chain stakeholders.