Data Engineering Jobs

Harnham - Data and Analytics Recruitment · London · £150,000 – £180,000 pa

Executive role owning the data vision for a private equity-backed financial services firm, leading a large-scale transformation of its data and analytics function. Responsibilities span reshaping the operating model, building a modern cloud data platform with lake and warehousing capabilities, and driving data engineering, governance and self-service analytics. Also involves applying AI to engineering productivity and improving customer onboarding and personalisation.

Harnham - Data and Analytics Recruitment · London · £75,000 – £85,000 pa

Owns the infrastructure, deployment and operational excellence of production machine learning systems within a growing AI function. Builds ML orchestration pipelines with Dagster, Airflow or Prefect, runs Kubernetes and Terraform/Bicep infrastructure, and maintains CI/CD and observability for models and LLM-powered services. Works closely with data scientists, engineers and client-facing teams, and influences platform standards.

Palantir Technologies · London

Builds, operates and maintains high-performance, scalable services across Palantir platforms and government deployments, handling monitoring, configuration management, upgrades and migrations. Combines software development with production ownership, automating manual workflows and troubleshooting complex distributed systems, including an on-call support rotation.

Tenth Revolution Group · Reading · £55,000 – £65,000 pa

Designs and builds scalable cloud data solutions, supporting a migration from a legacy SQL environment to Azure Databricks. Works with Python, PySpark, Delta Lake and Unity Catalog to create pipelines, transformation frameworks and curated data layers, while optimising models for analytics and self-service BI. Involves governance, security and data architecture decisions within a growing data function.

Noir · Leeds · £60,000 – £75,000 pa

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role based in Leeds supporting client data engineering and integration engagements.

Tenth Revolution Group · West Midlands (Region) · £45,000 pa

Maintains and develops data pipelines and models that support business-critical reporting, ensuring data is accurate, documented and accessible. Works in a small cross-functional team reporting to the Head of IT, partnering with sales, marketing and operations on data questions and quality standards. Uses SQL, Git, dbt, Python and cloud data warehouses.

Reed · Edinburgh · £70,000 – £83,500 pa

Lead the creation of an enterprise data architecture practice from scratch, assessing a fragmented data landscape and building a scalable roadmap, models and governance standards. Hands-on role in the Microsoft ecosystem (Azure, Microsoft Fabric), designing pipelines and proof-of-concepts while guiding data engineers and analysts. Works with business and technical stakeholders in a regulated public sector setting.

Wesleyan · Birmingham · £49,800 – £72,000 pa

Lead project data architect role within a four-person data architecture team, ensuring centre-of-excellence objectives run through projects across all business units. Involves designing data architecture, modelling and master data solutions, enabling integration via APIs, GraphQL, JSON and XML, and building cloud-based platforms with Azure, SQL, Python and Databricks.

Noir · Newcastle upon Tyne · £45,000 – £80,000 pa

Builds and optimises high-quality data pipelines processing large volumes from internal and external sources, and helps maintain a central data platform supporting investment decision-making. Works closely with business stakeholders on how data is accessed, tested and leveraged, using SQL, Python, AWS, Git and Airflow. Requires direct hedge fund sector experience.

Interface Recruitment · Leeds

Lead the design, build and optimisation of scalable data pipelines and platforms supporting analytics, reporting, AI and machine learning in a regulated asset management environment. Sets data engineering standards, mentors engineers, and ensures solutions meet security, governance, quality and resilience requirements while partnering with risk, technology and business teams.

Intec Select · London · £80,000 – £90,000 pa

Analyse, design and implement enhancements to financial crime and surveillance platforms including transaction monitoring, sanctions screening and market surveillance. Hands-on Python, PowerShell, .NET and Power BI work, plus data engineering with Snowflake, SQL, MongoDB and Kafka, root cause analysis, audit support and ML model tuning within a bank's compliance technology team.

Cathcart Technology · Edinburgh · £500 – £525 pd

Owns the end-to-end data architecture for a major ERP transformation, leading migration design, governance, master data and reporting while challenging vendor designs. Works with senior tech leaders and implementation partners from build through to go-live, requiring deep ERP data migration and MDM expertise.

Exalto Consulting · Bradford

Design and build end-to-end ETL/ELT solutions on Microsoft Fabric, including Dataflow Gen2 pipelines, Fabric Notebooks and Lakehouse with Medallion architecture. Work with SQL, Python, Spark SQL and Delta Lake, integrating APIs, databases, CRM and ERP sources, plus CI/CD, monitoring and data quality. Collaborate with Data Architects and BI teams on a modern platform supporting analytics, AI and operational use cases.

Dns Info Ltd · London · £350 – £450 pd

Day-to-day work centres on designing and maintaining data warehousing and data modelling solutions — star, snowflake and data vault patterns — plus producing data dictionaries and models managed through Bitbucket and Liquibase deployments. The role sits with a banking and trade management focus, covering vanilla macro, credit and securitisation products, and requires AI-driven development alongside Sybase, Oracle, Postgres, some Python and basic AWS.

Palantir Technologies · New York, United States · US$135,000 – US$200,000 pa

Works deep inside the data processing infrastructure behind Palantir Foundry, designing query planning and optimization, extending execution engines, and improving operators, parallelism and memory management. Builds on and extends Apache Spark, DataFusion, Comet, Velox and Iceberg, owning changes from design through production with a high bar for correctness and performance.