Latest Data Pipeline Engineer Jobs

Senior Data Engineer

This role involves designing and building a modern, scalable data platform on Azure from the ground up, establishing data engineering best practices, and creating secure, governed solutions. The engineer will develop ETL/ELT pipelines using Databricks and Spark, optimise Power BI semantic models, and support analytics and future AI initiatives. It's a high-impact position with full technical ownership in a collaborative engineering environment.

Yolk Recruitment Cardiff, Cymru / Wales, CF10 2AF, United Kingdom £47,675 pa

Hybrid Permanent Clearance Required

Data Engineer

This role involves designing and building cloud-based data platforms using modern technologies like Python, PySpark, Databricks, and Snowflake. You will work on complex data pipelines, ensure data quality, and collaborate closely with underwriting, actuarial, and regulatory teams. The position offers a high-impact, engineering-led environment with opportunities for technical leadership and mentorship.

Tenth Revolution Group London, United Kingdom £60,000 – £90,000 pa

Hybrid Permanent

Data Engineer

Design and implement cloud-based data solutions integrating multiple sources, with a focus on Salesforce and marketing data. Build scalable ELT pipelines and support data-driven campaign activation. Contribute to AI and transformation projects in a high-performing analytics team.

Datatech Covent Garden, London, WC2E 8RE, United Kingdom £50,000 pa

Data Engineer

The Data Engineer will design and build a modern, cloud-first data platform from the ground up, migrating from legacy on-premise systems to a scalable cloud architecture using tools like BigQuery and Airbyte. The role involves refactoring complex T-SQL into cloud workflows, implementing CI/CD and version control with Git, and creating robust data pipelines to support analytics and future AI/ML initiatives. This is a high-ownership role shaping the foundation of Liquidline’s data strategy.

Liquidline Ipswich, United Kingdom

Senior Azure Data Engineer

Contract Opportunity: Senior Data Engineer / DataOps EngineerLocation: Central London, UKContract Duration: 6 MonthsRole Type: ContractAbout the RoleAre you an experienced Data Engineer with a passion for DataOps, automation, and platform engineering? We are looking for a Senior Data Engineer...

Randstad Technologies Recruitment London, City And County Of the City Of London, United Kingdom £400 – £450 pd

EMEA Lead Data Engineer

Lead the technical direction of a modern data platform on Microsoft Fabric, designing and owning core ETL/ELT pipelines from ERP, CRM, and digital sources into the data warehouse. Drive engineering excellence, mentor junior engineers, and collaborate across business units to deliver scalable, high-impact data solutions. Focus on advancing cloud-based data integration and raising standards within a growing data team.

Gleeson Recruitment Group London, United Kingdom £80,000 – £100,000 pa

Senior Analytics Engineering Consultant

This role involves leading analytics and data engineering projects for clients, designing scalable cloud data solutions, and building data pipelines and models using modern data stack technologies. The consultant will act as a trusted advisor, translating business needs into technical architectures while delivering end-to-end solutions. Responsibilities include client workshops, solution design, mentoring, and driving innovation across cloud platforms.

Harnham - Data and Analytics Recruitment London, United Kingdom £70,000 – £90,000 pa

Lead Engineer

Lead the development of a Single Customer View by designing scalable ETL/ELT pipelines and integrating data from CRM, marketing platforms, and other systems. Define data models, improve data quality, and establish identity resolution to enable customer segmentation, reporting, and AI initiatives. Work across technical and business teams to shape data architecture and governance in a hybrid-working environment.

STORMX RECRUITMENT LIMITED Nr11Bj, United Kingdom £65,000 – £75,000 pa

Hybrid Permanent

Data Enigneer

Design and build data architecture, APIs, and pipelines to integrate disparate business systems into a unified data environment. Develop ETL/ELT solutions and support BI/analytics with trusted, consolidated data. Work in a greenfield setting to shape both technical implementation and long-term data strategy using Azure and modern data platforms.

RaptorTech Recruitment Ip14Ee, United Kingdom £40,000 – £50,000 pa

Engineering Manager

Lead the delivery of data platform and analytics programmes, managing technical roadmaps, cross-functional teams, and modern data stack technologies including Snowflake, dbt, and Airflow. Focus on architecture, SDLC governance, and stakeholder collaboration in a hybrid environment.

DCV Technologies London, United Kingdom £500 – £550 pd

Engineering Manager - Full Stack

Lead a full-stack engineering team building a modern, AI-driven data platform for retail and consumer goods clients. Focus on scalable cloud-native systems using Kubernetes, Terraform, and microservices, with strong emphasis on code quality, observability, and cross-team collaboration. Drive technical direction while mentoring engineers and shaping platform strategy.

dunnhumby Manchester, United Kingdom

Hybrid Permanent

Azure Devops Engineer

This role involves designing and maintaining CI/CD pipelines, automating Azure cloud infrastructure, and supporting a government client's data platform using DevOps practices. The engineer will implement Infrastructure as Code, troubleshoot operational issues, and mentor Agile delivery teams. Key focus areas include Azure Data Factory, Synapse Analytics, and monitoring with Prometheus and Grafana.

TXP Leeds, West Yorkshire, United Kingdom £330 – £380 pd

Software Engineer - Hosted Model Infrastructure

This role involves building and maintaining infrastructure for deploying machine learning models in highly secure, constrained environments such as air-gapped government networks and edge devices. You'll work across the full stack to develop model serving systems, deployment pipelines, and observability tools, ensuring reliable and performant AI inference across diverse hardware. The position emphasizes end-to-end ownership, debugging in low-access environments, and integration with Palantir’s platform and security frameworks.

Palantir Technologies United States US$145,000 – US$200,000 pa

Hybrid Permanent Clearance Required

Software Engineer - Hosted Model Infrastructure

This role involves building and maintaining high-performance, secure model serving infrastructure for AI/ML models deployed in challenging environments such as air-gapped government systems and edge devices. You'll work across the full stack to enable reliable, observable, and reproducible deployment of frontier AI models on customer-controlled hardware with constrained resources. The position emphasizes end-to-end ownership, debugging in low-access environments, and integration with Palantir’s platform and security systems.

Palantir Technologies United States £145,000 – £200,000 pa

Hybrid Permanent Clearance Required

Applied AI Engineer

Design and develop AI-powered features within a C#/.NET backend system, integrating LLMs and generative AI into customer-facing products. Build scalable RAG pipelines and APIs using Azure, vector databases, and semantic search. Collaborate with product and data teams to productionise intelligent software with monitoring and guardrails.

Oscar Technology Nottingham, United Kingdom £70,000 – £80,000 pa