Latest Data Pipeline Engineer Jobs

Data Scientist

The role involves developing and maintaining data models, building features for large language models (LLMs), and collaborating with data engineering and cross-functional teams to deliver scalable AI-driven products. You'll work across the project lifecycle from problem exploration to deployment, ensuring high-quality, maintainable code. The position requires close collaboration with senior stakeholders and international teams to deliver data-driven solutions in production.

Infused Solutions London, United Kingdom £46,000 – £56,000 pa

Software Engineer - AI / ML

This role involves building and maintaining scalable data pipelines for AI/ML applications, focusing on data quality, reliability, and observability. The engineer will work closely with data science and product teams to design and implement data infrastructure on Google Cloud Platform using tools like Airflow, Dataflow, and Spark. Key responsibilities include managing batch and streaming pipelines, ensuring robust data tracking, and supporting cross-functional initiatives in a collaborative environment.

EF Recruitment Victoria, Greater London, London, SW1P 1BX, United Kingdom £350 pd

Hybrid Contract

AI-Native Software Engineer

Build production software, APIs, and data pipelines that integrate with LLMs and agentic workflows. Work on AI-powered systems that analyze brand visibility across AI search and answer engines. Combine strong software engineering practices with cutting-edge AI patterns in a real-world commercial product.

Hyre Ai Paddington, London, W2 1HU, United Kingdom £60,000 – £70,000 pa

Senior Platform Engineer (Azure)

This role involves taking technical ownership of a growing Azure cloud environment, designing and improving infrastructure, security, and automation while driving adoption of Infrastructure as Code. The engineer will lead cloud transformation projects, support modern data platforms including Microsoft Fabric, and replace legacy systems with automated solutions. It's a hands-on senior position with influence over architecture and engineering standards in a cloud-native environment.

Yolk Recruitment Cardiff, South Glamorgan, CF10 2AF, United Kingdom

Senior Backend Engineer - ClickStack

Build and scale backend services for a petabyte-scale observability platform that unifies logs, metrics, traces, and session replays. Design high-throughput data pipelines and APIs with a focus on developer experience, working closely with open-source contributors and customers to shape the future of debugging in production.

ClickHouse United Kingdom

Senior Software Engineering

This role involves leading the design and delivery of enterprise-grade software and data platforms using Python, C#/.NET, and modern data technologies. The engineer will drive technical strategy, modernize legacy systems, and deliver scalable data solutions across cloud and on-prem environments. Collaboration with data, analytics, and architecture teams is key to enabling robust, secure, and high-performance systems.

Adecco London, United Kingdom £600 – £650 pd

Hybrid Contract

Head of Data

Leads the data function, shaping strategy, modernising platforms from SQL Server to Databricks or Microsoft Fabric, and driving data governance, quality, and engineering best practices. Manages a team of 10 data specialists, overseeing data architecture, pipelines, and compliance. Focuses on transitioning legacy systems to scalable, future-proof analytics solutions while ensuring strong stakeholder engagement and technical excellence across the data lifecycle.

Michael Page Harrogate, North Yorkshire, HG1 1QS, United Kingdom £75,000 – £90,000 pa

Senior Data Analyst

This role involves building and maintaining scalable data pipelines for AI/ML-driven user experience projects, using Google Cloud Platform and tools like Airflow and Cloud Composer. The analyst will ensure data quality and system reliability through monitoring with Monte Carlo, Looker, Splunk, and NewRelic, while collaborating closely with product engineering and data science teams. Responsibilities include data ingestion, pipeline orchestration, and technical documentation to support cross-functional data initiatives.

EF Recruitment Victoria, Greater London, London, SW1P 1BX, United Kingdom £500 pd

Data Architect

This role involves designing and evolving enterprise data architecture within a hybrid cloud and on-premise environment, with a focus on building Common Data Models in Microsoft Fabric and integrating diverse data sources. The Data Architect will establish scalable data integration patterns, support unified data views, and drive data governance and metadata management initiatives. It's a strategic position influencing large-scale data transformation across customer and property data domains.

Hays Technology Milton Keynes, Buckinghamshire, United Kingdom £550 pd

Hybrid Contract

Data Architect

Design and evolve enterprise data architecture across hybrid cloud and on-premises environments, focusing on Common Data Models in Microsoft Fabric, CRM data integration, and scalable data solutions. Drive data governance, metadata management, and compliance initiatives while collaborating with engineering and analytics teams. Support a large-scale data transformation programme with strategic impact.

Hays Technology Milton Keynes, Buckinghamshire, United Kingdom £550 pd

Sr. Forward Deployed Engineer - Architect - Full Stack

This role involves leading the design and implementation of end-to-end data and AI systems for enterprise customers using the Databricks platform. You'll work hands-on to build production-grade solutions, guide architectural decisions, and integrate complex data pipelines with ML/AI models and user-facing applications. The role emphasizes customer collaboration, reusable solutioning, and influencing product direction through real-world feedback.

Databricks London, United Kingdom

Hybrid Permanent

Energy Analytics Engineer

The Energy Analytics Engineer will design and maintain data pipelines using Azure-based tools, automate data ingestion from APIs, and support reporting and analytics for energy and sustainability initiatives. The role involves close collaboration with cross-functional teams to deliver robust data models, ensure data quality, and enable data-driven decision-making. A key focus is on enabling carbon reporting and driving digital solutions that support Veolia’s ecological transformation goals.

Veolia London, United Kingdom £40,000 pa

Lead Azure Databricks Platform Engineer / Architect

This role involves hands-on engineering and architectural leadership for an enterprise Azure Databricks platform, focusing on enabling Serverless workloads, implementing FinOps controls, and migrating analytical workloads from POSIT/RStudio. The engineer will optimise cost, performance, and security across data pipelines, implement tagging and budgeting systems, and enhance the Discovery Zone for broader adoption. Key responsibilities include direct development, migration pattern design, and cross-team collaboration in a regulated environment.

TXP London, United Kingdom £500 – £501 pd

Hybrid Contract

Exposure / Quantitative Data Analyst

This role involves developing analytical tools and automated data pipelines to monitor and manage natural catastrophe exposure across an insurance portfolio. The analyst will work with geospatial data, catastrophe models, and modern analytics platforms to generate risk insights, support pricing decisions, and deliver reporting for capital modelling. Collaboration with underwriting, actuarial, and research teams is central, with opportunities to innovate using AI-driven solutions and advanced risk analytics.

Insight Select Bishopsgate, City And County Of the City Of London, EC2M 3UE, United Kingdom £80,000 – £90,000 pa

On-site Permanent

Data Scientist

Purpose of the roleTo support the design, prototype and delivery of innovative, data-led products by combining market insight, advanced analytics and modern data platforms. Working in closely with Product Managers and Data Analysts, this role will convert data assets and...

Sagacity London, United Kingdom

Permanent