Latest Data Pipeline Engineer Jobs

Senior Staff Software Engineer - Unity Catalog Runtime Enforcement

This role involves leading the development and hardening of the runtime enforcement layer for Unity Catalog, ensuring secure and consistent data access across Databricks' compute engines and cloud environments. The engineer will drive multi-year technical initiatives, establish enforcement standards, and lead a team in a high-severity, cross-organizational domain. Key responsibilities include incident prevention, automation, and collaboration across teams to unify authorization semantics at scale.

Databricks London, United Kingdom

Forward Deployed Software Engineer - NATO

This role involves working directly with NATO and other high-stakes organisations to solve complex, real-world problems using Palantir’s data platforms. As a Forward Deployed Software Engineer, you'll own end-to-end project delivery, from understanding customer challenges to designing and implementing technical solutions. The role blends software engineering, data analysis, and client strategy, often requiring on-site collaboration and rapid adaptation to new domains.

Palantir Technologies London, United Kingdom

Forward Deployed Infrastructure Engineer - UK Government

This role involves building, operating, and maintaining high-performance infrastructure for Palantir's platforms deployed within UK government environments. You'll troubleshoot complex production systems, automate manual processes, and collaborate with engineering and deployment teams to ensure reliability and scalability. The position emphasizes hands-on problem-solving, coding proficiency, and direct impact on mission-critical operations.

Palantir Technologies London, United Kingdom

Hybrid Permanent Clearance Required

Staff Software Engineer I

This role involves developing a next-generation multi-modal storage engine as part of the Tableflow project, focusing on scalable table materialization, compaction, and highly available compute infrastructure. The engineer will work on enabling seamless consumption of streaming data as both tables and streams, integrating with Confluent Cloud at scale. Collaboration with product, design, and engineering teams ensures tight integration of storage features within the broader platform.

Confluent United Kingdom

Remote Permanent

Lead Solutions Architect - Strategic Customers

This role involves working at the executive level with Databricks' largest enterprise customers across the UK and Ireland to drive digital transformation through data and AI. You'll design strategic technology adoption plans, mentor technical teams, and lead thought leadership initiatives using platforms like Databricks, Spark, and cloud ecosystems. The position emphasizes hands-on solution building, cross-functional collaboration, and shaping long-term data strategies for complex organisations.

Databricks London, United Kingdom

Hybrid Permanent

Elastic Consulting Architect - Public Sector

This role involves delivering technical solutions and strategic consulting for Elastic's public sector clients, focusing on search, security, and observability platforms. You'll design and optimise large-scale Elastic deployments, lead proof-of-concepts, and advise senior government stakeholders on aligning Elastic technology with strategic objectives. The position requires deep expertise in Elasticsearch, distributed systems, and data architecture, with significant onsite engagement and travel.

Elastic United Kingdom

AWS Cloud Engineer

Design and build scalable, cloud-native Python applications on AWS, processing real-time data at scale. Work across the full development lifecycle, from infrastructure provisioning with IaC to deploying containerised services on Kubernetes and serverless platforms. Collaborate with data and DevOps teams in an Agile environment to deliver secure, high-availability solutions impacting real-world environmental challenges.

hireful Exeter, United Kingdom £65,000 – £70,000 pa

Software Engineer (LabVIEW)

Design and develop LabVIEW-based control and data acquisition systems for industrial automation and R&D projects. Integrate software with complex hardware platforms, support deployment, and provide technical guidance to clients. Work on bespoke solutions within a technically advanced engineering environment with opportunities for UK and international travel.

Rise Technical Recruitment Gloucester, United Kingdom £45,000 – £65,000 pa

Hybrid Permanent

Database Engineer - MySQL

Database AdministratorBuild resilient databases. Power critical platforms. Shape the future of data.Our client is a tech-driven organisation operating at the heart of the UK digital ecosystem, supporting thousands of businesses through a complex, high-availability platform. Behind the scenes, robust data...

Akkodis Prudhoe, NE42 5PY, United Kingdom £40,000 – £45,000 pa

Database Engineer - MySQL

Database AdministratorBuild resilient databases. Power critical platforms. Shape the future of data.Our client is a tech-driven organisation operating at the heart of the UK digital ecosystem, supporting thousands of businesses through a complex, high-availability platform. Behind the scenes, robust data...

Akkodis Nelson, United Kingdom £40,000 – £45,000 pa

AI Engineer

This role involves building and refining an agentic AI platform that connects fragmented school data to provide actionable insights. Responsibilities include developing workflows, integrating LLMs, improving prompt engineering, and contributing to system observability and benchmarking.

Opus Recruitment Solutions London, United Kingdom £60,000 – £70,000 pa

Remote Permanent Flexible

Cloud FinOps Analyst

This role involves leading cloud financial optimisation across Azure and Snowflake platforms, using tools like Kubecost and Power BI to analyse spend, drive cost efficiency, and establish governance. The analyst will work cross-functionally with engineering, data, and finance teams to implement cost controls, improve visibility, and promote cost-aware culture. Key responsibilities include rightsizing resources, optimising workloads, and maintaining chargeback models.

Manufacturing Recruitment Ltd Leicester, Leicestershire, United Kingdom

Hybrid Permanent

Alation Technical Consultant CGEMJP00354051

Implement and configure the Alation Data Intelligence Platform, including deployment, integration, and administration across cloud and on-premises environments. Onboard diverse data sources, migrate metadata from legacy systems, and enable metadata discovery, lineage, and governance. Provide technical guidance and operational support to stakeholders while ensuring platform performance and sustainability through documentation and best practices.

Experis Lime Street, City And County Of the City Of London, United Kingdom £300 – £332 pd

Hybrid Contract

Product Marketing Manager – Enterprise Architects, EMEA

This role focuses on developing and executing go-to-market strategies tailored to Enterprise Architects across EMEA, translating Snowflake’s technical platform strengths into compelling architectural narratives. The person will lead regional marketing programmes, enable sales teams with targeted messaging, and build a community of technical decision-makers. They will also gather regional insights to influence global strategy and ensure alignment between field execution and product marketing.

Snowflake London, United Kingdom

Permanent

Software Architect

This role involves designing scalable, cloud-first SaaS platforms handling high data throughput, with a focus on modernising architecture using Node.js, NestJS, and AWS. The architect will lead microservices and event-driven design, influence AI and data practices, and collaborate with distributed teams. Emphasis is on strong engineering principles and DevOps-aligned patterns in a technology-agnostic environment.

Spectrum IT Recruitment Portsmouth, Hampshire, United Kingdom £85,000 – £95,000 pa