Latest Data Streaming Jobs

Spotlight

Coach - Data Engineer Level 5 - Fully Remote

This role involves coaching and mentoring working professionals through a Data Engineering Level 5 programme, helping them develop practical, real-world data engineering skills. The coach supports learners in building robust, secure, and scalable data solutions while connecting technical concepts to workplace application. It combines technical depth with teaching, mentoring, and assessment guidance in a remote-first, people-centred environment.

Corndel London, United Kingdom

Remote Permanent

Spotlight

Senior Data Engineer

This role involves designing, building, and operating scalable batch and streaming data pipelines that transform vast, unstructured exposed data into reliable, queryable intelligence. The Senior Data Engineer will own end-to-end data workflows, ensure data quality and model readiness, and collaborate closely with ML teams on feature engineering. The position is central to enabling analytics and AI capabilities on a platform that detects corporate data exposure across supply chains.

Lab 1 London, Greater London, United Kingdom £85,000 – £125,000 pa

Hybrid Permanent

Senior Software Engineer II, Kora Compute

This role involves building and maintaining the compute layer of Kora, a cloud-native event streaming platform for Kafka. You will work on highly available, reliable, and scalable systems, collaborating closely with the team and stakeholders to deliver top-notch solutions. The role focuses on solving complex distributed systems and infrastructure challenges, with a strong emphasis on customer success and team collaboration.

Confluent United Kingdom

Remote Permanent

Senior Software Engineer

Design and maintain Golang-based infrastructure services, primarily Kubernetes operators, to support the Confluent Cloud Platform. Work on scalability, availability, and performance of a cloud-native data streaming platform. Collaborate with engineering teams to build and operate large-scale distributed systems using tools like Terraform, Datadog, and Prometheus.

Confluent London, London, City Of, United Kingdom

Remote Permanent

Data Engineer

This role involves building scalable data pipelines and automating ETL processes to support a data-driven organisation. The engineer will work on streaming data ingestion, data modelling, and cost optimisation while promoting best practices in security and governance. Collaboration with data engineering teams and stakeholder engagement are key to delivering reusable, high-quality data solutions.

Third Nexus Group Limited London, United Kingdom £75,000 – £100,000 pa

Hybrid Permanent Clearance Required

Data Engineer

This role involves designing, building, and optimising scalable data pipelines using Python and Databricks within a Lakehouse architecture. The engineer will develop ETL/ELT workflows, ensure data quality and governance, and support analytics and machine learning initiatives. Collaboration with data scientists and analysts is key, along with mentoring junior engineers and implementing monitoring for data systems.

Adecco London, United Kingdom £600 – £700 pd

Hybrid Contract

Data Engineer

This role involves building and maintaining scalable data pipelines on Google Cloud Platform, with a focus on BigQuery, Cloud Composer, and Airflow. The engineer will implement data quality checks, monitoring, and observability using tools like Monte Carlo and Looker, while collaborating closely with data science and product teams. The position emphasizes robust data infrastructure to support AI/ML workflows across the organization.

EF Recruitment London, United Kingdom £300 – £350 pd

Hybrid Contract

Snowflake Data Architect

This role involves defining enterprise data architecture and leading large-scale cloud data transformations, with a focus on Snowflake, event-driven systems, and modern integration patterns. The architect will establish technical standards, drive platform modernisation, and collaborate with engineering teams to deliver scalable, secure data solutions in a hybrid environment.

Tenth Revolution Group London, United Kingdom £90,000 – £120,000 pa

Hybrid Permanent

Senior Data Engineer

This role involves designing and building scalable ETL/ELT pipelines using Snowflake and AWS, with a focus on streaming data ingestion, automation, and data governance. The engineer will work closely with business stakeholders to translate technical solutions into real-world impact, while mentoring junior team members and driving cloud transformation initiatives.

Ikhoi Recruitment Ec2M1Jj, EC2M 1JJ, United Kingdom £80,000 – £94,000 pa

Hybrid Permanent

Principal Data Engineer - Active SC required

This role involves designing and maintaining secure, scalable data architectures for a defence client's Secure Digital Platform. The Principal Data Engineer will lead development of enterprise data pipelines and integration frameworks, enforce data engineering standards, and support cloud modernisation initiatives. It requires strong expertise in cloud platforms, DataOps, and working within classified environments.

Matchtech Reading, Berkshire, United Kingdom

Hybrid Contract Clearance Required

Lead Data Engineer (Kafka/Kinesis)

Lead the design and implementation of a greenfield data platform for an AI-driven property management product, with full technical ownership of data architecture, real-time and batch pipelines, and integration with AI/ML systems. Work closely with engineering and product teams to build scalable data infrastructure using Kafka or Kinesis and modern data stack technologies.

Harnham - Data and Analytics Recruitment London, United Kingdom £90,000 – £100,000 pa

Hybrid Permanent

Senior Manager Architect - Data

As a Senior Manager Architect in Data at Capital One, you will lead the technical direction and evolution of the company's cloud-based data ecosystem. You will shape the architecture for distributed data processing, storage, and consumption, while fostering innovation and collaboration across various teams including Engineers, Data Scientists, and Data Governance associates.

Capital One Tower, Greater London, City And County Of the City Of London, United Kingdom

Hybrid Permanent

Software Engineer - AI / ML

This role involves building and maintaining scalable data pipelines for AI/ML applications, focusing on data quality, reliability, and observability. The engineer will work closely with data science and product teams to design and implement data infrastructure on Google Cloud Platform using tools like Airflow, Dataflow, and Spark. Key responsibilities include managing batch and streaming pipelines, ensuring robust data tracking, and supporting cross-functional initiatives in a collaborative environment.

EF Recruitment Victoria, Greater London, London, SW1P 1BX, United Kingdom £350 pd

Hybrid Contract

Data Engineer

This role involves designing and building cloud-based data platforms using modern technologies like Python, PySpark, Databricks, and Snowflake. You will work on complex data pipelines, ensure data quality, and collaborate closely with underwriting, actuarial, and regulatory teams. The position offers a high-impact, engineering-led environment with opportunities for technical leadership and mentorship.

Tenth Revolution Group London, United Kingdom £60,000 – £90,000 pa

Hybrid Permanent

Lead Data Architect / Lead Data Engineer - Azure Databricks | Energy Trading

Lead the design and technical implementation of a modern Azure Databricks Lakehouse platform within a major Energy & Utilities transformation programme. Drive best practices in scalable data engineering, building robust Spark and Delta Lake pipelines for both streaming and batch workloads while mentoring engineers and shaping future-state data architecture.

Broster Buchanan Wc2N5Du, WC2N 5DU, United Kingdom £600 – £675 pd

Remote Contract

DV Cleared Data Engineer

Design and maintain secure, scalable data pipelines and platforms in a classified government environment. Work with batch and streaming data using Python, SQL, and Elasticsearch, within Agile delivery frameworks. Support intelligence operations through robust data engineering and modern architecture on cloud and on-premise systems.

Experis Bath, Somerset, TA7 8PH, United Kingdom £400 – £500 pd

On-site Contract Clearance Required