Latest Data Streaming Jobs

Senior Software Engineer

As a Senior Software Engineer, you will work on the Tableflow project, developing and maintaining a multi-tenant, highly available storage infrastructure for Kora. Your responsibilities include designing and implementing strategies for table materialization and compaction at scale, ensuring high availability and scalability, and collaborating with cross-functional teams to integrate storage features.

Confluent United Kingdom

Remote Permanent

Staff Software Engineer I

This role involves developing and scaling the Tableflow project, a next-generation multi-modal storage engine that enables seamless streaming and table-based data consumption. The engineer will focus on building highly available, scalable infrastructure for table materialization, compaction, and background maintenance at massive scale. The work sits at the intersection of distributed systems and data infrastructure, with deep integration into Confluent Cloud's core storage architecture.

Confluent United Kingdom

Remote Permanent

Senior Data Engineer

This role involves designing and maintaining scalable ETL/ELT pipelines for large-scale economic and financial datasets, using Azure Databricks, Spark, and Delta Lake. The engineer will implement data governance with Azure Purview, optimize cloud workloads, and collaborate with economists and data scientists to deliver reliable data infrastructure. Key responsibilities include automation, CI/CD integration, and mentoring within a hybrid working environment.

Velocity Talent London, United Kingdom £75,000 – £80,000 pa

Hybrid Permanent Clearance Required

Senior Software Engineer

This role involves developing a semantic data integration platform and open-source schema language, with work spanning Kotlin backend services, reactive streaming pipelines, AI agent orchestration using Spring AI, and full-stack contributions. Engineers contribute to both enterprise and open-source components, focusing on secure, scalable systems used by financial institutions. The role emphasizes autonomy, customer empathy, and innovation in a distributed, async-first team environment.

Oscar Technology London, United Kingdom £70,000 – £90,000 pa

IAM Devops

This role involves designing and maintaining secure, scalable infrastructure with a focus on identity and access management within a DevOps framework. The engineer will work on CI/CD pipelines, containerized environments using Kubernetes and Docker, and ensure compliance through policy-as-code and security automation. Responsibilities include supporting data streaming platforms, graph-based systems, and regional deployment strategies in a hybrid working environment.

Vallum Associates Sheffield, South Yorkshire, United Kingdom £430 – £500 pd

Hybrid Contract

SC cleared GCP Cloud engineer

This role involves designing and managing secure, scalable cloud infrastructure on Google Cloud Platform, with a strong focus on Kubernetes and containerised workloads. The engineer will apply infrastructure-as-code practices using tools like Terraform and Ansible, and contribute to CI/CD pipelines in a highly regulated environment. Emphasis is placed on security-hardened deployments, making this role well-suited to professionals with experience in government or defence sectors.

Opus Recruitment Solutions London, United Kingdom £450 – £500 pd

Senior Databricks Architect

This role involves designing and delivering enterprise-scale data platforms using Databricks and AWS, with a focus on modernising legacy systems and building cloud-native data solutions. The architect will develop scalable data pipelines, implement real-time processing, and lead the adoption of lakehouse architectures using Medallion principles. Emphasis is placed on data governance, security, and cross-functional collaboration within complex transformation programmes.

Tenth Revolution Group London, United Kingdom £85,000 – £115,000 pa

Hybrid Permanent

AI Deployment Engineer

This role involves owning the data infrastructure for AI deployments, integrating AI solutions into existing business systems, and ensuring reliable and scalable production-grade pipelines. You will work closely with AI strategists to build and maintain the technical backbone that supports AI tooling, including data pipelines, APIs, and system integrations.

Emponics Almondsbury, Gloucestershire, BS32 4DS, United Kingdom £80,000 – £130,000 pa

Permanent

AI Deployment Engineer

As an AI Deployment Engineer, you will be responsible for building and maintaining the data infrastructure that supports AI deployments, integrating AI solutions into existing business systems, and ensuring the reliability and scalability of deployed AI solutions. You will work closely with AI Deployment Strategists to take prototypes to production and manage the technical backbone of the company's AI tooling.

Emponics Cornhill, Greater London, City And County Of the City Of London, United Kingdom £80,000 – £130,000 pa

Permanent

Senior Java Engineer

Global technology & software product company operating in the observability and monitoring space, is looking for aSenior Java Engineer to join their Platform Team in London. You'll help build the distributed services that sit at the core of their product,...

hireful Central London, W3 0BJ, United Kingdom £120,000 – £130,000 pa

AI Platform Architect

Design and lead the development of enterprise-scale AI platforms for a major financial services client, focusing on cloud-native, secure, and governed solutions across traditional ML and Generative AI. Drive MLOps, LLMOps, and AgentOps best practices while ensuring compliance with financial regulations. Collaborate across engineering, data, and business teams to deliver production-ready AI systems on Google Cloud Platform.

83zero London, United Kingdom £90,000 – £100,000 pa

Hybrid Permanent

Senior Java Engineer

Design and build distributed services from the ground up using core Java, Kafka, and Kubernetes. Work on event-driven systems at scale, solving complex data consistency and availability challenges. Mentor peers while owning key parts of a globally used observability platform within months of joining.

hireful Central London, United Kingdom £11,000 – £130,000 pa

Senior Machine Learning Engineer, Developer Advocacy | UK |

Build and operate personalized recommendation systems for Grafana's in-product learning experience, evolving a rule-based engine into a data-driven, real-time recommender. Collaborate with engineers and analysts to ship iterative improvements using product telemetry, content metadata, and experimentation. Own model development, evaluation, and integration within a distributed system environment.

Grafana Labs United Kingdom £91,755 – £110,106 pa

Remote Permanent

Data Engineer

This role involves designing and building robust data pipelines to integrate data from external sources into a central platform, while ensuring data quality, reliability, and system integrity. The Data Engineer will enhance and maintain the data platform, collaborate with stakeholders to improve data accessibility, and adopt advanced analytics technologies. Work is conducted within a high-performance team environment focused on innovation and continuous improvement in data engineering practices.

Catalyst Newcastle upon Tyne, Tyne & Wear, NE1 4JA, United Kingdom

Hybrid Permanent

Data Engineer (Full-Stack Data Products)

Design and build scalable data pipelines and full-stack data products, integrating data from diverse sources into cloud platforms while ensuring data quality and reliability. Develop production-grade applications and APIs using modern DevOps practices, collaborating across teams to enhance data accessibility and drive innovation with cloud-native solutions. Work within a high-performing engineering team to support analytics and AI-driven systems using distributed computing and infrastructure-as-code.

Catalyst Newcastle upon Tyne, Tyne & Wear, United Kingdom