Latest streaming engineer Jobs

Staff Software Engineer I

This role involves developing a next-generation multi-modal storage engine as part of the Tableflow project, focusing on scalable table materialization, compaction, and highly available compute infrastructure. The engineer will work on enabling seamless consumption of streaming data as both tables and streams, integrating with Confluent Cloud at scale. Collaboration with product, design, and engineering teams ensures tight integration of storage features within the broader platform.

Confluent United Kingdom

Remote Permanent

ESRI Data Engineer

This role involves designing, building, and maintaining data pipelines that ingest, process, and disseminate operational and geospatial data within on-premise enterprise environments. The engineer will work across the full data lifecycle, integrating diverse sources such as APIs, message brokers, and sensors, with a focus on reliability, security, and performance. Emphasis is placed on strong data engineering fundamentals, troubleshooting complex platform dependencies, and enabling maritime domain awareness through robust data services.

Carbon 60 Portsmouth, Hampshire, United Kingdom

Principal Data Engineer - Active SC required

This role involves designing and maintaining secure, scalable data architectures for a defence client's Secure Digital Platform. The Principal Data Engineer will lead development of enterprise data pipelines and integration frameworks, enforce data engineering standards, and support cloud modernisation initiatives. It requires strong expertise in cloud platforms, DataOps, and working within classified environments.

Matchtech Reading, Berkshire, United Kingdom

Hybrid Contract Clearance Required

Senior Backend Engineer - ClickStack

Build and scale backend services for a petabyte-scale observability platform that unifies logs, metrics, traces, and session replays. Design high-throughput data pipelines and APIs with a focus on developer experience, working closely with open-source contributors and customers to shape the future of debugging in production.

ClickHouse United Kingdom

Principal AI Data Engineer

This role involves developing and deploying AI, GenAI, and agentic AI systems using Azure AI Foundry, Databricks Mosaic AI, and LangChain-based frameworks. The engineer will build production-ready generative AI applications, focusing on RAG pipelines, agent design, and scalable workflows on Databricks. Responsibilities include prompt engineering, evaluation framework development, and applying DevOps practices to ensure robust, high-performing AI solutions for commercial trading teams.

Tatton Recruitment South Bank, London, SE1 9PZ, United Kingdom £750 – £800 pd

Senior Software Engineering

This role involves leading the design and delivery of enterprise-grade software and data platforms using Python, C#/.NET, and modern data technologies. The engineer will drive technical strategy, modernize legacy systems, and deliver scalable data solutions across cloud and on-prem environments. Collaboration with data, analytics, and architecture teams is key to enabling robust, secure, and high-performance systems.

Adecco London, United Kingdom £600 – £650 pd

Hybrid Contract

Senior Machine Learning Engineer, Developer Advocacy | UK |

Build and operate personalized recommendation systems for Grafana's in-product learning experience, evolving a rule-based engine into a data-driven, real-time recommender. Collaborate with engineers and analysts to ship iterative improvements using product telemetry, content metadata, and experimentation. Own model development, evaluation, and integration within a distributed system environment.

Grafana Labs United Kingdom £91,755 – £110,106 pa

Remote Permanent

Palantir Developer

Design and build scalable data pipelines using Palantir Foundry and Gotham to integrate complex, multi-source data for government programmes. Develop ETL workflows, automate data transformations, and deliver actionable insights in mission-critical environments. Work within Agile, cross-functional teams to translate client needs into robust, production-grade data solutions.

Experis United Kingdom £45,000 – £60,000 pa

Senior Solutions Architect (EDW Enterprise Data Warehouse Migrations)

This role focuses on leading enterprise data warehouse migrations from legacy systems to the Databricks Intelligence Platform. The Senior Solutions Architect will design technical go-to-market strategies, develop scalable migration frameworks, and act as a top-tier technical advisor for complex customer transitions across EMEA. Key responsibilities include building automated assessment tools, mentoring regional teams, and bridging field feedback into product development.

Databricks London, United Kingdom

Data Architect

The role involves leading enterprise data architecture assessments, mapping systems and data flows, and identifying risks and inconsistencies. It focuses on defining data models, improving integration patterns, and enabling data readiness for AI. The architect will work across teams to align data strategy with business needs and improve data quality and traceability.

Experis London, United Kingdom £585 pd

Hybrid Contract

Senior Data Analyst

This role involves building and maintaining scalable data pipelines for AI/ML-driven user experience projects, using Google Cloud Platform and tools like Airflow and Cloud Composer. The analyst will ensure data quality and system reliability through monitoring with Monte Carlo, Looker, Splunk, and NewRelic, while collaborating closely with product engineering and data science teams. Responsibilities include data ingestion, pipeline orchestration, and technical documentation to support cross-functional data initiatives.

EF Recruitment Victoria, Greater London, London, SW1P 1BX, United Kingdom £500 pd

Data Architect

Design and evolve enterprise-wide data architecture, including data models and cloud platform strategy, while guiding teams on integration and governance. Lead migration from legacy systems to modern cloud environments, with a focus on scalability and best practices. Work in a hybrid setup with regular onsite collaboration.

TRIA Worcestershire, United Kingdom £70,000 – £79,000 pa

Hybrid Permanent

Data Architect

This role involves defining and evolving enterprise-wide data architecture, including creating data models and guiding cloud migration efforts. The architect will shape data platform strategy, integration, and governance while working across engineering teams. It's a key position in a major technology and data transformation, with a focus on modern cloud platforms and advanced data architectures.

TRIA Hampshire, United Kingdom £70,000 – £79,000 pa

Director of Data

Leads the enterprise data platform strategy and a team of ~60 data professionals, driving the shift from traditional analytics to real-time, AI-powered data products. Focuses on scalable data platforms, streaming, APIs, and modern data governance in a highly regulated environment. Works cross-functionally with data science, AI, and product teams to enable conversational data experiences and digital transformation.

Harnham - Data and Analytics Recruitment Usa, United Kingdom US$250,000 – US$300,000 pa

Data Architect

The Data Architect will define and evolve the global data architecture for a multinational entertainment business, ensuring consistency and trust in data used for commercial decision-making. This role involves designing data models, contracts, and governance frameworks across marketing, finance, and operations, with a strong focus on privacy, security, and cross-border compliance. The architect will collaborate with engineering, analytics, and business teams to enable scalable access to data for AI, ML, and analytics in a cloud-native environment.

Young's Employment Services Leicester Square, London, United Kingdom £95,000 – £100,000 pa