218 jobs
Databricks London
Owns the core write-path operations for Delta Lake, the open-source storage layer behind the Databricks Lakehouse, driving performance innovations like Low Shuffle Merge and Deletion Vectors. Designs and maintains high-QPS, low-latency backend systems at massive scale while providing technical leadership, mentoring engineers and leading complex cross-team projects.
Palantir Technologies London
Works deep inside the data processing infrastructure behind Palantir Foundry, on how computations are represented, query plans optimised, operators executed, and data read and written efficiently. Builds on and extends Apache Spark, DataFusion and Iceberg, taking on production problems such as writing planning rules or speeding up large table scans through design, code review, testing and release.
Palantir Technologies London US$10,500 pm
Works deep inside the data processing infrastructure behind Foundry, covering query plan optimisation, execution operators, and efficient data reads and writes. Extends open-source engines and table formats such as Apache Spark, DataFusion, and Iceberg, with work spanning design, code review, testing, and release. An internship aimed at students graduating in 2028.
Rise Technical Recruitment London £35,000 – £50,000 pa
Hands-on role developing and maintaining software with Python, Go and TypeScript, processing and validating live and historical sports datasets, and supporting AWS cloud infrastructure and production systems. Works closely with experienced engineers on SQL databases, troubleshooting and technical projects within the sports and betting sector.
Circle Recruitment Dudley £65,000 – £85,000 pa
Technical owner of a Microsoft Fabric data platform, building and maintaining data pipelines, ETL/ELT processes and integrations from APIs, flat files and ERP systems. Works with Finance, Commercial and BI teams to shape data architecture during a major Fabric migration, with Databricks, Azure data lakes and warehousing in the stack.
Tenth Revolution Group London £75,000 – £105,000 pa
Design, build and deploy production-grade LLM and Generative AI applications, including RAG solutions, scalable data pipelines and AI-powered services for enterprise clients. The role blends software and data engineering with modern AI platforms, plus deployment, monitoring and optimisation of live systems, in a fully remote team of engineers, architects and AI specialists.
ISR Recruitment United Kingdom £475 – £525 pd
Hands-on engineering and architecture role designing and building an open-source, cloud-agnostic data transformation layer for a national data exchange platform. Day to day involves building Apache NiFi flows, developing RDF/SPARQL pipelines and supporting components in Python and Java, plus automated testing, monitoring and secure integrations. Distinct for combining reusable pipeline architecture with semantic data modelling for a central government client.
Harnham - Data and Analytics Recruitment Oxford £65,000 – £75,000 pa
Lead the development of a greenfield AWS capability while supporting an existing Azure estate, acting as the AWS subject matter expert. Hands-on work spans architecture, Landing Zones, governance, Terraform IaC, CI/CD pipelines with GitHub Actions and Azure DevOps, plus automation, security and mentoring junior engineers.
Deerfoot Recruitment Solutions United Kingdom £90,000 – £115,000 pa
Designs and delivers secure, scalable cloud-native data platforms across AWS, Azure and GCP for enterprise clients, leading migrations to Snowflake, Databricks, BigQuery, Synapse and Redshift. Builds PoCs and MVPs for AI and advanced analytics, automates infrastructure with Terraform and CI/CD, and advises senior stakeholders on data strategy, Data Mesh and Data Fabric architecture.
Harnham - Data and Analytics Recruitment London £90,000 – £110,000 pa
Defines and evolves the architecture of a modern cloud-based data platform, providing technical leadership across data platform and engineering teams. Designs scalable, secure data solutions and champions DataOps practices including CI/CD, testing, monitoring and automation, while guiding ETL/ELT implementation and AI-enablement initiatives.
Matillion Hyderabad, India
You'll work in a small cross-functional team writing, testing and releasing new features and fixing problems across Matillion's data automation products, from design through CI/CD deployment to ongoing production support. The stack spans Java, Spring microservices, React, GraphQL, Docker, Kubernetes and AWS, with code reviews, research projects and mentoring built into the role.
Tenth Revolution Group London £70,000 – £85,000 pa
Builds and maintains scalable data pipelines in Databricks, developing batch and streaming workflows and designing Lakehouse architectures with medallion models. Works alongside data scientists, analysts and product teams in a cloud-first Azure environment, implementing data quality, governance and observability frameworks while driving engineering best practice through code reviews.
ClickHouse United Kingdom
Owns the collection, storage and serving of metrics from customer ClickHouse instances, building and operating a petabyte-scale platform that handles trillions of records and millions of events per second. The stack is Golang, Kubernetes and ClickHouse, with work spanning billing data pipelines, customer dashboards, reliability, cost-efficiency and on-call, in a fully remote, globally distributed team.
Real United Kingdom £600 – £700 pd
Lead data architecture across multiple transformation programmes at a university, producing architecture artefacts, standards and documentation. Design and assure data flows, integration patterns and system mappings, and support data governance frameworks and operating models. Involves facilitating workshops, presenting to Architecture Boards, and handing over to a permanent Data Architect.
ClickHouse United Kingdom
Owns reliability, availability and scalability of ClickHouse Cloud, building SLOs/SLAs, monitoring and alerting across data plane, control plane and core. Leads incident response, blameless post-mortems and chaos engineering, and develops Go/Python tooling to improve operational efficiency. Works across engineering, security, support and operations teams, with on-call responsibilities.
