Future Tech Jobs Future Tech Jobs

Azure Databricks Engineer

Huxley Associates
London, City And County Of the City Of London, United Kingdom
Last month
£140,000 – £160,000 pa
Applications closed

Related Jobs

View all jobs

Data Engineer

Hays Technology Newport, Gwent, NP20 1GF, United Kingdom
£45,000 – £55,000 pa

Data Engineer

hireful Bristol, Bristol (county), United Kingdom
£50,000 – £55,000 pa Hybrid

Data Engineer

hireful Devon, United Kingdom
£50,000 – £55,000 pa Hybrid

Data Engineering - Senior Consultant

RSM London, United Kingdom

Data Platform Manager

Deerfoot Recruitment Solutions Luton, Bedfordshire, United Kingdom
£70,000 pa Remote

Power BI Specialist

Tatton Recruitment Chaucer, London, United Kingdom

Salary

£140,000 – £160,000 pa

Posted
7 Apr 2026 (Last month)
Share
Save job
Create job alert

This is a rare opportunity to apply serious data engineering in a domain where latency, correctness, and reliability carry direct commercial weight.

* Requirements

* 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts

* ETL/ELT pipeline design and implementation at scale; orchestration with Airflow, Prefect, or equivalent; reliability-first mindset including backfill, retry, and exactly-once semantics

* Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage; infrastructure as code for data workloads (Terraform or Bicep)

* Databricks - Delta Lake, Unity Catalog, job cluster vs interactive cluster trade-offs, cost-aware compute management, Spark job optimisation

* Relational databases: PostgreSQL at production scale - query optimisation, indexing strategies, table partitioning, replication, schema design for both OLTP and analytical workloads

* MongoDB - document modelling, aggregation pipelines, indexing strategy, replica sets; clear judgment on when document vs relational storage is the right architectural call

* Containerisation: Docker and Kubernetes-based deployment of data workloads; reproducible, environment-agnostic data infrastructure

* Data modelling for analytical workloads - dimensional modelling, data vault, or equivalent; schema evolution, slowly changing dimensions, and downstream impact analysis

* Stream and batch processing patterns; late data handling, watermarking, and backfill strategies; throughput vs latency trade-offs in pipeline design

* Production data observability - data lineage, quality checks, SLA monitoring, alerting on freshness and completeness; treating data correctness as a first-class concern

* CI/CD for data infrastructure - version-controlled pipelines, automated data quality testing, reproducible and auditable deploys

* Ability to work directly with quant researchers, risk managers, and traders - translate business requirements into reliable, well-documented data products

* Nice to Have

* Financial markets data - market data feeds (Bloomberg, Refinitiv), tick data, trade history, reference data, or instrument master management

* Apache Spark or Flink for large-scale stream and batch processing beyond the Databricks ecosystem

* dbt or equivalent SQL transformation layer; experience building and maintaining dbt projects in a production data warehouse

* Event streaming with Kafka or Confluent Platform - topic design, consumer group management, exactly-once delivery guarantees

* OLAP-optimised stores - ClickHouse, DuckDB, or equivalent; understanding of columnar storage and vectorised query execution

* Energy, commodities, or broader financial markets domain knowledge

* What We're Looking For

* You treat data as a product, not a side effect. You know what it takes to make a pipeline trustworthy - not just running, but observable, tested, and recoverable when something upstream changes at 3am. You think in systems: schema evolution, lineage, freshness SLAs, and the downstream impact of every modelling decision. At ETrading , that data is the foundation of billion-dollar trading decisions. You are the reason it is right.

To find out more about Huxley, please visit

Huxley, a trading division of SThree Partnership LLP is acting as an Employment Business in relation to this vacancy | Registered office | 8 Bishopsgate, London, EC2N 4BQ, United Kingdom | Partnership Number | OC(phone number removed) England and Wales

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Products

Where to Advertise Data Engineering Jobs in the UK (2026 Guide)

Where to advertise data engineering jobs UK in 2026: the specialist boards and channels that reach Spark, dbt, Snowflake and platform engineering talent. Data engineers occupy a distinct discipline that sits between software engineering, data science and cloud infrastructure — and the strongest candidates identify firmly with the data engineering community rather than with adjacent roles. General job boards consistently conflate data engineering with data analysis, data science and BI development, producing high application volumes but low candidate quality for specialist pipeline and platform roles. This guide, published by DataEngineeringJobs.co.uk, covers where to advertise data engineering roles in the UK in 2026, how the main platforms compare, what employers should expect to pay, and what the data says about hiring across different role types.

Jobs

Data Engineering Jobs UK 2026: What to Expect Over the Next 3 Years

Data Engineering Jobs UK 2026: roles, salaries and the trends shaping UK data engineering hiring over the next three years — Spark, dbt, lakehouse and AI. Data engineering has become one of the most strategically important disciplines in the entire technology sector — and one of the most reliably in-demand. Every organisation that wants to use data to make decisions, train AI models, personalise products, manage risk, or understand its customers depends on data engineers to build the infrastructure that makes any of that possible. Without well-designed, reliable data pipelines, the most sophisticated machine learning model is worthless and the most ambitious analytics strategy is undeliverable. That foundational importance has made data engineering hiring remarkably resilient through the technology market corrections of the past few years. Where headcount reductions fell heavily on some engineering disciplines, demand for data engineers held firm — because the work of building and maintaining data infrastructure cannot be deferred in the way that some product development can. The data keeps coming. The pipelines need to work. But the data engineering jobs market of 2026 is not simply a stable version of what it was three years ago. The discipline has undergone a series of architectural shifts — from batch to streaming, from on-premise data warehouses to cloud-native lakehouses, from hand-rolled pipelines to declarative transformation frameworks, and most recently toward AI-augmented data engineering workflows that are beginning to reshape what the role looks like in practice. The employers hiring data engineers today are asking for a meaningfully different skill set than those hiring three years ago. The candidates who will thrive over the next three years are those who understand where the discipline is heading — which architectural patterns are becoming standard, which technologies are defining the modern data stack, and how the definition of a data engineering career is evolving toward a richer intersection of infrastructure, analytics, and AI enablement. This article breaks down what the UK data engineering jobs market is likely to look like through to 2028 — covering the titles emerging right now, the technologies driving employer demand, the skills that will matter most, and how to position your career ahead of the curve.

Jobs

New Data Engineering Employers to Watch in 2026: UK and Global Companies Driving the Data Revolution

New Data Engineering Employers to Watch in 2026: a UK and global shortlist of data platform companies hiring data engineers, pipeline and lakehouse specialists. Data engineering is at the heart of the digital economy, transforming raw data into actionable insights, powering analytics, AI systems, and cloud infrastructure. As the UK and global markets continue to invest heavily in data platforms, pipelines, and real-time analytics, demand for skilled data engineers is growing rapidly. For professionals exploring opportunities on www.DataEngineeringJobs.co.uk , the critical question is: which companies are expanding, hiring, and shaping the future of data-driven business? This article highlights new data engineering employers to watch in 2026, including UK startups, scale-ups, and international firms expanding in the UK.

🍪 Basic, anonymous analytics (aggregate counts only, never shared) are always on. Accept to also enable third-party tools — Google Analytics, Microsoft Clarity, Mixpanel, Leadfeeder — which help us match you with relevant Data Engineering roles. We never sell your data or use it for cross-site advertising. See our Cookie Policy.