Future Tech Jobs Future Tech Jobs

Databricks Platform Engineer

Sagacity
London, United Kingdom
Last week
Job Type
Permanent
Work Pattern
Full-time
Work Location
On-site
Seniority
Senior
Education
Degree
Posted
20 May 2026 (Last week)
Share
Save job
Create job alert

Platform Architecture & Engineering responsibilities:

  • Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements
  • Architect end-to-end data platforms including ingestion, storage (Delta Lake), processing, and consumption layers
  • Build and configure cloud infrastructure using infrastructure-as-code (e.g. Terraform & Declarative Automation Bundles(DAB's))
  • Establish secure, compliant environments including networking (VNet/VPC, Private Link), identity (IAM/Entra ID), data governance (Unity Catalog), and access controls
  • Define environment strategies (dev/test/prod), CI/CD pipelines, and release processes for Databricks deployments
  • Implement monitoring, logging, cost optimisation, and performance tuning across the platform
  • Design and implement data pipelines using Delta Live Tables, Auto Loader, and Databricks Workflows for both batch and streaming workloads

Client Delivery & Enablement responsibilities:

  • Work directly with clients to translate business and technical requirements into scalable platform designs
  • Lead technical workshops, architecture sessions, and whiteboarding engagements with client stakeholders
  • Support rapid prototyping and proof-of-concept builds within Databricks to demonstrate platform capabilities and accelerate client adoption
  • Provide best practice guidance on Lakehouse architecture, data modelling, workload optimisation, and cost management
  • Produce high-quality technical documentation including architecture diagrams, architecture decision records (ADRs), runbooks, and deployment guides
  • Enable client teams through structured knowledge transfer, training, and platform handover
  • Collaborate with data engineers, data scientists, and product teams to ensure successful delivery outcomes

Governance & Security:

  • Implement Unity Catalog for centralised data governance, including access control (RBAC/ABAC), data lineage, audit logging, and compliance enforcement
  • Apply security best practices across platform design: network isolation, secret management, encryption at rest and in transit, and identity federation
  • Ensure platform designs meet client regulatory and compliance requirements (e.g. GDPR, ISO 27001, sector-specific standards)

What success looks like in the role:

  • Delivery of robust, secure, and scalable Databricks platforms that meet client performance and cost expectations
  • Clear, well-architected solutions that balance flexibility, governance, and operational efficiency
  • Strong client relationships built on trust, technical credibility, and effective communication
  • Accelerated client adoption of the Lakehouse platform through well-designed enablement and documentation
  • Reduced deployment time through reusable infrastructure patterns and automation
  • Proactive identification of risks, trade-offs, and optimisation opportunities across platform design and delivery
  • Contribution to the organisation’s growing body of reusable platform accelerators, reference architectures, and internal knowledge

Competencies and Behaviours:

  • 3+ years experience in data platform engineering, cloud engineering, or similar roles
  • Strong hands-on experience with Databricks, including Apache Spark, Delta Lake, Workflows
  • Proven experience designing and deploying data platforms on AWS and/or Azure (e.g. ADLS, S3, VNet/VPC, IAM)
  • Experience with infrastructure-as-code tools (e.g. Terraform preferred) and CI/CD pipelines (e.g. Azure DevOps, GitHub Actions)
  • Solid understanding of data architecture concepts including Lakehouse medallion architecture and dimensional modelling
  • Familiarity with security and governance frameworks (e.g. RBAC, ABAC, data masking, audit, compliance standards)
  • Excellent communication skills with the ability to explain complex technical concepts to non-technical stakeholders
  • Comfortable working in a client-facing consultancy environment with multiple concurrent engagements
  • Proactive, self-driven, and able to take ownership of end-to-end platform delivery
  • Willingness to travel within the UK as required
  • Right to work in the UK

Related Jobs

View all jobs

Senior Data Platform Owner

Costa Coffee St. Albans, United Kingdom
Hybrid

Engineering Manager - Platform Reliability

Databricks London, United Kingdom

AI Platform Engineer (DevOps / MLOps Focus)

The Portfolio Group London, United Kingdom
£80,000 pa On-site

Data Engineer - Databricks

Akkodis Manchester, United Kingdom
£50,000 – £60,000 pa Hybrid

Lead Data Platform Engineer | |+ 4 day week

Akkodis United Kingdom
£70,000 – £85,000 pa Remote

Platform Engineer

Digital Waffle London, United Kingdom
£70,000 – £75,000 pa Remote

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Products

Where to Advertise Data Engineering Jobs in the UK (2026 Guide)

Where to advertise data engineering jobs UK in 2026: the specialist boards and channels that reach Spark, dbt, Snowflake and platform engineering talent. Data engineers occupy a distinct discipline that sits between software engineering, data science and cloud infrastructure — and the strongest candidates identify firmly with the data engineering community rather than with adjacent roles. General job boards consistently conflate data engineering with data analysis, data science and BI development, producing high application volumes but low candidate quality for specialist pipeline and platform roles. This guide, published by DataEngineeringJobs.co.uk, covers where to advertise data engineering roles in the UK in 2026, how the main platforms compare, what employers should expect to pay, and what the data says about hiring across different role types.

Jobs

Data Engineering Jobs UK 2026: What to Expect Over the Next 3 Years

Data Engineering Jobs UK 2026: roles, salaries and the trends shaping UK data engineering hiring over the next three years — Spark, dbt, lakehouse and AI. Data engineering has become one of the most strategically important disciplines in the entire technology sector — and one of the most reliably in-demand. Every organisation that wants to use data to make decisions, train AI models, personalise products, manage risk, or understand its customers depends on data engineers to build the infrastructure that makes any of that possible. Without well-designed, reliable data pipelines, the most sophisticated machine learning model is worthless and the most ambitious analytics strategy is undeliverable. That foundational importance has made data engineering hiring remarkably resilient through the technology market corrections of the past few years. Where headcount reductions fell heavily on some engineering disciplines, demand for data engineers held firm — because the work of building and maintaining data infrastructure cannot be deferred in the way that some product development can. The data keeps coming. The pipelines need to work. But the data engineering jobs market of 2026 is not simply a stable version of what it was three years ago. The discipline has undergone a series of architectural shifts — from batch to streaming, from on-premise data warehouses to cloud-native lakehouses, from hand-rolled pipelines to declarative transformation frameworks, and most recently toward AI-augmented data engineering workflows that are beginning to reshape what the role looks like in practice. The employers hiring data engineers today are asking for a meaningfully different skill set than those hiring three years ago. The candidates who will thrive over the next three years are those who understand where the discipline is heading — which architectural patterns are becoming standard, which technologies are defining the modern data stack, and how the definition of a data engineering career is evolving toward a richer intersection of infrastructure, analytics, and AI enablement. This article breaks down what the UK data engineering jobs market is likely to look like through to 2028 — covering the titles emerging right now, the technologies driving employer demand, the skills that will matter most, and how to position your career ahead of the curve.

🍪 Basic, anonymous analytics (aggregate counts only, never shared) are always on. Accept to also enable third-party tools — Google Analytics, Microsoft Clarity, Mixpanel, Leadfeeder — which help us match you with relevant Data Engineering roles. We never sell your data or use it for cross-site advertising. See our Cookie Policy.