Databricks Engineer Jobs

Specialists who build and optimise data pipelines using Databricks. A key role in modern data infrastructure, focusing on scalable and efficient data processing.

Open roles
7
Salary range
£48k – £140k
Hiring companies
6

Databricks Engineers are at the forefront of building and maintaining robust data infrastructure. They work with cutting-edge tools and technologies to create scalable and efficient data pipelines, ensuring that data is processed, stored, and accessed seamlessly. These roles are in high demand across a variety of industries, from finance and healthcare to retail and technology, where data-driven decision-making is crucial. Databricks Engineers collaborate closely with data scientists, data analysts, and other stakeholders to ensure that data infrastructure meets the organisation's needs.

What the role does

Inside the role of a Databricks Engineer

A typical week for a Databricks Engineer is a mix of coding, testing, and collaboration. They spend time writing and optimising Spark jobs, troubleshooting issues, and working with cross-functional teams.

  1. 01
    Design and implement data pipelines using Databricks.
  2. 02
    Optimise and troubleshoot existing data processing workflows.
  3. 03
    Collaborate with data scientists and analysts on data requirements.
  4. 04
    Monitor and maintain data infrastructure for performance and reliability.
  5. 05
    Document and communicate changes and improvements to the team.
  6. 06
    Stay updated with the latest Databricks features and best practices.
Salary on the board

£48k – £140k

Based on advertised midpoints across the 6 priced listings posted in the last 12 months. Base salary only.

Salary visibility
25% of listings advertise a salary.
Skills & tools

What hiring managers ask for

% of 3 listings posted in the last 12 months that mention each skill, extracted from job descriptions.

Databricks
100%
SQL
100%
Python
67%
Azure
67%
Lakehouse
67%
Data Modelling
67%
Apache Spark
33%
Scala
33%
Data Pipelines
33%
Data Transformation
33%
Data Integration
33%
APIs
33%
Career ladder

From Junior to Principal

A typical UK progression for databricks engineers. Years are guidance — strong people move faster, and many senior folks sidestep into research, product or management.

  1. Level 1

    Junior Databricks Engineer

    0–2 yrs

    Assists in the design and implementation of basic data pipelines. Focuses on learning and contributing to small-scale projects.

  2. Level 2

    Databricks Engineer

    2–5 yrs

    Takes ownership of mid-sized data pipelines. Collaborates with cross-functional teams to ensure data infrastructure meets business needs.

  3. Level 3

    Senior Databricks Engineer

    5–8 yrs

    Leads the design and implementation of complex data pipelines. Mentors junior engineers and drives best practices within the team.

  4. Level 4

    Principal Databricks Engineer

    8+ yrs

    Strategises and oversees the entire data infrastructure. Influences organisational data strategy and leads large-scale projects.

Pathway

How to become a Databricks Engineer

There's no single route, but most people follow some version of these steps.

  1. 1

    Learn the Basics

    Start by mastering the fundamentals of Databricks, including Spark, Delta Lake, and the Databricks Unified Data Analytics Platform.

  2. 2

    Build Small Pipelines

    Gain hands-on experience by designing and implementing small-scale data pipelines. Focus on best practices and efficiency.

  3. 3

    Collaborate with Teams

    Work closely with data scientists, analysts, and other engineers to understand data requirements and improve data infrastructure.

  4. 4

    Lead Mid-Sized Projects

    Take ownership of mid-sized data pipelines. Ensure they are scalable, efficient, and meet business needs.

  5. 5

    Mentor Junior Engineers

    Share your knowledge and experience with junior engineers. Help them grow and develop their skills.

  6. 6

    Influence Data Strategy

    Strategise and influence the organisation's data infrastructure. Lead large-scale projects and drive innovation.

Live jobs

7 live roles

Senior Data Engineer (Databricks)

Design and build scalable data pipelines within a Databricks and Azure-based Lakehouse environment, focusing on high-performance batch and streaming solutions using PySpark and Delta Lake. Implement medallion architecture patterns and data quality frameworks while collaborating with data scientists and product teams. Influence platform evolution and engineering best practices in a cloud-first, technically rigorous team.

Tenth Revolution Group Surrey, United Kingdom £75,000 – £90,000 pa

Databricks Data Engineer

Design and build scalable data pipelines and analytics solutions using Azure Databricks and Azure Data Factory within an HR technology environment. Work with complex, multi-format datasets to deliver production-ready, secure, and observable data products integrated across the employee lifecycle. Collaborate with engineering, product, and HR teams in an Agile environment with strong DevOps and CI/CD practices.

Coltech Recruitment London, United Kingdom £400 – £600 pa

Senior Data Engineer (Databricks)

Build and optimize scalable data pipelines in Databricks to unify marketing, CRM, and paid media data into a centralized lakehouse. Collaborate with analytics and marketing teams to develop data models supporting dashboards, attribution, and marketing mix modeling. Work in a greenfield environment to establish a single source of truth across diverse data sources.

Lawrence Harvey Uxbridge, London, UB8 1SB, United Kingdom £69,000 – £72,000 pa

Lead Azure Databricks Platform Engineer / Architect

This role involves hands-on engineering and architectural leadership for an enterprise Azure Databricks platform, focusing on enabling Serverless workloads, implementing FinOps controls, and migrating analytical workloads from POSIT/RStudio. The engineer will optimise cost, performance, and security across data pipelines, implement tagging and budgeting systems, and enhance the Discovery Zone for broader adoption. Key responsibilities include direct development, migration pattern design, and cross-team collaboration in a regulated environment.

TXP London, United Kingdom £500 – £501 pd
Hybrid Contract

Data Engineer - Sales Data - Azure Databricks

The role involves working with sales and product data to measure year-on-year subscription growth, focusing on accurate categorisation of retired and active products. The engineer will ensure data integrity across historical and current sales datasets within an Azure Databricks environment. Key tasks include data mapping, pipeline development, and alignment with business-defined metrics for uplift, upsell, cross-sell, and cancellations.

Square One Resources London, United Kingdom £500 – £560 pd

Azure Cloud Infrastructure Engineer – SC Cleared / Databricks

Design and implement scalable Azure cloud environments with a focus on Databricks, data platforms, and DevOps pipelines. Work within a secure enterprise setting to migrate and optimise infrastructure using Infrastructure as Code and automated CI/CD workflows. Collaborate with architects and engineering teams to ensure secure, compliant, and high-performance cloud solutions.

DCV Technologies Derby, Derbyshire, DE1 3AE, United Kingdom £600 pd
Hybrid Contract Clearance Required

SQL Analytics Engineer (AI-Enabled, Databricks) - Software

The role involves designing and optimizing analytics solutions within a large-scale data environment, focusing on SQL development, performance tuning, and troubleshooting data issues. The engineer will use AI-assisted tools to accelerate coding and testing while ensuring the accuracy of AI-generated outputs. Collaboration with global teams and continuous improvement of data workflows and reporting systems are key aspects of the position.

Salt London, United Kingdom £350 – £450 pd
Hiring locations

Where this role is hiring

The locations with the most live listings for this role today.

FAQs

Common questions

  • Essential skills include proficiency in SQL, Python, and Scala, a strong understanding of data warehousing and ETL processes, and experience with Apache Spark and Databricks.

  • Gain experience with data engineering tools and technologies, particularly Databricks and Apache Spark. Consider certifications and hands-on projects to build your portfolio.

  • Responsibilities include designing and implementing data pipelines, optimising data processing workflows, troubleshooting issues, and collaborating with cross-functional teams.

  • The typical career path includes roles such as Junior Databricks Engineer, Databricks Engineer, Senior Databricks Engineer, and Principal Databricks Engineer.

  • Salaries for Databricks Engineers can vary based on experience and location. For specific salary ranges, please refer to the salary section on this page.

Hiring databricks engineers?

Post your role in 90 seconds and reach the specialist audience that already reads this page.