Databricks Engineer Jobs

Specialists who build and optimise data pipelines using Databricks. A key role in modern data infrastructure, focusing on scalable and efficient data processing.

Open roles
7
Salary range
£42k – £119k
Hiring companies
6

Databricks Engineers are at the forefront of building and maintaining robust data infrastructure. They work with cutting-edge tools and technologies to create scalable and efficient data pipelines, ensuring that data is processed, stored, and accessed seamlessly. These roles are in high demand across a variety of industries, from finance and healthcare to retail and technology, where data-driven decision-making is crucial. Databricks Engineers collaborate closely with data scientists, data analysts, and other stakeholders to ensure that data infrastructure meets the organisation's needs.

What the role does

Inside the role of a Databricks Engineer

A typical week for a Databricks Engineer is a mix of coding, testing, and collaboration. They spend time writing and optimising Spark jobs, troubleshooting issues, and working with cross-functional teams.

  1. 01
    Design and implement data pipelines using Databricks.
  2. 02
    Optimise and troubleshoot existing data processing workflows.
  3. 03
    Collaborate with data scientists and analysts on data requirements.
  4. 04
    Monitor and maintain data infrastructure for performance and reliability.
  5. 05
    Document and communicate changes and improvements to the team.
  6. 06
    Stay updated with the latest Databricks features and best practices.
Salary on the board

£42k – £119k

Based on advertised midpoints across the 12 UK listings priced in pounds in the last 12 months. Base salary only.

Salary visibility
35% of listings advertise a salary.
By seniority
£k base
Senior
55
102
7 jobs
Skills & tools

What hiring managers ask for

% of 11 listings posted in the last 12 months that mention each skill, extracted from job descriptions.

SQL
100%
Python
82%
Databricks
73%
CI/CD
64%
Data Modelling
55%
PySpark
45%
Delta Lake
45%
ETL
36%
ELT
36%
Apache Spark
27%
Data Pipelines
27%
Azure
27%
Career ladder

From Junior to Principal

A typical UK progression for databricks engineers. Years are guidance — strong people move faster, and many senior folks sidestep into research, product or management.

  1. Level 1

    Junior Databricks Engineer

    0–2 yrs

    Assists in the design and implementation of basic data pipelines. Focuses on learning and contributing to small-scale projects.

  2. Level 2

    Databricks Engineer

    2–5 yrs

    Takes ownership of mid-sized data pipelines. Collaborates with cross-functional teams to ensure data infrastructure meets business needs.

  3. Level 3

    Senior Databricks Engineer

    5–8 yrs

    Leads the design and implementation of complex data pipelines. Mentors junior engineers and drives best practices within the team.

  4. Level 4

    Principal Databricks Engineer

    8+ yrs

    Strategises and oversees the entire data infrastructure. Influences organisational data strategy and leads large-scale projects.

Pathway

How to become a Databricks Engineer

There's no single route, but most people follow some version of these steps.

  1. 1

    Learn the Basics

    Start by mastering the fundamentals of Databricks, including Spark, Delta Lake, and the Databricks Unified Data Analytics Platform.

  2. 2

    Build Small Pipelines

    Gain hands-on experience by designing and implementing small-scale data pipelines. Focus on best practices and efficiency.

  3. 3

    Collaborate with Teams

    Work closely with data scientists, analysts, and other engineers to understand data requirements and improve data infrastructure.

  4. 4

    Lead Mid-Sized Projects

    Take ownership of mid-sized data pipelines. Ensure they are scalable, efficient, and meet business needs.

  5. 5

    Mentor Junior Engineers

    Share your knowledge and experience with junior engineers. Help them grow and develop their skills.

  6. 6

    Influence Data Strategy

    Strategise and influence the organisation's data infrastructure. Lead large-scale projects and drive innovation.

Live jobs

7 live roles

Azure Databricks Engineer

2 weeks ago

Opus Recruitment Solutions London £500 – £550 pd

Design, build and support scalable data solutions on Azure Databricks, developing SQL, PySpark and Python pipelines and maintaining ETL/ELT flows across Azure, SQL Server and Delta Lake. The role also covers Lakeflow pipelines, Unity Catalog, CI/CD automation and production troubleshooting within a growing data team.

Hybrid Contract

Databricks Data Engineer /London

Last month

Damia Group London £400 – £450 pd

Hands-on data engineering role on a major data transformation and cloud modernisation programme in a regulated banking environment. You will design, build and optimise ETL/ELT pipelines using Databricks, Python, SQL and Oracle, migrate legacy data assets to modern cloud architectures, and troubleshoot production issues. Delivery-focused rather than a technical lead position, working independently with business and technology stakeholders.

Hybrid Contract Clearance Required

Databricks Data Engineer

Last month

Tenth Revolution Group London £70,000 – £85,000 pa

Builds and maintains scalable data pipelines in Databricks, developing batch and streaming workflows and designing Lakehouse architectures with medallion models. Works alongside data scientists, analysts and product teams in a cloud-first Azure environment, implementing data quality, governance and observability frameworks while driving engineering best practice through code reviews.

Hybrid

Data Engineer (Databricks)

Last month

Syntax Consultancy Leeds £500 – £550 pd

Hands-on Data Engineer to run and maintain production data pipelines on Databricks and AWS, combining L2/L3 production support with engineering work. Involves incident investigation, root cause analysis, permanent remediation, and performance troubleshooting across Spark SQL, Delta Lake, Parquet and Hive metastore tables. Works on a large-scale Government project within a hybrid model, mostly remote with occasional Leeds office travel.

Hybrid Contract Clearance Required

Azure Databricks Data Engineer

3 weeks ago

Opus Recruitment Solutions Nottingham £450 – £500 pd

Builds and optimises scalable ETL/ELT pipelines and Lakehouse architectures on Azure Databricks, working with Python, PySpark and Spark SQL across Bronze, Silver and Gold layers on ADLS Gen2. Handles ingestion via Auto Loader and CDC, orchestrates workflows with Lakeflow, and applies Unity Catalog governance and Azure DevOps CI/CD. Hybrid role with three days per week on site in Nottingham.

Hybrid Contract

Staff BI & Data Engineer | Databricks

Last week

Datatech Berkshire £55,000 – £67,000 pa

Owns the end-to-end data journey for a financial services business, building Azure Databricks pipelines with PySpark, SQL, ADF and ADLS Gen2, and governed lakehouse solutions using Delta Lake, medallion architecture and Unity Catalog. Also owns Power BI semantic models, DAX measures and row-level security, translating marketing and contact-centre requirements into trusted metrics while mentoring colleagues and improving engineering standards.

Hybrid Permanent

Data Engineer – Python / SQL / Azure / Databricks

6 days ago

Adria Solutions Southampton £40,000 – £45,000 pa

Hands-on role building and maintaining scalable data pipelines in Python and SQL on a cloud-based enterprise platform using Azure and Databricks. Involves data integration, governance, database administration and exploring AI-driven automation for pipeline monitoring, working closely with Data Scientists and analysts.

Permanent
Hiring locations

Where this role is hiring

The locations with the most live listings for this role today.

FAQs

Common questions

  • Essential skills include proficiency in SQL, Python, and Scala, a strong understanding of data warehousing and ETL processes, and experience with Apache Spark and Databricks.

  • Gain experience with data engineering tools and technologies, particularly Databricks and Apache Spark. Consider certifications and hands-on projects to build your portfolio.

  • Responsibilities include designing and implementing data pipelines, optimising data processing workflows, troubleshooting issues, and collaborating with cross-functional teams.

  • The typical career path includes roles such as Junior Databricks Engineer, Databricks Engineer, Senior Databricks Engineer, and Principal Databricks Engineer.

  • Salaries for Databricks Engineers can vary based on experience and location. For specific salary ranges, please refer to the salary section on this page.

Hiring databricks engineers?

Post your role in 90 seconds and reach the specialist audience that already reads this page.