Databricks Engineer Jobs

Specialists who build and optimise data pipelines using Databricks. A key role in modern data infrastructure, focusing on scalable and efficient data processing.

Open roles
5
Salary range
£66k – £160k
Hiring companies
6

Databricks Engineers are at the forefront of building and maintaining robust data infrastructure. They work with cutting-edge tools and technologies to create scalable and efficient data pipelines, ensuring that data is processed, stored, and accessed seamlessly. These roles are in high demand across a variety of industries, from finance and healthcare to retail and technology, where data-driven decision-making is crucial. Databricks Engineers collaborate closely with data scientists, data analysts, and other stakeholders to ensure that data infrastructure meets the organisation's needs.

What the role does

Inside the role of a Databricks Engineer

A typical week for a Databricks Engineer is a mix of coding, testing, and collaboration. They spend time writing and optimising Spark jobs, troubleshooting issues, and working with cross-functional teams.

  1. 01
    Design and implement data pipelines using Databricks.
  2. 02
    Optimise and troubleshoot existing data processing workflows.
  3. 03
    Collaborate with data scientists and analysts on data requirements.
  4. 04
    Monitor and maintain data infrastructure for performance and reliability.
  5. 05
    Document and communicate changes and improvements to the team.
  6. 06
    Stay updated with the latest Databricks features and best practices.
Salary on the board

£66k – £160k

Based on advertised midpoints across the 9 UK listings priced in pounds in the last 12 months. Base salary only.

Salary visibility
75% of listings advertise a salary.
By seniority
£k base
Senior
61
108
5 jobs
Skills & tools

What hiring managers ask for

% of 2 listings posted in the last 12 months that mention each skill, extracted from job descriptions.

Databricks
100%
SQL
100%
Lakehouse
100%
Data Modelling
100%
Azure
50%
Python
50%
Azure Data Factory
50%
Data Quality
50%
Git
50%
CI/CD
50%
ETL/ELT
50%
Power BI
50%
Career ladder

From Junior to Principal

A typical UK progression for databricks engineers. Years are guidance — strong people move faster, and many senior folks sidestep into research, product or management.

  1. Level 1

    Junior Databricks Engineer

    0–2 yrs

    Assists in the design and implementation of basic data pipelines. Focuses on learning and contributing to small-scale projects.

  2. Level 2

    Databricks Engineer

    2–5 yrs

    Takes ownership of mid-sized data pipelines. Collaborates with cross-functional teams to ensure data infrastructure meets business needs.

  3. Level 3

    Senior Databricks Engineer

    5–8 yrs

    Leads the design and implementation of complex data pipelines. Mentors junior engineers and drives best practices within the team.

  4. Level 4

    Principal Databricks Engineer

    8+ yrs

    Strategises and oversees the entire data infrastructure. Influences organisational data strategy and leads large-scale projects.

Pathway

How to become a Databricks Engineer

There's no single route, but most people follow some version of these steps.

  1. 1

    Learn the Basics

    Start by mastering the fundamentals of Databricks, including Spark, Delta Lake, and the Databricks Unified Data Analytics Platform.

  2. 2

    Build Small Pipelines

    Gain hands-on experience by designing and implementing small-scale data pipelines. Focus on best practices and efficiency.

  3. 3

    Collaborate with Teams

    Work closely with data scientists, analysts, and other engineers to understand data requirements and improve data infrastructure.

  4. 4

    Lead Mid-Sized Projects

    Take ownership of mid-sized data pipelines. Ensure they are scalable, efficient, and meet business needs.

  5. 5

    Mentor Junior Engineers

    Share your knowledge and experience with junior engineers. Help them grow and develop their skills.

  6. 6

    Influence Data Strategy

    Strategise and influence the organisation's data infrastructure. Lead large-scale projects and drive innovation.

Live jobs

5 live roles

Senior Data Engineer (Databricks)

Build and optimize scalable data pipelines in Databricks to unify marketing, CRM, and paid media data into a centralized lakehouse. Collaborate with analytics and marketing teams to develop data models supporting dashboards, attribution, and marketing mix modeling. Work in a greenfield environment to establish a single source of truth across diverse data sources.

Lawrence Harvey Uxbridge, London, UB8 1SB, United Kingdom £69,000 – £72,000 pa

Azure Databricks Data Engineer

This role involves designing, developing, and optimizing Azure Databricks solutions using PySpark, Python, and SQL. You will build and maintain enterprise-grade ETL/ELT pipelines, support Lakeflow and Delta Lake implementations, and drive best practices in performance, security, and governance.

Marks Sattin London, United Kingdom £450 – £550

Azure Cloud Infrastructure Engineer – SC Cleared / Databricks

Design and implement scalable Azure cloud environments with a focus on Databricks, data platforms, and DevOps pipelines. Work within a secure enterprise setting to migrate and optimise infrastructure using Infrastructure as Code and automated CI/CD workflows. Collaborate with architects and engineering teams to ensure secure, compliant, and high-performance cloud solutions.

DCV Technologies Derby, Derbyshire, DE1 3AE, United Kingdom £600 pd
Hybrid Contract Clearance Required

Data Engineering Consultant, Data Bricks, Snowflake, Big 4

This role involves working as a Data Engineering Consultant, primarily focusing on data platforms like Databricks and Snowflake, and advising financial services clients on data engineering, AI, and analytics. You will be based in the City of London, with a mix of office and client site work, and will need to have extensive experience in data engineering, regulatory compliance, and data governance frameworks.

Carrington Recruitment Solutions Broad Street, City And County Of the City Of London, United Kingdom £120,000 – £160,000 pa

Data Engineering Consultant, Data Bricks, Snowflake, Big 4

This role involves consulting on data engineering, AI, and analytics for financial services clients, with a focus on regulatory compliance and data governance. You will work in the office 4 days a week and travel to client sites, using tools like Databricks, Snowflake, and Azure to deliver practical solutions and enhance audit processes.

Carrington Recruitment Solutions Broad Street, Greater London, City And County Of the City Of London, United Kingdom £120,000 – £160,000 pa
Hiring locations

Where this role is hiring

The locations with the most live listings for this role today.

FAQs

Common questions

  • Essential skills include proficiency in SQL, Python, and Scala, a strong understanding of data warehousing and ETL processes, and experience with Apache Spark and Databricks.

  • Gain experience with data engineering tools and technologies, particularly Databricks and Apache Spark. Consider certifications and hands-on projects to build your portfolio.

  • Responsibilities include designing and implementing data pipelines, optimising data processing workflows, troubleshooting issues, and collaborating with cross-functional teams.

  • The typical career path includes roles such as Junior Databricks Engineer, Databricks Engineer, Senior Databricks Engineer, and Principal Databricks Engineer.

  • Salaries for Databricks Engineers can vary based on experience and location. For specific salary ranges, please refer to the salary section on this page.

Hiring databricks engineers?

Post your role in 90 seconds and reach the specialist audience that already reads this page.