Lead Data Engineer

Oliver James
London
Today
Job Type
Contract
Work Location
Hybrid
Seniority
Lead
Posted
17 Nov 2026 (Today)
Share

Lead Data Engineer - Databricks
Contract: 12 months, renewable
Location: Hybrid, 1 day a week in the office (London or Brussels)
Rate: Competitive day rate, depending on experience

A major international travel business is looking for a Lead Data Engineer to run a team of 5-7 engineers building its Databricks data platform and data products.

The role is split evenly: half leading people, half leading the engineering. You'll stay hands-on in code, design and review while coaching the team and acting as the main technical contact for business areas such as Commercial, Operations and Customer.

What you'll do

  • Lead, coach and develop a team of data engineers, and work with the Engineering Manager, Scrum Master and product owners on priorities and delivery
  • Set and enforce coding, testing, review and CI/CD standards
  • Build reusable project templates (Databricks Asset Bundles), shared libraries and CI/CD pipelines that every new data product follows
  • Make data AI-ready: rich metadata, semantic definitions and curated Genie spaces
  • Set standards for, and review the work of, analytics engineers in the business

What you'll need

  • 7+ years in data engineering, including at least 2 years leading or mentoring engineers
  • Deep hands-on experience with Databricks and Spark (Unity Catalog, Delta Lake, Lakeflow / DLT), plus strong Python and SQL
  • Strong data modelling skills and experience building data as a product
  • A track record of building templates, libraries or CI/CD that other engineers adopted
  • Working knowledge of AI data agents such as Databricks Genie
  • Clear communication with both technical and business stakeholders

Nice to have: dbt, Azure, FinOps on Databricks, data contracts, AI agent architecture (LLM, RAG, MCP), and experience leading teams across the UK and Europe. French is an advantage but not required.

Lead Data Engineer

Oliver James

All roles

Elastic SIEM & SOC Security Engineer/Architect

identifi Global Resources · Harrow

Featured
Featured Last week

Senior Data Engineer

Atom Learning · London · £76,000 – £90,000 pa

Featured
Featured 2 weeks ago

Lead Data Engineer

Nottingham Community Housing Association Ltd · Bristol · £45,343 – £51,937 pa

Today

Lead Data Engineer

Hexwired Recruitment Limited · London · £80,000 – £115,000 pa

6 days ago

Lead Data Engineer

TRIA · London · £90,000 – £95,000 pa

3 weeks ago

Lead Data Engineer

Tenth Revolution Group · London · £80,000 – £110,000 pa

4 months ago

Lead Data Engineer

Nottingham Community Housing Association Ltd · Nottingham · £45,343 – £51,937 pa

Today

Lead Data Engineer

Oliver James · London

Today

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Are you sure?