Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Lead Data Engineer

Holborn and Covent Garden
5 months ago
Applications closed

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Azure Data engineer

Lead AWS Data Engineer / Architect - Databricks - London

Lead Data Engineer ( Databricks )
London - Hybrid - Remote
Permanent
£100,000 - £130,000 plus up to 20% bonus based on performance and commercial contribution

About the Role

We’re looking for a Lead Data Engineer to spearhead some of our clients most strategic Databricks engagements.

This is a senior client-facing leadership role, blending hands-on technical delivery with architectural design and pre-sales influence.

You'll be leading high-performing squads, guiding complex transformations, and working directly with senior stakeholders to bridge business needs and engineering excellence — particularly in industries like manufacturing, utilities, and aviation.

This is a key hire to support our clients expanding Databricks practice, to build capacity for future growth.

What You’ll Be Doing

  • Act as the technical lead on client engagements, owning design and delivery of data solutions in Databricks.

  • Architect robust, scalable data platforms using the medallion architecture.

  • Translate business requirements into scalable workflows, advising on data governance, quality, and security.

  • Design and implement complex data pipelines using tools like Delta Live Tables (DLT) and Unity Catalog.

  • Guide teams in implementing best practices across engineering, DevOps, and model deployment.

  • Support pre-sales activity, including shaping proposals, estimates, and technical roadmaps.

  • Provide technical leadership, mentorship, and oversight to squads of Senior and Associate Engineers.

  • Collaborate closely with Platform Engineers and Platform Architects to align infrastructure with data needs.

  • Contribute to growing the Databricks capability – from delivery frameworks to internal tooling and capability development.

  • Lead a team of data engineers, fostering a collaborative and growth-oriented environment.

  • Evaluate new data engineering technologies and strategies, assessing their relevance and fit for the organisation’s strategic goals.

  • Work closely with the commercial team to scope projects and develop proposals that align technical capabilities with client requirements.

    Essential Skills & Experience

  • 8+ years in data engineering, with at least 2+ in a technical leadership role

  • Proven experience designing and leading Databricks-based data platforms

  • Deep understanding of the medallion architecture, data lakehouse design, and transformation workflows

  • Hands-on expertise with DLT, Unity Catalog, and model deployment frameworks

  • Strong communication and consulting skills – able to lead client conversations and manage stakeholders

  • Experience in agile delivery environments and cross-functional teams

  • Commercial awareness – comfortable contributing to pre-sales, growing accounts, and engaging with commercial targets

    Desirable Skills

  • Experience in physical asset-heavy industries (e.g. utilities, manufacturing, aviation)

  • Familiarity with platform and DevOps collaboration, especially on AWS or Azure

  • Certifications in Databricks or cloud platforms (AWS/Azure)

  • Background in consulting or client delivery environments

    Why Join?

  • Join a consultancy that’s doubling down on Databricks with enterprise-grade delivery

  • Be the go-to technical leader on projects with real-world business impact

  • Shape the future of our Databricks workforce strategy and delivery model

  • Career progression into Delivery Lead, Practice Lead, or Pre-Sales Specialist

  • Competitive compensation and strong bonus structure, aligned with delivery and commercial impact

    To find out more about this high profile Lead Data Engineering position, click apply

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Best Free Tools & Platforms to Practise Data Engineering Skills in 2025/26

Data engineering has rapidly become one of the most critical disciplines in technology. Every business, from financial services to healthcare to e-commerce, relies on robust data pipelines to move, transform, and store information efficiently. Without skilled data engineers, the modern data-driven economy would grind to a halt. The challenge for job seekers? Employers don’t just want to see academic credentials. They want hands-on evidence that you can build and manage data workflows, integrate sources, optimise performance, and deploy solutions at scale. Fortunately, you don’t need expensive software licences or premium courses to gain practical experience. A wealth of free tools and platforms allow you to practise and master the essential skills of a data engineer. In this vlog-style guide, we’ll cover the best free resources you can use in 2025 to build portfolio-ready projects and boost your job prospects.

Top 10 Skills in Data Engineering According to LinkedIn & Indeed Job Postings

Data engineering is the backbone of modern analytics, AI, and business intelligence. Across the UK—from finance and health to e-commerce and public sector—organisations are investing heavily in platforms that ingest, process, and store vast amounts of data. Demand for professionals who can build robust, scalable, and reliable data pipelines has never been higher. But what skills do employers really want? By analysing job postings on LinkedIn and Indeed, this article highlights the Top 10 data engineering skills that UK organisations are looking for in 2025. You’ll learn how to surface these skills in your CV, demonstrate them in interviews, and build proof-of-work through a compelling portfolio.

The Future of Data Engineering Jobs: Careers That Don’t Exist Yet

Data engineering has quietly become one of the most crucial roles in modern technology. While data science and artificial intelligence often attract the headlines, it is data engineering that provides the foundation. By building pipelines, managing databases, and ensuring data quality, data engineers make it possible for organisations to analyse, innovate, and grow. In the UK, data engineering is booming. Banks rely on engineers to process financial transactions in real time. Retailers depend on them to analyse customer behaviour. Healthcare providers use engineered data to fuel predictive analytics in the NHS. Demand is so strong that data engineering has become one of the fastest-growing roles in the tech sector, with salaries reflecting its importance. But the story doesn’t stop here. As AI, quantum computing, edge intelligence, sustainability, and regulation reshape how we manage information, the role of data engineers will evolve dramatically. Many of the most important data engineering jobs of the next two decades don’t exist yet. This article explores why new roles are coming, what they might look like, how current jobs will change, why the UK is positioned to lead, and how professionals can prepare.