Azure Databricks Data Engineer - OUTSIDE IR35

City of London
5 days ago
Create job alert

Databricks Data Engineer - Contract

Day Rate: £450 - £550 P/ day
Location: Hybrid (Remote / 2 Days a week in London)
Start: Immediate Start
Note: Capital Markets, or at least Banking experience is a MUST!

Key expertise and experience we're looking for:

Data Engineering in Databricks -
Spark programming with Scala, Python, SQL
Ideally experience with Delta Lake
Databricks workflows, jobs, etc.
Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks
Data Governance experience - Metadata, Data Quality, Lineage, Data Access Models
Good understanding of Data Modelling concepts, Data Products and Data Domains
Unity Catalog experience is a key differentiator - if not then experience with a similar Catalog/Data Governance Management component
MS Purview (Metadata and Data Quality tool) experience is a bonus - experience in similar tools is valuable (Collibra, Informatica Data Quality/MDM/Axon etc.)
Data Architecture experience is a bonus
Python, Scala, Databricks Spark and Pyspark with Data Engineering skills
Ownership and ability to drive implementation / solution designFor more information please contact Ellis via email directly to

Related Jobs

View all jobs

Data Architect

Data Architect

Azure Data Engineer - Insurance Firm – London – hybrid working

Databricks Data Architect

Databricks Data Architect

Databricks Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Jobs at Newly Funded UK Start-ups: Q3 2025 Investment Tracker

Data. It’s the critical lifeblood of every forward-thinking organisation, fueling everything from strategic decision-making to real-time analytics. As data volumes skyrocket and technologies mature, the UK has distinguished itself as a frontrunner in data innovation. A robust venture capital scene, government-backed initiatives, and a wealth of academic talent have created fertile ground for data-centric start-ups across the country. In this Q3 2025 Investment Tracker, we’ll delve into the newly funded UK start-ups shaping the future of data engineering. More importantly, we’ll explore the rich job opportunities that have emerged alongside these funding announcements. From building scalable ETL (Extract, Transform, Load) pipelines to architecting data warehouses and implementing advanced data governance frameworks, data engineers, architects, and analysts have an incredible array of roles to pursue. If you’re eager to elevate your career in data engineering, read on for insights into the most dynamic start-ups, their fresh capital injections, and the skill sets they’re hungry for.

Portfolio Projects That Get You Hired for Data Engineering Jobs (With Real GitHub Examples)

Data is increasingly the lifeblood of businesses, driving everything from product development to customer experience. At the centre of this revolution are data engineers—professionals responsible for building robust data pipelines, architecting scalable storage solutions, and preparing data for analytics and machine learning. If you’re looking to land a role in this exciting and high-demand field, a strong CV is only part of the puzzle. You also need a compelling data engineering portfolio that shows you can roll up your sleeves and deliver real-world results. In this guide, we’ll cover: Why a data engineering portfolio is crucial for standing out in the job market. Choosing the right projects for your target data engineering roles. Real GitHub examples that demonstrate best practices in data pipeline creation, cloud deployments, and more. Actionable project ideas you can start right now, from building ETL pipelines to implementing real-time streaming solutions. Best practices for structuring your GitHub repositories and showcasing your work effectively. By the end, you’ll know exactly how to build and present a portfolio that resonates with hiring managers—and when you’re ready to take the next step, don’t forget to upload your CV on DataEngineeringJobs.co.uk. Our platform connects top data engineering talent with companies that need your skills, ensuring your portfolio gets the attention it deserves.

Data Engineering Job Interview Warm‑Up: 30 Real Coding & System‑Design Questions

The world of data engineering has rapidly emerged as a critical pillar for businesses, enabling them to extract insights from vast amounts of information and power data-driven decision-making. From building scalable ETL pipelines to designing real-time streaming infrastructures and cloud data warehouses, data engineers are in high demand across every industry—from tech giants to healthcare providers to financial institutions. If you’re seeking a data engineering role, you may already know that interviews can be rigorous, spanning software development, database design, distributed systems, and cloud computing. Many organisations need engineers who can handle both traditional batch processing and cutting-edge real-time analytics frameworks, all while keeping data secure, consistent, and optimised. In this guide, we’ll explore 30 real coding & system-design questions that often come up in data engineering interviews. From classic coding challenges to architecture-focused scenarios, these questions will help you gauge your readiness and build confidence before stepping into that interview room. If you’re actively searching for new data engineering opportunities in the UK, www.dataengineeringjobs.co.uk is a fantastic resource. It features a wide range of vacancies—from junior data engineering positions to senior-level cloud architecture roles. Let’s dive in so you can approach your next interview with insight and poise.