Data Engineer (SQL and PySpark)

Data Engineer

Location: Dunstable (near Luton) - Hybrid (up to 2 days onsite) Rate: £549 per day (Inside IR35 / Umbrella) Contract: Initial term until end of August

Overview

Whitbread is seeking a hands-on Data Engineer to build and maintain scalable, production-grade data pipelines within reusable, modular frameworks. This role focuses on engineering high-quality, durable solutions rather than one-off development.

Key Responsibilities

Design and develop end-to-end data pipelines using reusable frameworks

Build scalable data solutions using Python, SQL, and PySpark

Create modular frameworks separating configuration from orchestration

Implement robust automated testing (unit, integration, regression)

Establish and enforce data quality controls (schema, nulls, row counts, integrity checks)

Contribute to CI/CD pipelines and Git-based workflows

Troubleshoot and optimise data pipelines for reliability and performance

Required Experience

Strong Data Engineering background

Advanced Python and SQL skills

Experience with PySpark or distributed processing tools

Proven track record building reusable data frameworks

Strong testing experience (pytest, mock data, data validation techniques)

Solid understanding of data quality, integrity, and pipeline behaviour

Experience with CI/CD, Git, and code review processes

Desirable

Experience in enterprise or cloud-based data environments

Exposure to dbt, Great Expectations, or similar tools

Experience in retail, hospitality, or customer-focused industries