Senior Data Engineer

Senior Data Engineer

Hybrid: 3 days in office, Warwick

Duration: 6-Month Contract

Rate: £450/day (Inside IR35)

A leading organization is seeking a Senior Data Engineer to join their cloud data platform team on a hybrid basis (3 days in office, Warwick). This is a 6-month contracting role offering competitive daily rates and the opportunity to contribute to a modern, cloud-native data platform.

The Role

You will be responsible for driving the design and implementation of scalable, high-performing data architectures and pipelines. Working with the Interconnectors Data Platform (ICDP), you will provide both technical leadership and hands-on development, supporting the transition to modern Azure-based ingestion patterns and Medallion Architecture.

Key Responsibilities

* Lead the design and implementation of scalable data architectures and layered models (Bronze/Silver/Gold).

* Develop robust, secure, and observable ingestion and transformation pipelines using Azure-based tools.

* Lead the migration from legacy ETL tools to modern cloud pipelines (ADF, Azure Functions, event-driven frameworks).

* Build performant SQL transformations and reusable data models.

* Implement CI/CD, automated testing, version control, and observability in workflows.

* Ensure data quality, validation, reconciliation, and auditability across platform layers.

* Collaborate with business and product teams to deliver high-quality analytical outputs.

* Mentor junior data engineers and contribute to team capability development.

Required Skills & Experience

* Strong hands-on experience with Python for production-grade pipelines.

* Expert-level SQL, including optimization and data modelling.

* Azure Cloud experience (ADF, Functions, Storage, Key Vault).

* Deep understanding of data warehousing, dimensional modelling, and scalable architectures.

* Proficiency in Git, CI/CD, automated testing, and modern engineering best practices.

* Experience with API and SFTP ingestion and resilient pipeline design.

* Strong problem-solving, communication, and stakeholder collaboration skills.

Desirable

* Experience with Medallion/Lakehouse patterns or Databricks-style ecosystems.

* Experience in regulated or high-assurance data environments.

* Collaboration with modeling teams in engineering-modelling interfaces