Data Engineer

Location: London, Potters Bar or Bristol (Hybrid working options available)

The Data Engineer is a hands-on technical role responsible for designing, developing, and maintaining data pipelines within the IT department. The pipelines will be realised in a modern lake environment and the engineer will collaborate in cross-functional teams to gather requirements and develop the conceptual data models. This role plays a crucial part in driving data-driven decision-making across the organisation, ensuring data availability, quality, and accessibility for various business needs.

This is not a line management role, but you will play a key part in guiding and upskilling more junior data engineers and setting data standards and guidelines.

What you'll do

Data Pipeline Development

• Design, model, develop and maintain data pipelines to ingest, store, process, and present data.
• Ensure data quality, accuracy, and consistency.
• Collaborate with data architects to ensure data pipelines align with the overall data architecture strategy.

Data Transformation and Integration

• Perform data transformation tasks, including data cleansing, enrichment, and aggregation, to prepare data for analytics and reporting.
• Integrate data from structured and unstructured sources, ensuring compatibility...