Data Engineer

Data Engineer

Python | AWS | Databricks

We’re working with a leading organisation operating at the forefront of the energy sector, playing a critical role in supporting the transition to a more sustainable, low-carbon future.

As the business continues to invest in its data capabilities, they are looking for aData Engineer to join their growingData Platform team. This is an opportunity to work in a complex, evolving environment where data is central to decision-making across trading, operations, and commercial functions.

The Role

You’ll be responsible for building and maintaining scalable data pipelines that power analytics and reporting across the organisation. Working within a modernDatabricks on AWS environment, you’ll help deliver reliable, high-quality data to support business insights.

Key Responsibilities

• Build and maintainscalable ETL/ELT pipelines using Python and PySpark
• Ingest and integrate data from multiple sources includingtrading, finance, and operational systems
• Work within aDatabricks Lakehouse architecture to transform and deliver data
• OptimiseSpark jobs for performance and cost efficiency
• Implement and maintaindata quality, governance, and reliability standards
• Support the full data lifecycle from ingestion through to reporting and insight delivery
• Collaborate withBI teams and stakeholders to ensure data is accessible and usable

Key Skills & Experience

• Strong experience inData Engineering (3–6 years)
• Proficiency inPython and PySpark for large-scale data processing
• Hands-on experience withDatabricks (Delta Lake, Workflows, Lakehouse architecture)
• Solid knowledge ofAWS services (e.g. S3, Kinesis, Lambda, IAM)
• Experience buildingproduction-grade data pipelines
• Good understanding ofdata governance and data quality frameworks
• Strong SQL skills and experience working with complex datasets

Desirable

• Experience withinenergy, utilities, or similar complex industries
• Exposure toCI/CD for data pipelines or modern data platform tooling