Senior Data Engineer - Energy

St James's
3 days ago
Create job alert

Our client, a well-established energy business in London, is hiring a Senior Data Engineer to support the next phase of their growth.

The role is based in Mayfair and operates on a hybrid basis, with three office days and two remote days per week.

Senior Data Engineer – Role Purpose:

We are looking for an engineer who is responsible for building, maintaining, and evolving the data pipelines and models that underpin our supply business. This includes ingestion, transformation, validation, and exposure of data used by trading, optimisation, operations, and reporting. The role exists to provide clear ownership of the supply data stack, reduce operational and analytical friction, and allow traders, analysts, and optimisation engineers to rely on high-quality, well-understood data without constant ad-hoc intervention.

This position would sit within both the supply-side of our business and the broader technology department, meaning this role also includes engaging with the technology strategy of our client as a whole.

Senior Data Engineer – Key Responsibilities:

  1. Own the Energy Supply Data Stack.

  • Take end-to-end ownership of data pipelines supporting the supply business.

  • Ensure data is accurate, timely, and fit for both operational and analytical use in our pipelines.

  • Collaborate with supply managers to deliver insights and serve as a first point of contact.

  1. Build and Maintain Robust Data Pipelines.

  • Ingest data from internal systems, market sources, and third-party providers.

  • Implement transformations, validations, and reconciliation logic using Python and SQL.

  • Proactively identify and resolve data quality issues.

  1. Collaborate Across Engineering and the Business

  • Work closely with engineers to ensure data systems integrate with trading and optimization platforms.

  • Support the broader engineering team by owning supply-domain data complexity.

  • Contribute to improving standards and tooling across the data platform.

  1. Develop a Deep Domain Expertise in Energy Supply and UK Markets

  • Build a strong, working understanding of the UK energy supply industry, including market structures, products, and commercial drivers.

  • Maintain familiarity with UK electricity and gas market mechanics, settlement processes, and key regulatory frameworks.

  • Translate regulatory, commercial, and operational requirements into robust data models and pipelines.

    What We’re Looking For

    • Strong Python and SQL skills in data engineering contexts.

    • Experience building and maintain production data pipelines.

    • Experience working with SQL and data-engineering environments such as Databricks or Spark.

    • Ability to work closely with non-engineering stakeholders and translate business needs into data models.

    • Desire to become an expert in all facets of the energy systems in which they participates, from behind-the-meter asset optimisation to retail energy supply.

      Nice to Have

    • 4+ years of related experience.

    • Experience in energy supply, trading, or market-facing data systems.

    • Exposure to regulated or operationally critical data environments.

    • Familiarity with CHP, generation assets, or flexibility markets.

      What You’ll Get

    • Clear ownership of a critical part of the business’s technical foundation.

    • The opportunity to turn ad-hoc, manual data work into robust systems.

    • Close collaboration with trading, optimization, and operations teams.

    • A position with long-term scope: as the company and product grow, so does your impact, responsibility, and career trajectory

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Thinking about switching into data engineering in your 30s, 40s or 50s? You’re not alone. In the UK, companies of all sizes — from fintechs to government agencies, retailers to healthcare providers — are building data teams to turn vast amounts of information into insight and value. That means demand for data engineering talent remains strong, but there’s a gap between media hype and the real pathways available to mid-career professionals. This guide gives you the straight UK reality check: which data engineering roles are genuinely open to career switchers, what skills employers actually look for, how long retraining really takes and how to position your experience for success.

How to Write a Data Engineering Job Ad That Attracts the Right People

Data engineering is the backbone of modern data-driven organisations. From analytics and machine learning to business intelligence and real-time platforms, data engineers build the pipelines, platforms and infrastructure that make data usable at scale. Yet many employers struggle to attract the right data engineering candidates. Job adverts often generate high application volumes, but few applicants have the practical skills needed to build and maintain production-grade data systems. At the same time, experienced data engineers skip over adverts that feel vague, unrealistic or misaligned with real-world data engineering work. In most cases, the issue is not a shortage of talent — it is the quality and clarity of the job advert. Data engineers are pragmatic, technically rigorous and highly selective. A poorly written job ad signals immature data practices and unclear expectations. A well-written one signals strong engineering culture and serious intent. This guide explains how to write a data engineering job ad that attracts the right people, improves applicant quality and positions your organisation as a credible data employer.

Maths for Data Engineering Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are applying for data engineering jobs in the UK, maths can feel like a vague requirement hiding behind phrases like “strong analytical skills”, “performance mindset” or “ability to reason about systems”. Most of the time, hiring managers are not looking for advanced theory. They want confidence with the handful of maths topics that show up in real pipelines: Rates, units & estimation (throughput, cost, latency, storage growth) Statistics for data quality & observability (distributions, percentiles, outliers, variance) Probability for streaming, sampling & approximate results (sketches like HyperLogLog++ & the logic behind false positives) Discrete maths for DAGs, partitioning & systems thinking (graphs, complexity, hashing) Optimisation intuition for SQL plans & Spark performance (joins, shuffles, partition strategy, “what is the bottleneck”) This article is written for UK job seekers targeting roles like Data Engineer, Analytics Engineer, Platform Data Engineer, Data Warehouse Engineer, Streaming Data Engineer or DataOps Engineer.