Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer

CFP Energy Ltd.
City of London
3 weeks ago
Create job alert
The Role

Brook Green Supply is an independent B2B energy supply company. You will be joining a highly experienced team at the forefront of the UK energy market, providing a fantastic opportunity for a driven and commercially minded individual to make a meaningful contribution to the growth and evolution of our trading desk.

We are seeking a Data Engineer to join our growing data engineering team. This role is perfect for someone passionate about building robust, scalable data infrastructure using open-source technologies. You'll work in an environment that values innovation, technical excellence, and collaborative problem-solving.

Key Responsibilities
  • Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools
  • Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements
  • Develop data models and schemas that support analytics, business intelligence and product needs
  • Monitor, troubleshoot, and optimise data pipeline performance and reliability
  • Collaborate with stakeholders, analysts and product team to understand data requirements
  • Implement data quality checks and validation processes to ensure data integrity
  • Participate in architecture decisions and contribute to technical roadmap planning
Analytical and Soft Skills
  • Strong analytical mindset with attention to detail
  • Excellent problem-solving and debugging skills
  • Ability to work independently and manage priorities
  • Strong communication skills and ability to explain technical concepts to non-technical stakeholders
  • Experience working in agile development environments
  • Passion for continuous learning and staying current with emerging technologies
Required Skills and ExperienceTechnical Skills
  • Great SQL skills with experience in complex query optimization
  • Strong Python programming skills with experience in data processing libraries (pandas, NumPy, Apache Spark)
  • Hands-on experience building and maintaining data ingestion pipelines
  • Proven track record of optimising queries, code, and system performance
  • Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow)
  • Knowledge of distributed computing concepts and big data technologies
  • Experience with version control systems (Git) and CI/CD practices
  • Experience with relational databases (PostgreSQL, MySQL or similar)
  • Experience with containerization technologies (Docker, Kubernetes)
  • Experience with data orchestration tools (Apache Airflow or Dagster)
  • Understanding of data warehousing concepts and dimensional modelling
  • Understanding of cloud platforms using infrastructure-as-code (IaC) approaches
  • Knowledge of streaming data processing and real-time analytics
  • Experience with data quality and monitoring tools
Preferred Qualifications
  • Bachelor\'s degree in Computer Science, Engineering, Mathematics, or related field
  • 2-5 years of experience in data engineering or related roles
  • Experience working in the Energy industry

The CFP Energy Group is committed to ensuring equal opportunities, fairness of treatment, dignity and respect, and the elimination of all forms of discrimination in the workplace for all employees/contractors and job applicants.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data engineering hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise reliable pipelines, modern lakehouse/streaming stacks, data contracts & governance, observability, performance/cost discipline & measurable business outcomes. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for platform‑oriented DEs, analytics engineers, streaming specialists, data reliability engineers, DEs supporting AI/ML platforms & data product managers. Who this is for: Data engineers, analytics engineers, streaming engineers, data reliability/SRE, data platform engineers, data product owners, ML/feature‑store engineers & SQL/ELT specialists targeting roles in the UK.

Why Data Engineering Careers in the UK Are Becoming More Multidisciplinary

For many years, data engineering in the UK meant designing pipelines, moving data between systems, and ensuring analysts had what they needed. Today, the field is expanding. With cloud platforms, machine learning, real-time analytics and the explosion of sensitive personal data, employers expect data engineers to do much more. Modern data engineering is no longer just about code and storage. It requires legal awareness, ethical judgement, psychological insight, linguistic clarity and human-centred design. These disciplines shape how data is collected, processed, explained and trusted. In this article, we’ll explore why data engineering careers in the UK are becoming more multidisciplinary, how law, ethics, psychology, linguistics & design now influence job descriptions, and what job-seekers & employers must do to thrive.

Data Engineering Team Structures Explained: Who Does What in a Modern Data Engineering Department

Data has become the lifeblood of modern organisations. Every sector in the UK—finance, healthcare, retail, government, technology—is increasingly relying on insights derived from data to drive decisions, deliver products, and improve operations. But raw data on its own isn’t enough. To make data useful, reliable, secure, and scalable, companies must build strong data engineering teams. If you’re recruiting for data engineering or seeking a role, understanding the structure of such a team and who does what is essential. This article breaks down the typical roles in a modern data engineering department, how they collaborate, required skills and qualifications, expected UK salaries, common challenges, and advice on structuring and growing a data engineering team.