Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer

CFP Energy Ltd.
City of London
6 days ago
Create job alert
The Role

Brook Green Supply is an independent B2B energy supply company. You will be joining a highly experienced team at the forefront of the UK energy market, providing a fantastic opportunity for a driven and commercially minded individual to make a meaningful contribution to the growth and evolution of our trading desk.

We are seeking a Data Engineer to join our growing data engineering team. This role is perfect for someone passionate about building robust, scalable data infrastructure using open-source technologies. You'll work in an environment that values innovation, technical excellence, and collaborative problem-solving.

Key Responsibilities
  • Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools
  • Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements
  • Develop data models and schemas that support analytics, business intelligence and product needs
  • Monitor, troubleshoot, and optimise data pipeline performance and reliability
  • Collaborate with stakeholders, analysts and product team to understand data requirements
  • Implement data quality checks and validation processes to ensure data integrity
  • Participate in architecture decisions and contribute to technical roadmap planning
Analytical and Soft Skills
  • Strong analytical mindset with attention to detail
  • Excellent problem-solving and debugging skills
  • Ability to work independently and manage priorities
  • Strong communication skills and ability to explain technical concepts to non-technical stakeholders
  • Experience working in agile development environments
  • Passion for continuous learning and staying current with emerging technologies
Required Skills and ExperienceTechnical Skills
  • Great SQL skills with experience in complex query optimization
  • Strong Python programming skills with experience in data processing libraries (pandas, NumPy, Apache Spark)
  • Hands-on experience building and maintaining data ingestion pipelines
  • Proven track record of optimising queries, code, and system performance
  • Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow)
  • Knowledge of distributed computing concepts and big data technologies
  • Experience with version control systems (Git) and CI/CD practices
  • Experience with relational databases (PostgreSQL, MySQL or similar)
  • Experience with containerization technologies (Docker, Kubernetes)
  • Experience with data orchestration tools (Apache Airflow or Dagster)
  • Understanding of data warehousing concepts and dimensional modelling
  • Understanding of cloud platforms using infrastructure-as-code (IaC) approaches
  • Knowledge of streaming data processing and real-time analytics
  • Experience with data quality and monitoring tools
Preferred Qualifications
  • Bachelor\'s degree in Computer Science, Engineering, Mathematics, or related field
  • 2-5 years of experience in data engineering or related roles
  • Experience working in the Energy industry

The CFP Energy Group is committed to ensuring equal opportunities, fairness of treatment, dignity and respect, and the elimination of all forms of discrimination in the workplace for all employees/contractors and job applicants.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why Data Engineering Careers in the UK Are Becoming More Multidisciplinary

For many years, data engineering in the UK meant designing pipelines, moving data between systems, and ensuring analysts had what they needed. Today, the field is expanding. With cloud platforms, machine learning, real-time analytics and the explosion of sensitive personal data, employers expect data engineers to do much more. Modern data engineering is no longer just about code and storage. It requires legal awareness, ethical judgement, psychological insight, linguistic clarity and human-centred design. These disciplines shape how data is collected, processed, explained and trusted. In this article, we’ll explore why data engineering careers in the UK are becoming more multidisciplinary, how law, ethics, psychology, linguistics & design now influence job descriptions, and what job-seekers & employers must do to thrive.

Data Engineering Team Structures Explained: Who Does What in a Modern Data Engineering Department

Data has become the lifeblood of modern organisations. Every sector in the UK—finance, healthcare, retail, government, technology—is increasingly relying on insights derived from data to drive decisions, deliver products, and improve operations. But raw data on its own isn’t enough. To make data useful, reliable, secure, and scalable, companies must build strong data engineering teams. If you’re recruiting for data engineering or seeking a role, understanding the structure of such a team and who does what is essential. This article breaks down the typical roles in a modern data engineering department, how they collaborate, required skills and qualifications, expected UK salaries, common challenges, and advice on structuring and growing a data engineering team.

Why the UK Could Be the World’s Next Data Engineering Jobs Hub

Data is now the lifeblood of the digital economy. Every industry—healthcare, finance, retail, manufacturing, transport, and government—relies on data to make decisions, power applications, and enable innovation. But raw data is only valuable if it can be collected, processed, cleaned, and made available for analysis. This is the role of data engineering. Over the past decade, data engineering has emerged as one of the fastest-growing areas of technology. Data engineers design and build the pipelines, platforms, and architectures that allow organisations to harness the power of big data, cloud services, artificial intelligence, and machine learning. Without them, the data economy would grind to a halt. The United Kingdom is uniquely placed to become the world’s next data engineering jobs hub. With its thriving tech ecosystem, leading universities, strong financial markets, and expanding data infrastructure, the UK already has many of the foundations needed. This article explores why the UK has this opportunity, what is driving demand, the career prospects for professionals, and what must happen for the UK to seize global leadership in data engineering jobs.