Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer

Information Tech Consultants
City of London
1 day ago
Create job alert

💻 Junior Big Data Developer (Python & SQL Focus) 📊


!!! URGENT HIRING !!! Looking for London based Citizens/Dependents


***We DO NOT provide SPONSORSHIP***


We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python, and expert skills in SQL. You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms.


Key Responsibilities


  • Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into our data warehouse or data lake.
  • Data Transformation with Python: Write, optimize, and maintain production-grade Python scripts to clean, transform, aggregate, and process large volumes of data.
  • Database Interaction (SQL): Develop complex, high-performance SQL queries (DDL/DML) for data extraction, manipulation, and validation within relational and data warehousing environments.
  • Quality Assurance: Implement data quality checks and monitoring across pipelines, identifying discrepancies and ensuring the accuracy and reliability of data.
  • Collaboration: Work closely with Data Scientists, Data Analysts, and other Engineers to understand data requirements and translate business needs into technical data solutions.
  • Tooling & Automation: Utilize version control tools like Git and contribute to the automation of data workflows and recurring processes.
  • Documentation: Create and maintain technical documentation for data mappings, processes, and pipelines.


Required Skills and Qualifications


Core Technical Skills


Skill Area

Requirements

Programming

Strong proficiency in Python for data manipulation and scripting. Familiarity with standard Python data libraries (e.g., Pandas, NumPy).

Database

Expert-level proficiency in SQL (Structured Query Language). Experience writing complex joins, stored procedures, and performing performance tuning.

Big Data Concepts

Foundational understanding of Big Data architecture (Data Lakes, Data Warehouses) and distributed processing concepts (e.g., MapReduce).

ETL/ELT

Basic knowledge of ETL principles and data modeling (star schema, snowflake schema).

Version Control

Practical experience with Git (branching, merging, pull requests).


Preferred Qualifications (A Plus)


  • Experience with a distributed computing framework like Apache Spark (using PySpark).
  • Familiarity with cloud data services (AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage).
  • Exposure to workflow orchestration tools (Apache Airflow, Prefect, or Dagster).
  • Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data engineering hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise reliable pipelines, modern lakehouse/streaming stacks, data contracts & governance, observability, performance/cost discipline & measurable business outcomes. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for platform‑oriented DEs, analytics engineers, streaming specialists, data reliability engineers, DEs supporting AI/ML platforms & data product managers. Who this is for: Data engineers, analytics engineers, streaming engineers, data reliability/SRE, data platform engineers, data product owners, ML/feature‑store engineers & SQL/ELT specialists targeting roles in the UK.

Why Data Engineering Careers in the UK Are Becoming More Multidisciplinary

For many years, data engineering in the UK meant designing pipelines, moving data between systems, and ensuring analysts had what they needed. Today, the field is expanding. With cloud platforms, machine learning, real-time analytics and the explosion of sensitive personal data, employers expect data engineers to do much more. Modern data engineering is no longer just about code and storage. It requires legal awareness, ethical judgement, psychological insight, linguistic clarity and human-centred design. These disciplines shape how data is collected, processed, explained and trusted. In this article, we’ll explore why data engineering careers in the UK are becoming more multidisciplinary, how law, ethics, psychology, linguistics & design now influence job descriptions, and what job-seekers & employers must do to thrive.

Data Engineering Team Structures Explained: Who Does What in a Modern Data Engineering Department

Data has become the lifeblood of modern organisations. Every sector in the UK—finance, healthcare, retail, government, technology—is increasingly relying on insights derived from data to drive decisions, deliver products, and improve operations. But raw data on its own isn’t enough. To make data useful, reliable, secure, and scalable, companies must build strong data engineering teams. If you’re recruiting for data engineering or seeking a role, understanding the structure of such a team and who does what is essential. This article breaks down the typical roles in a modern data engineering department, how they collaborate, required skills and qualifications, expected UK salaries, common challenges, and advice on structuring and growing a data engineering team.