Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer (SC cleared)

City of London
5 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer
4 months - with extensions
Remote
Active SC clearance required
£640 per day inside ir35

REQUIRED

Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc
Strong understanding of complex JSON manipulation
Experience working with Data Pipelines using a custom Python/PySpark frameworks
Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc including experience of handling sensitive datasets
Strong problem solving and analytical skills, particularly able to demonstrate these intuitively (able to work a problem out, not follow a work instruction to resolve)
Experience working in a support role would be beneficial, particularly able to demonstrate incident triage and handling skills/knowledge (SLAs etc)
Fundamental linux system administration knowledge - ssh keys and config etc, Bash CLI and scripting, Environment variables
Experience using browser based IDEs (Jupyter Notebooks, RStudio etc)
Experience working in a dynamic Agile environment (SAFE, scrum, sprints, JIRA etc)
Python (as a programming language, not just being able to write basic scripts)LANGUAGES / FRAMEWORKS

JSON
YAML
Python (as a programming language, not just able to write basic scripts)
Pydantic experience DESIRABLE
SQL
PySpark
Delta Lake
Bash (both CLI usage and scripting)
Git
Markdown
Scala DESIRABLE
Azure SQL Server as a HIVE Metastore DESIRABLETECHNOLOGIES

Azure Databricks
Apache Spark
Delta Tables
Data processing with Python
PowerBI (Integration / Data Ingestion)
JIRAIf you meet the above requirements, please apply for the vacancy to be contacted by an Experis Consultant. If you haven't been contacted within 2 weeks of application, please consider the vacancy closed

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why the UK Could Be the World’s Next Data Engineering Jobs Hub

Data is now the lifeblood of the digital economy. Every industry—healthcare, finance, retail, manufacturing, transport, and government—relies on data to make decisions, power applications, and enable innovation. But raw data is only valuable if it can be collected, processed, cleaned, and made available for analysis. This is the role of data engineering. Over the past decade, data engineering has emerged as one of the fastest-growing areas of technology. Data engineers design and build the pipelines, platforms, and architectures that allow organisations to harness the power of big data, cloud services, artificial intelligence, and machine learning. Without them, the data economy would grind to a halt. The United Kingdom is uniquely placed to become the world’s next data engineering jobs hub. With its thriving tech ecosystem, leading universities, strong financial markets, and expanding data infrastructure, the UK already has many of the foundations needed. This article explores why the UK has this opportunity, what is driving demand, the career prospects for professionals, and what must happen for the UK to seize global leadership in data engineering jobs.

The Best Free Tools & Platforms to Practise Data Engineering Skills in 2025/26

Data engineering has rapidly become one of the most critical disciplines in technology. Every business, from financial services to healthcare to e-commerce, relies on robust data pipelines to move, transform, and store information efficiently. Without skilled data engineers, the modern data-driven economy would grind to a halt. The challenge for job seekers? Employers don’t just want to see academic credentials. They want hands-on evidence that you can build and manage data workflows, integrate sources, optimise performance, and deploy solutions at scale. Fortunately, you don’t need expensive software licences or premium courses to gain practical experience. A wealth of free tools and platforms allow you to practise and master the essential skills of a data engineer. In this vlog-style guide, we’ll cover the best free resources you can use in 2025 to build portfolio-ready projects and boost your job prospects.

Top 10 Skills in Data Engineering According to LinkedIn & Indeed Job Postings

Data engineering is the backbone of modern analytics, AI, and business intelligence. Across the UK—from finance and health to e-commerce and public sector—organisations are investing heavily in platforms that ingest, process, and store vast amounts of data. Demand for professionals who can build robust, scalable, and reliable data pipelines has never been higher. But what skills do employers really want? By analysing job postings on LinkedIn and Indeed, this article highlights the Top 10 data engineering skills that UK organisations are looking for in 2025. You’ll learn how to surface these skills in your CV, demonstrate them in interviews, and build proof-of-work through a compelling portfolio.