Data Engineer (SC cleared)

City of London
1 month ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer
4 months - with extensions
Remote
Active SC clearance required
£640 per day inside ir35

REQUIRED

Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc
Strong understanding of complex JSON manipulation
Experience working with Data Pipelines using a custom Python/PySpark frameworks
Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc including experience of handling sensitive datasets
Strong problem solving and analytical skills, particularly able to demonstrate these intuitively (able to work a problem out, not follow a work instruction to resolve)
Experience working in a support role would be beneficial, particularly able to demonstrate incident triage and handling skills/knowledge (SLAs etc)
Fundamental linux system administration knowledge - ssh keys and config etc, Bash CLI and scripting, Environment variables
Experience using browser based IDEs (Jupyter Notebooks, RStudio etc)
Experience working in a dynamic Agile environment (SAFE, scrum, sprints, JIRA etc)
Python (as a programming language, not just being able to write basic scripts)LANGUAGES / FRAMEWORKS

JSON
YAML
Python (as a programming language, not just able to write basic scripts)
Pydantic experience DESIRABLE
SQL
PySpark
Delta Lake
Bash (both CLI usage and scripting)
Git
Markdown
Scala DESIRABLE
Azure SQL Server as a HIVE Metastore DESIRABLETECHNOLOGIES

Azure Databricks
Apache Spark
Delta Tables
Data processing with Python
PowerBI (Integration / Data Ingestion)
JIRAIf you meet the above requirements, please apply for the vacancy to be contacted by an Experis Consultant. If you haven't been contacted within 2 weeks of application, please consider the vacancy closed

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers Education

Top 10 Best UK Universities for Data Engineering Degrees (2025 Guide

Discover ten of the strongest UK universities for Data Engineering degrees in 2025. Compare entry requirements, course content, research strength and industry links to choose the right programme for you. Data is the fuel of the digital economy, and turning raw records into reliable, analysis-ready information is the job of the data engineer. From building lake-house architectures to orchestrating near-real-time pipelines, demand for these skills is soaring across finance, retail, health-tech and government. The UK boasts several universities recognised internationally for large-scale data systems and scalable computing. Below we profile ten institutions whose undergraduate or postgraduate pathways major on data engineering. Tables shift each year, but these universities have a consistent record of excellence in teaching, research and industry collaboration.

Jobs

How to Write a Winning Cover Letter for Data Science Jobs: Proven 4-Paragraph Structure

Learn how to craft the perfect cover letter for data science jobs with this proven 4-paragraph structure. Ideal for entry-level candidates, career switchers, and professionals looking to advance in the data science sector. When applying for a data science job, your cover letter is an essential part of your application. The data science field is highly competitive, with many candidates vying for the same roles. Your cover letter allows you to showcase your technical expertise, analytical skills, and your ability to apply data to solve real-world problems. It’s the perfect opportunity to demonstrate your passion for data and your understanding of how it can drive meaningful insights for an organisation. Whether you're new to data science, making a career switch, or looking to advance your skills, this article will guide you through a proven four-paragraph structure to craft a compelling cover letter. We’ll provide sample lines and tips to help you stand out in the highly competitive data science job market.

Jobs

How to Write a Winning Cover Letter for Data Engineering Jobs: Proven 4-Paragraph Structure

Learn how to craft the perfect cover letter for data engineering jobs with this proven 4-paragraph structure. Ideal for entry-level candidates, career switchers, and professionals looking to advance in the data engineering sector. When applying for a data engineering job, your cover letter is a vital component of your application. The data engineering field is critical for organisations that rely on big data to make informed decisions, and a well-crafted cover letter will allow you to demonstrate your expertise in data management, data architecture, and data pipeline construction. Writing a cover letter for a data engineering role can seem challenging, but with the right structure, it becomes much easier to highlight your strengths. Whether you're just entering the field, transitioning from another role, or seeking to advance your career in data engineering, this article will walk you through a proven four-paragraph structure. We’ll provide sample lines and practical tips to help you create a cover letter that stands out from the competition in the data engineering job market.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.