Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Python Data Engineer

London
2 days ago
Create job alert

Data Engineer - Security Clearance (SC), Python, Azure, BDD

Up to £475 per day (Inside IR35)

Remote / London

6 months

My client is an International Consultancy who require a Security Cleared Data Engineer, with Active Security Clearance (SC), and strong Python skills to design and deploy scalable Data solutions in a containerized Azure environment.

Key requirements:

Proven experience as a Data Engineer with Active Security Clearance (SC)
Strong Python skills with modular, test-driven design
Experience with Behave for unit and BDD testing (mocking, patching)
Proficiency in PySpark and distributed Data processing
Solid understanding of Delta Lake (design and maintenance)
Hands-on with Docker for development and deployment
Familiarity with Azure services: Functions, Key Vault, Blob Storage
Ability to build configurable, parameter-driven applications
Exposure to CI/CD pipelines (ideally Azure DevOps) and cloud security best practices
Strong collaboration and communication skills
Nice to have:

Immediate availability
Experience with Databricks or Synapse
Knowledge of Data governance in Azure ecosystems
Infrastructure as Code (IaC) tooling

If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career.

Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)

Related Jobs

View all jobs

Data Engineer (Python)

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Hiring Trends 2026: What to Watch Out For (For Job Seekers & Recruiters)

As we move into 2026, the data engineering jobs market in the UK is evolving fast. Almost every organisation is talking about AI, analytics & data-driven decision making – but behind all that sits the data engineering function. Cloud costs, complex data estates, stricter regulation & the explosion of AI workloads are all changing how data platforms are built & run. Some companies are tightening budgets & consolidating teams, while others are doubling down on modern data stacks, lakehouses & real-time pipelines. Whether you are a data engineering job seeker planning your next move, or a recruiter building data teams, understanding the key data engineering hiring trends for 2026 will help you stay ahead.

Data Engineering Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data engineering hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise reliable pipelines, modern lakehouse/streaming stacks, data contracts & governance, observability, performance/cost discipline & measurable business outcomes. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for platform‑oriented DEs, analytics engineers, streaming specialists, data reliability engineers, DEs supporting AI/ML platforms & data product managers. Who this is for: Data engineers, analytics engineers, streaming engineers, data reliability/SRE, data platform engineers, data product owners, ML/feature‑store engineers & SQL/ELT specialists targeting roles in the UK.

Why Data Engineering Careers in the UK Are Becoming More Multidisciplinary

For many years, data engineering in the UK meant designing pipelines, moving data between systems, and ensuring analysts had what they needed. Today, the field is expanding. With cloud platforms, machine learning, real-time analytics and the explosion of sensitive personal data, employers expect data engineers to do much more. Modern data engineering is no longer just about code and storage. It requires legal awareness, ethical judgement, psychological insight, linguistic clarity and human-centred design. These disciplines shape how data is collected, processed, explained and trusted. In this article, we’ll explore why data engineering careers in the UK are becoming more multidisciplinary, how law, ethics, psychology, linguistics & design now influence job descriptions, and what job-seekers & employers must do to thrive.