SC Cleared Python Developer

Opus Recruitment Solutions
Newcastle upon Tyne, Tyne & Wear, NE1 4JA, United Kingdom
Last week
£400 – £425 pd

Salary

£400 – £425 pd

Job Type
Permanent
Work Pattern
Full-time
Work Location
On-site
Seniority
Mid
Education
Degree
Security Clearance
Required
Posted
18 May 2026 (Last week)

What is Citizen Event Analytics?

Citizen Event Analytics (CEA) is a cross-benefit, cross-channel event history compiled from citizens' interaction, (telephony, face to face and digital), claim processing and support events.

CEA uses a pipeline that:

Extracts event data from different sources

Transforms the data into a usable and trusted resource

Loads that data into the data asset that is accessible to Data users through the Uplifted Analytical Service (UAS).

Support DWP in the maintenance of the longitudinal event history data asset and associated data pipelines that forms Citizen Event Analytics. As directed by DWP, activities may include:

The resources will be expected to support:

plan and lead development on sets of related stories

have an understanding of the whole CEA system and take responsibility for teaching this to others(specific technical skills listed below in the ‘Technical skill requirements’ section

work with other users, Product Owner and Business Analyst to understand what needs to be built

coach and mentor more junior colleagues

operate the ingest and publishing production pipelines/services, that are build and find ways to improve system robustness, resilience and stability

Key skills required:

Understanding of data processing using Apache Spark

Use of Python, SQL, and familiarity with PySpark

Experience using Apache Airflow for task orchestration

Understanding of EMR and reviewing output logs

Use of Jupyter notebooks and/or Amazon Athena to query and validate data

Data analysis to identify root cause of issues

Understanding of dimensional data models and slowly changing dimensions/historic data capture

Use of AWS console and services such as, but not limited to; CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, Dynamo DB, LakeFormation

Familiarity with Amazon Textract and Comprehend

Understanding of both server-side and client-side encryption

Use of GitLab for source code management pipelines for CI/CD

Use of GitLab Tags for component versioning in shared repositories

Understanding of Docker and containerization of solutions

IaC using Terraform

Experience of understanding how customer expectations transition to applied functionality

Familiarity with, and implementation of, DWP Engineering best practices

Use of gitlab for release tagging and deployments

Familiarity with basic data structures for constructing a solution

Related Jobs

View all jobs

SC & DV Cleared Data Consultants and Analysts

VIQU IT Farringdon, Greater London, London, EC1M 4BJ, United Kingdom
£50,000 – £60,000 pa On-site Clearance Required

SC Cleared Senior Data Engineer

Opus Recruitment Solutions London, United Kingdom
£650 – £700 pd Hybrid Clearance Required

WANTED - Active SC-Cleared Data Engineers

Opus Recruitment Solutions South Bank, London, SE1 9PZ, United Kingdom
£500 – £600 pd On-site Clearance Required

Data Architect (SC Cleared)

ARM London, United Kingdom
£600 – £700 pd Hybrid Clearance Required

Data Architect (SC Cleared)

TXP London, United Kingdom
£450 – £550 pd

Salesforce Data Cloud Developer

Damia Group London, United Kingdom
£600 – £700 pd Hybrid Clearance Required

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Where to Advertise Data Engineering Jobs in the UK (2026 Guide)

Where to advertise data engineering jobs UK in 2026: the specialist boards and channels that reach Spark, dbt, Snowflake and platform engineering talent. Data engineers occupy a distinct discipline that sits between software engineering, data science and cloud infrastructure — and the strongest candidates identify firmly with the data engineering community rather than with adjacent roles. General job boards consistently conflate data engineering with data analysis, data science and BI development, producing high application volumes but low candidate quality for specialist pipeline and platform roles. This guide, published by DataEngineeringJobs.co.uk, covers where to advertise data engineering roles in the UK in 2026, how the main platforms compare, what employers should expect to pay, and what the data says about hiring across different role types.

Data Engineering Jobs UK 2026: What to Expect Over the Next 3 Years

Data Engineering Jobs UK 2026: roles, salaries and the trends shaping UK data engineering hiring over the next three years — Spark, dbt, lakehouse and AI. Data engineering has become one of the most strategically important disciplines in the entire technology sector — and one of the most reliably in-demand. Every organisation that wants to use data to make decisions, train AI models, personalise products, manage risk, or understand its customers depends on data engineers to build the infrastructure that makes any of that possible. Without well-designed, reliable data pipelines, the most sophisticated machine learning model is worthless and the most ambitious analytics strategy is undeliverable. That foundational importance has made data engineering hiring remarkably resilient through the technology market corrections of the past few years. Where headcount reductions fell heavily on some engineering disciplines, demand for data engineers held firm — because the work of building and maintaining data infrastructure cannot be deferred in the way that some product development can. The data keeps coming. The pipelines need to work. But the data engineering jobs market of 2026 is not simply a stable version of what it was three years ago. The discipline has undergone a series of architectural shifts — from batch to streaming, from on-premise data warehouses to cloud-native lakehouses, from hand-rolled pipelines to declarative transformation frameworks, and most recently toward AI-augmented data engineering workflows that are beginning to reshape what the role looks like in practice. The employers hiring data engineers today are asking for a meaningfully different skill set than those hiring three years ago. The candidates who will thrive over the next three years are those who understand where the discipline is heading — which architectural patterns are becoming standard, which technologies are defining the modern data stack, and how the definition of a data engineering career is evolving toward a richer intersection of infrastructure, analytics, and AI enablement. This article breaks down what the UK data engineering jobs market is likely to look like through to 2028 — covering the titles emerging right now, the technologies driving employer demand, the skills that will matter most, and how to position your career ahead of the curve.