Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Data Engineer – SC Cleared

Farringdon
2 days ago
Create job alert

Senior Data Engineer – SC Cleared
We are seeking a hands-on Senior Data Engineer with deep expertise in building and managing streaming and batch data pipelines. The ideal candidate will have strong experience working with large-scale data systems operating on cloud-based platforms such as AWS, Databricks or Snowflake. This role also involves close collaboration with hyperscalers and data platform vendors to evaluate and document Proofs of Concept (PoCs) for modern data platforms, while effectively engaging with senior stakeholders across the organisation.
Key Responsibilities:

Design, develop, and maintain streaming and batch data pipelines using modern data engineering tools and frameworks.
Work with large volumes of structured and unstructured data, ensuring high performance and scalability.
Collaborate with cloud providers and data platform vendors (e.g., AWS, Microsoft Azure, Databricks, IBM, Snowflake) to conduct PoCs for data platform solutions.
Evaluate PoC outcomes and provide comprehensive documentation including architecture, performance benchmarks, and recommendations.
Engage with key stakeholders including Heads of Architecture, Enterprise Architects, Product Owners, and Security teams to align data platform initiatives with business and technical strategies.Required Experience & Skills:

Proven experience as a Data Engineer with a strong focus on streaming and batch processing.
Hands-on experience with cloud-based data plaforms such as AWS/ Databricks/ IBM/ Snowflake.
Strong programming skills in Python, Scala, or Java.
Experience with data modeling, ETL/ELT processes, and data warehousing.
Experience conducting and documenting PoCs with hyperscalers or data platform vendors.Preferred Qualifications:

Certifications in AWS, Azure, or Databricks.
Experience with Snowflake, IBM DataStage, or other enterprise data tools.
Knowledge of CI/CD pipelines and infrastructure as code (e.g., Terraform, CloudFormation).
Familiarity with data governance frameworks and compliance standards

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Senior Data Engineer in Databricks

Vice President, Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Jobs

Data Engineering Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data engineering hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise reliable pipelines, modern lakehouse/streaming stacks, data contracts & governance, observability, performance/cost discipline & measurable business outcomes. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for platform‑oriented DEs, analytics engineers, streaming specialists, data reliability engineers, DEs supporting AI/ML platforms & data product managers. Who this is for: Data engineers, analytics engineers, streaming engineers, data reliability/SRE, data platform engineers, data product owners, ML/feature‑store engineers & SQL/ELT specialists targeting roles in the UK.

Jobs

Why Data Engineering Careers in the UK Are Becoming More Multidisciplinary

For many years, data engineering in the UK meant designing pipelines, moving data between systems, and ensuring analysts had what they needed. Today, the field is expanding. With cloud platforms, machine learning, real-time analytics and the explosion of sensitive personal data, employers expect data engineers to do much more. Modern data engineering is no longer just about code and storage. It requires legal awareness, ethical judgement, psychological insight, linguistic clarity and human-centred design. These disciplines shape how data is collected, processed, explained and trusted. In this article, we’ll explore why data engineering careers in the UK are becoming more multidisciplinary, how law, ethics, psychology, linguistics & design now influence job descriptions, and what job-seekers & employers must do to thrive.

Jobs

Data Engineering Team Structures Explained: Who Does What in a Modern Data Engineering Department

Data has become the lifeblood of modern organisations. Every sector in the UK—finance, healthcare, retail, government, technology—is increasingly relying on insights derived from data to drive decisions, deliver products, and improve operations. But raw data on its own isn’t enough. To make data useful, reliable, secure, and scalable, companies must build strong data engineering teams. If you’re recruiting for data engineering or seeking a role, understanding the structure of such a team and who does what is essential. This article breaks down the typical roles in a modern data engineering department, how they collaborate, required skills and qualifications, expected UK salaries, common challenges, and advice on structuring and growing a data engineering team.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.