Data Engineer – Databricks Specialist (SC Cleared)

Farringdon, Greater London
1 day ago
Create job alert

Data Engineer – Databricks Specialist (SC Cleared)
SR2 is supporting a high-impact greenfield transformation programme within the public sector. We are looking for a hands-on Data Engineer with deep experience in Databricks and modern data architectures to help shape and build the foundation of a new cloud-native data platform from the ground up.
This role offers the opportunity to directly influence data engineering best practice, advise on architectural decisions, and collaborate with stakeholders across government, hyperscalers, and delivery teams to ensure performance, scalability, and compliance from day one.
Key Responsibilities:

Design and implement streaming and batch data pipelines in Databricks to support complex public sector use cases.
Lead the setup of a new Databricks environment, including security, data governance, orchestration, and performance tuning.
Collaborate with hyperscalers (e.g. AWS) to conduct Proofs of Concept (PoCs) for new data services and platforms.
Document architecture, performance benchmarks, and technical recommendations to support future scaling and support.Required Experience & Skills:

Proven experience as a Data Engineer delivering solutions in Databricks (across both streaming and batch).
Strong hands-on knowledge of cloud platforms, particularly AWS
Experience in building data solutions from scratch, including environment setup, configuration, and integration.
Programming proficiency in Python and/or Scala for data transformation, orchestration, and automation.
Demonstrable experience in conducting PoCs and documenting technical outcomes

Related Jobs

View all jobs

Data Engineer (Databricks)

Databricks Data Engineer

Lead Data Engineer

Python Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Neurodiversity in Data Engineering Careers: Turning Different Thinking into a Superpower

Every modern organisation runs on data – but without good data engineering, even the best dashboards & machine learning models are built on sand. Data engineers design the pipelines, platforms & tools that make data accurate, accessible & reliable. Those pipelines need people who can think in systems, spot patterns in messy logs, notice what others overlook & design elegant solutions to complex problems. That is exactly why data engineering can be such a strong fit for many neurodivergent people, including those with ADHD, autism & dyslexia. If you’re neurodivergent & considering a data engineering career, you might have heard comments like “you’re too disorganised for engineering”, “too literal for stakeholder work” or “too distracted for complex systems”. In reality, the traits that can make traditional office environments hard often line up beautifully with data engineering work. This guide is written for data engineering job seekers in the UK. We’ll cover: What neurodiversity means in a data engineering context How ADHD, autism & dyslexia strengths map to common data engineering tasks Practical workplace adjustments you can request under UK law How to talk about your neurodivergence in applications & interviews By the end, you’ll have a clearer sense of where you might thrive in data engineering – & how to turn “different thinking” into a genuine professional superpower.

Data Engineering Hiring Trends 2026: What to Watch Out For (For Job Seekers & Recruiters)

As we move into 2026, the data engineering jobs market in the UK is evolving fast. Almost every organisation is talking about AI, analytics & data-driven decision making – but behind all that sits the data engineering function. Cloud costs, complex data estates, stricter regulation & the explosion of AI workloads are all changing how data platforms are built & run. Some companies are tightening budgets & consolidating teams, while others are doubling down on modern data stacks, lakehouses & real-time pipelines. Whether you are a data engineering job seeker planning your next move, or a recruiter building data teams, understanding the key data engineering hiring trends for 2026 will help you stay ahead.

Data Engineering Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data engineering hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise reliable pipelines, modern lakehouse/streaming stacks, data contracts & governance, observability, performance/cost discipline & measurable business outcomes. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for platform‑oriented DEs, analytics engineers, streaming specialists, data reliability engineers, DEs supporting AI/ML platforms & data product managers. Who this is for: Data engineers, analytics engineers, streaming engineers, data reliability/SRE, data platform engineers, data product owners, ML/feature‑store engineers & SQL/ELT specialists targeting roles in the UK.