Senior Data Engineer

Spitalfields and Banglatown
1 day ago
Create job alert

We believe in better. And we make it happen.
Better content. Better products. And better careers.
Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products, content and services millions of people love.
And we do it all right here at Sky.

Within the Communications & Infrastructure group, RTA ( Real-Time Analytics ) is a platform that offers every team and every individual in Sky Technology a managed service of Sky's Telco telemetry data assets and enables data anal ytics at scale.

We are looking for a promising and seasoned Sr. Data Engineer who will act as a technical leader within the data engineering team, shaping the future of our data platform and enabling data-driven decision-making across the organisation.

This role goes beyond coding- it's about influencing strategy, fostering collaboration, and driving excellence in data lifecycle management.

What you'll do Lead technical decisions and shape the data platform's long-term vision for efficiency, scalability, and compliance.

Define and deliver the data platform roadmap, collaborating with stakeholders to align with business objectives .

Oversee and contribute to the end-to-end delivery of data processing capabilities - including design, development, and support - with a distributed team.

Drive continuous improvement in ways of working and foster innovation by exploring new technologies and methodologies.

Implement robust data lifecycle management and automation to ensure data quality, security, accessibility, and compliance.

What you'll bring Graduate degree (BSc) in Computer Science, Electrical Engineering, or related field, coupled with extensive experience in data engineering.

Cloud & Infrastructure-as-Code: Deep expertise in architecting on major cloud platforms (GCP/AWS) using Terraform for infrastructure automation and Git for robust version control and CI/CD workflows.

Big Data Processing & Engineering: Advanced proficiency in Python and SQL to build scalable batch and streaming ETL/ELT pipelines using distributed frameworks like Spark or Beam.

Data Architecture & Storage: Extensive experience managing diverse data ecosystems, including Relational/NoSQL databases, high-performance Data Warehouses, and complex storage for structured and unstructured data

Data Governance & Security: Hands-on experience implementing data quality frameworks, security protocols, and full data lifecycle management.

Proven ability to lead and motivate teams in dynamic environments, ideally in Telecom or similar industries where software is always-on and customer experience is critical.

Collaborative Problem Solving: A "lead by influence" mindset that values diverse perspectives and proactively removes roadblocks to ensure team success.

Adaptability in High-Stakes Environments: Proven resilience in dynamic, "always-on" industries (like Telecom), where system uptime and customer experience are mission-critical.

Technology Stack Apache Airflow / Kafka

GCP ( BigQuery , GCS, Composer, IAM)

Python

Terraform

Linux / Bash

Team overview

Looking to be part of non-stop innovation? Join our Group Communications and Infrastructure team and you'll work alongside experts in broadband, telephony, mobile, cloud and infrastructure. We're the team that designs, builds, supports and maintains the telecoms networks across the whole Sky Group. Together, we help Sky broadband, mobile and TV enter new markets by creating a single and secure infrastructure for the amazing content and services that keep our customers coming back for more.

The rewards

There's one thing people can't stop talking about when it comes to #LifeAtSky: the perks. Here's a taster: Sky Q, for the TV you love all in one place

The magic of Sky Glass at an exclusive rate

A generous pension package

Private healthcare

Discounted mobile and broadband

A wide range of Sky VIP rewards and experiences

Inclusion & how you'll work

We are a Disability Confident Employer, and welcome and encourage applications from all candidates. We will look to ensure a fair and consistent experience for all, and will make reasonable adjustments to support you where" appropriate . Please flag any adjustments you need to your recruiter as early as you can.

We've "embraced hybrid working and split our time between unique office spaces and the convenience of working from home. You'll find out more about what hybrid working looks like for your role later in the recruitment process.

Your office space

Brick Lane

Our Brick Lane office is in the heart of the East End of London. It's part of a vibrant and varied community; close to street food, cafes, and shops.

The closest tube station is Aldgate East and Liverpool Street is about a 10-minute walk.

We'd love to hear from you

Inventive, forward-thinking minds come together to work in Tech, Product and Data at Sky. It's a place where you can explore what if, how far, and what next.

But better doesn't stop at what we do, it's how we do it, too. We embrace each other's differences. We support our community and contribute to a sustainable future for our business and the planet.

If you believe in better, we'll back you all the way.

Just so you know: if your application is successful, we'll ask you to complete a criminal record check. And depending on the role you have applied for and the nature of any convictions you may have, we might have to withdraw the offer

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Maths for Data Engineering Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are applying for data engineering jobs in the UK, maths can feel like a vague requirement hiding behind phrases like “strong analytical skills”, “performance mindset” or “ability to reason about systems”. Most of the time, hiring managers are not looking for advanced theory. They want confidence with the handful of maths topics that show up in real pipelines: Rates, units & estimation (throughput, cost, latency, storage growth) Statistics for data quality & observability (distributions, percentiles, outliers, variance) Probability for streaming, sampling & approximate results (sketches like HyperLogLog++ & the logic behind false positives) Discrete maths for DAGs, partitioning & systems thinking (graphs, complexity, hashing) Optimisation intuition for SQL plans & Spark performance (joins, shuffles, partition strategy, “what is the bottleneck”) This article is written for UK job seekers targeting roles like Data Engineer, Analytics Engineer, Platform Data Engineer, Data Warehouse Engineer, Streaming Data Engineer or DataOps Engineer.

Neurodiversity in Data Engineering Careers: Turning Different Thinking into a Superpower

Every modern organisation runs on data – but without good data engineering, even the best dashboards & machine learning models are built on sand. Data engineers design the pipelines, platforms & tools that make data accurate, accessible & reliable. Those pipelines need people who can think in systems, spot patterns in messy logs, notice what others overlook & design elegant solutions to complex problems. That is exactly why data engineering can be such a strong fit for many neurodivergent people, including those with ADHD, autism & dyslexia. If you’re neurodivergent & considering a data engineering career, you might have heard comments like “you’re too disorganised for engineering”, “too literal for stakeholder work” or “too distracted for complex systems”. In reality, the traits that can make traditional office environments hard often line up beautifully with data engineering work. This guide is written for data engineering job seekers in the UK. We’ll cover: What neurodiversity means in a data engineering context How ADHD, autism & dyslexia strengths map to common data engineering tasks Practical workplace adjustments you can request under UK law How to talk about your neurodivergence in applications & interviews By the end, you’ll have a clearer sense of where you might thrive in data engineering – & how to turn “different thinking” into a genuine professional superpower.

Data Engineering Hiring Trends 2026: What to Watch Out For (For Job Seekers & Recruiters)

As we move into 2026, the data engineering jobs market in the UK is evolving fast. Almost every organisation is talking about AI, analytics & data-driven decision making – but behind all that sits the data engineering function. Cloud costs, complex data estates, stricter regulation & the explosion of AI workloads are all changing how data platforms are built & run. Some companies are tightening budgets & consolidating teams, while others are doubling down on modern data stacks, lakehouses & real-time pipelines. Whether you are a data engineering job seeker planning your next move, or a recruiter building data teams, understanding the key data engineering hiring trends for 2026 will help you stay ahead.