Senior Data Engineer

Spitalfields and Banglatown
1 month ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

We believe in better. And we make it happen.
Better content. Better products. And better careers.
Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products, content and services millions of people love.
And we do it all right here at Sky.

Within the Communications & Infrastructure group, RTA ( Real-Time Analytics ) is a platform that offers every team and every individual in Sky Technology a managed service of Sky's Telco telemetry data assets and enables data anal ytics at scale.

We are looking for a promising and seasoned Sr. Data Engineer who will act as a technical leader within the data engineering team, shaping the future of our data platform and enabling data-driven decision-making across the organisation.

This role goes beyond coding- it's about influencing strategy, fostering collaboration, and driving excellence in data lifecycle management.

What you'll do Lead technical decisions and shape the data platform's long-term vision for efficiency, scalability, and compliance.

Define and deliver the data platform roadmap, collaborating with stakeholders to align with business objectives .

Oversee and contribute to the end-to-end delivery of data processing capabilities - including design, development, and support - with a distributed team.

Drive continuous improvement in ways of working and foster innovation by exploring new technologies and methodologies.

Implement robust data lifecycle management and automation to ensure data quality, security, accessibility, and compliance.

What you'll bring Graduate degree (BSc) in Computer Science, Electrical Engineering, or related field, coupled with extensive experience in data engineering.

Cloud & Infrastructure-as-Code: Deep expertise in architecting on major cloud platforms (GCP/AWS) using Terraform for infrastructure automation and Git for robust version control and CI/CD workflows.

Big Data Processing & Engineering: Advanced proficiency in Python and SQL to build scalable batch and streaming ETL/ELT pipelines using distributed frameworks like Spark or Beam.

Data Architecture & Storage: Extensive experience managing diverse data ecosystems, including Relational/NoSQL databases, high-performance Data Warehouses, and complex storage for structured and unstructured data

Data Governance & Security: Hands-on experience implementing data quality frameworks, security protocols, and full data lifecycle management.

Proven ability to lead and motivate teams in dynamic environments, ideally in Telecom or similar industries where software is always-on and customer experience is critical.

Collaborative Problem Solving: A "lead by influence" mindset that values diverse perspectives and proactively removes roadblocks to ensure team success.

Adaptability in High-Stakes Environments: Proven resilience in dynamic, "always-on" industries (like Telecom), where system uptime and customer experience are mission-critical.

Technology Stack Apache Airflow / Kafka

GCP ( BigQuery , GCS, Composer, IAM)

Python

Terraform

Linux / Bash

Team overview

Looking to be part of non-stop innovation? Join our Group Communications and Infrastructure team and you'll work alongside experts in broadband, telephony, mobile, cloud and infrastructure. We're the team that designs, builds, supports and maintains the telecoms networks across the whole Sky Group. Together, we help Sky broadband, mobile and TV enter new markets by creating a single and secure infrastructure for the amazing content and services that keep our customers coming back for more.

The rewards

There's one thing people can't stop talking about when it comes to #LifeAtSky: the perks. Here's a taster: Sky Q, for the TV you love all in one place

The magic of Sky Glass at an exclusive rate

A generous pension package

Private healthcare

Discounted mobile and broadband

A wide range of Sky VIP rewards and experiences

Inclusion & how you'll work

We are a Disability Confident Employer, and welcome and encourage applications from all candidates. We will look to ensure a fair and consistent experience for all, and will make reasonable adjustments to support you where" appropriate . Please flag any adjustments you need to your recruiter as early as you can.

We've "embraced hybrid working and split our time between unique office spaces and the convenience of working from home. You'll find out more about what hybrid working looks like for your role later in the recruitment process.

Your office space

Brick Lane

Our Brick Lane office is in the heart of the East End of London. It's part of a vibrant and varied community; close to street food, cafes, and shops.

The closest tube station is Aldgate East and Liverpool Street is about a 10-minute walk.

We'd love to hear from you

Inventive, forward-thinking minds come together to work in Tech, Product and Data at Sky. It's a place where you can explore what if, how far, and what next.

But better doesn't stop at what we do, it's how we do it, too. We embrace each other's differences. We support our community and contribute to a sustainable future for our business and the planet.

If you believe in better, we'll back you all the way.

Just so you know: if your application is successful, we'll ask you to complete a criminal record check. And depending on the role you have applied for and the nature of any convictions you may have, we might have to withdraw the offer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Data Engineering Tools Do You Need to Know to Get a Data Engineering Job?

If you’re aiming for a career in data engineering, it can feel like you’re staring at a never-ending list of tools and technologies — SQL, Python, Spark, Kafka, Airflow, dbt, Snowflake, Redshift, Terraform, Kubernetes, and the list goes on. Scroll job boards and LinkedIn, and it’s easy to conclude that unless you have experience with every modern tool in the data stack, you won’t even get a callback. Here’s the honest truth most data engineering hiring managers will quietly agree with: 👉 They don’t hire you because you know every tool — they hire you because you can solve real data problems with the tools you know. Tools matter. But only in service of outcomes. Jobs are won by candidates who know why a technology is used, when to use it, and how to explain their decisions. So how many data engineering tools do you actually need to know to get a job? For most job seekers, the answer is far fewer than you think — but you do need them in the right combination and order. This article breaks down what employers really expect, which tools are core, which are role-specific, and how to focus your learning so you look capable and employable rather than overwhelmed.

What Hiring Managers Look for First in Data Engineering Job Applications (UK Guide)

If you’re applying for data engineering jobs in the UK, the first thing to understand is this: Hiring managers don’t read every word of your CV. They scan it. They look for signals of relevance, credibility, delivery and collaboration — and if they don’t see the right signals quickly, your application may never get a second look. In data engineering, hiring managers are especially focused on whether you can build and operate reliable, scalable data systems, handle real-world data challenges and work effectively with analytics, BI, data science and engineering teams. This guide breaks down exactly what they look at first in your application — and how to shape your CV, portfolio and cover letter so you stand out.

The Skills Gap in Data Engineering Jobs: What Universities Aren’t Teaching

Data engineering has quietly become one of the most critical roles in the modern technology stack. While data science and AI often receive the spotlight, data engineers are the professionals who design, build and maintain the systems that make data usable at scale. Across the UK, demand for data engineers continues to rise. Organisations in finance, retail, healthcare, government, media and technology all report difficulty hiring candidates with the right skills. Salaries remain strong, and experienced professionals are in short supply. Yet despite this demand, many graduates with degrees in computer science, data science or related disciplines struggle to secure data engineering roles. The reason is not academic ability. It is a persistent skills gap between university education and real-world data engineering work. This article explores that gap in depth: what universities teach well, what they consistently miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data engineering.