Data Engineer

The Open University
Milton Keynes
1 week ago
Create job alert
Overview

Are you a data engineering expert ready to shape the future of data at one of the UK’s most respected learning institutions?

Join The Open University as a Data Engineer and play a key role in developing modern data capabilities that enable better insight, analytics, and decision‑making across the organisation.

About the Role

Effective use of data is critical to the successful delivery of the Open University’s strategic goals. Reporting to the Data Technology Director within Digital Services, this key Data Engineer role is responsible for building, operating, and evolving the Data Technology capability for the Open University.

The successful candidate will be an experienced data engineering professional with strong expertise in modern data platforms, preferably Microsoft Azure. You will bring hands-on experience with data engineering tools, programming languages, architectures, integration patterns, and operational best practices, and demonstrate the ability to implement these effectively at enterprise scale.

This role is responsible for the technical development of the Azure data platform and will act as the primary point of contact for data processing related to Tuition Services. As part of the Chief Data Office, the role will work closely with analytics and data teams to deliver a comprehensive and high-quality data service to the University.

Key Responsibilities
  • Acting as an individual contributor across the wider technology team while serving as a specialist in data engineering.
  • Designing and delivering end-to-end data transformation pipelines, supporting both batch and streaming data ingestion.
  • Implementing resilient, self-healing, and observable data ingestion and consumption infrastructure.
  • Taking technical ownership of workstreams, acting as the subject matter expert, and proactively managing risks and issues.
  • Defining, developing, and maintaining technical designs, documentation, and user artefacts, while driving continuous improvement within an agile delivery model.
  • Identifying and resolving technical problems and delivery roadblocks, working collaboratively with peers to drive issues to closure.
  • Performing performance tuning and code optimisation, and reviewing peers’ code to ensure adherence to best practices.
  • Mentoring and supporting the development of junior members of the data engineering team.
  • Working closely with the Data Engineering Lead and Analysts to ensure timely delivery of solutions that meet business and technical requirements.
  • Supporting technology innovation initiatives across the Open University through proofs of concept and exploratory work.

During the initial phase, the role will focus on:

  • Delivering highly critical data engineering solutions that enable the Open University to achieve its key strategic programmes.
  • Working closely with the Tuition Services team on current and future data processing, reporting, and analytics solutions.
  • Defining and delivering a roadmap for data platform uplift, aligned with Microsoft Azure’s technology roadmap, to meet future analytics needs in a cost-effective and scalable manner.
About You
  • Communicating effectively with stakeholders at all levels, managing expectations, and facilitating discussions in high-risk, complex, or time-constrained environments.
  • Designing and delivering enterprise-scale data integration solutions across the full data development lifecycle, with strong expertise in cloud-based data engineering (preferably Microsoft Azure).
  • Leading and motivating teams to ensure the reliable and efficient delivery of enterprise data services.
  • Implementing both on-premises and cloud-based data engineering solutions, with hands-on experience in relational databases, ETL tools, and programming languages such as SQL, Python, PySpark, and Java.
  • Defining and enforcing data engineering standards, architectural patterns, and industry best practices.
  • Advising on and shaping future technology roadmaps to deliver long-term business value.
  • Investigating emerging data technologies and trends, conducting horizon scanning, and introducing innovative approaches and ways of working.
  • Azure certification as a Cloud Architect or Cloud Data Engineer.
  • Practical experience in cloud-based development on the Microsoft Azure platform.
  • Strong hands-on experience with Azure Data Factory, Data Lake, Synapse, SQL Database, and Microsoft Fabric.
  • Experience with Azure Databricks and Spark cluster management.
  • Experience building Azure Data Factory pipelines and configuring CI/CD pipelines using Git.
Support with your application

If you have any questions, or need support or adjustments relating to your application, the recruitment process, or the role, please contact us on or email quoting the advert reference number.

Why Join The Open University?

At The Open University, we’re pioneers in accessible, high‑quality education. This is your chance to help build future‑proof data capabilities that directly support students, staff, and the University’s long-term strategy.

Our benefits include:

  • 33 days annual leave, on top of bank holidays and a three-day Christmas closure period.
  • Access to a leading pension scheme for UK higher education with generous employer contributions.
  • Staff Fee Waivers for OU study, meaning you could earn a degree for free.
  • Hybrid working, with limited requirement to attend the office in-person, with agile working and family friendly policies.
  • Discounts, wellbeing support, and development opportunities.

Ready to help shape the future of data at the OU?

Apply now and be part of a team delivering transformative data solutions that power world‑class digital learning.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer - AI Analytics and EdTech Developments

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Data Engineering Tools Do You Need to Know to Get a Data Engineering Job?

If you’re aiming for a career in data engineering, it can feel like you’re staring at a never-ending list of tools and technologies — SQL, Python, Spark, Kafka, Airflow, dbt, Snowflake, Redshift, Terraform, Kubernetes, and the list goes on. Scroll job boards and LinkedIn, and it’s easy to conclude that unless you have experience with every modern tool in the data stack, you won’t even get a callback. Here’s the honest truth most data engineering hiring managers will quietly agree with: 👉 They don’t hire you because you know every tool — they hire you because you can solve real data problems with the tools you know. Tools matter. But only in service of outcomes. Jobs are won by candidates who know why a technology is used, when to use it, and how to explain their decisions. So how many data engineering tools do you actually need to know to get a job? For most job seekers, the answer is far fewer than you think — but you do need them in the right combination and order. This article breaks down what employers really expect, which tools are core, which are role-specific, and how to focus your learning so you look capable and employable rather than overwhelmed.

What Hiring Managers Look for First in Data Engineering Job Applications (UK Guide)

If you’re applying for data engineering jobs in the UK, the first thing to understand is this: Hiring managers don’t read every word of your CV. They scan it. They look for signals of relevance, credibility, delivery and collaboration — and if they don’t see the right signals quickly, your application may never get a second look. In data engineering, hiring managers are especially focused on whether you can build and operate reliable, scalable data systems, handle real-world data challenges and work effectively with analytics, BI, data science and engineering teams. This guide breaks down exactly what they look at first in your application — and how to shape your CV, portfolio and cover letter so you stand out.

The Skills Gap in Data Engineering Jobs: What Universities Aren’t Teaching

Data engineering has quietly become one of the most critical roles in the modern technology stack. While data science and AI often receive the spotlight, data engineers are the professionals who design, build and maintain the systems that make data usable at scale. Across the UK, demand for data engineers continues to rise. Organisations in finance, retail, healthcare, government, media and technology all report difficulty hiring candidates with the right skills. Salaries remain strong, and experienced professionals are in short supply. Yet despite this demand, many graduates with degrees in computer science, data science or related disciplines struggle to secure data engineering roles. The reason is not academic ability. It is a persistent skills gap between university education and real-world data engineering work. This article explores that gap in depth: what universities teach well, what they consistently miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data engineering.