Data Engineer

The Open University UK
Milton Keynes
3 weeks ago
Create job alert

Job Location: Milton Keynes, Remote/Hybrid


Department: Data Technology


Closing Date: 5 March 2026


Weekly Working Hours: 37


Contract Type: Permanent


Fixed Term Contract: End Date: Not Applicable


Welsh Language: Not Applicable


Change your career, change lives

The Open University is the UK’s largest university, a world leader in flexible part-time education combining a mission to widen access to higher education with research excellence, transforming lives through education. Find out more about us and our mission by watching this short video (you will be taken to YouTube by clicking this link).


About the Role

Effective use of data is critical to the successful delivery of the Open University’s strategic goals. Reporting to the Data Technology Director within Digital Services, this key Data Engineer role is responsible for building, operating, and evolving the Data Technology capability for the Open University.


The successful candidate will be an experienced data engineering professional with strong expertise in modern data platforms, preferably Microsoft Azure. You will bring hands‑on experience with data engineering tools, programming languages, architectures, integration patterns, and operational best practices, and demonstrate the ability to implement these effectively at enterprise scale.


This role is responsible for the technical development of the Azure data platform and will act as the primary point of contact for data processing related to Tuition Services. As part of the Chief Data Office, the role will work closely with analytics and data teams to deliver a comprehensive and high‑quality data service to the University.


Key Responsibilities

  • Acting as an individual contributor across the wider technology team while serving as a specialist in data engineering.
  • Designing and delivering end‑to‑end data transformation pipelines, supporting both batch and streaming data ingestion.
  • Implementing resilient, self‑healing, and observable data ingestion and consumption infrastructure.
  • Taking technical ownership of workstreams, acting as the subject matter expert, and proactively managing risks and issues.
  • Defining, developing, and maintaining technical designs, documentation, and user artefacts, while driving continuous improvement within an agile delivery model.
  • Identifying and resolving technical problems and delivery roadblocks, working collaboratively with peers to drive issues to closure.
  • Performing performance tuning and code optimisation, and reviewing peers’ code to ensure adherence to best practices.
  • Mentoring and supporting the development of junior members of the data engineering team.
  • Working closely with the Data Engineering Lead and Analysts to ensure timely delivery of solutions that meet business and technical requirements.
  • Supporting technology innovation initiatives across the Open University through proofs of concept and exploratory work.

During the initial phase, the role will focus on:



  • Delivering highly critical data engineering solutions that enable the Open University to achieve its key strategic programmes.
  • Working closely with the Tuition Services team on current and future data processing, reporting, and analytics solutions.
  • Defining and delivering a roadmap for data platform uplift, aligned with Microsoft Azure’s technology roadmap, to meet future analytics needs in a cost‑effective and scalable manner.

About You

  • Communicating effectively with stakeholders at all levels, managing expectations, and facilitating discussions in high‑risk, complex, or time‑constrained environments.
  • Designing and delivering enterprise‑scale data integration solutions across the full data development lifecycle, with strong expertise in cloud‑based data engineering (preferably Microsoft Azure).
  • Leading and motivating teams to ensure the reliable and efficient delivery of enterprise data services.
  • Implementing both on‑premises and cloud‑based data engineering solutions, with hands‑on experience in relational databases, ETL tools, and programming languages such as SQL, Python, PySpark, and Java.
  • Defining and enforcing data engineering standards, architectural patterns, and industry best practices.
  • Advising on and shaping future technology roadmaps to deliver long‑term business value.
  • Investigating emerging data technologies and trends, conducting horizon scanning, and introducing innovative approaches and ways of working.
  • Azure certification as a Cloud Architect or Cloud Data Engineer.
  • Practical experience in cloud‑based development on the Microsoft Azure platform.
  • Strong hands‑on experience with Azure Data Factory, Data Lake, Synapse, SQL Database, and Microsoft Fabric.
  • Experience with Azure Databricks and Spark cluster management.
  • Experience building Azure Data Factory pipelines and configuring CI/CD pipelines using Git.

Support with your application

If you have any questions, or need support or adjustments relating to your application, the recruitment process, or the role, please contact us on or email quoting the advert reference number.


What's in it for you?

At The Open University, we offer a range of benefits to recognise and reward great work, alongside policies and flexible working that contribute towards a great work life balance. Get all the details of what benefits we offer by visiting our Staff Benefits page (clicking this link will open a new window).


We are open to discussions about flexible working. Whether it’s a job share, part time, compressed hours or another working arrangement. Please reach out to us to discuss what works best for you.


It is anticipated that a hybrid working pattern can be adopted for this role, where the successful candidate can work from home and the office. However, as this role is contractually aligned to our Milton Keynes office it is expected that some attendance in the office will be required when necessary and in response to business needs. We’d expect this to be approximately once per month.


Next steps in the Recruitment process

We anticipate that interviews for this role will be taking place online via Microsoft Teams during the week commencing 16 March 2026.


Early closing date notification

We may close this job advert earlier than the published closing date where a satisfactory number of applications are received. We would therefore encourage early applications.


How to apply

To apply for this role please submit the following documents:



  • CV
  • A personal statement of up to 1000 words. You should set out in your statement why you are interested in the role and provide examples of where your skills and experience meet the required competencies for this role as detailed in the job description.

You can view your progress and application communications when you are logged into our recruitment system. Please check your spam/junk folders if you do not receive associated email updates.


If you have any queries or questions about the recruitment process, or regarding your application,please contact: .


Looking for Associate Lecturer (AL) roles?

Please use our AL home page to find AL vacancies.


The Open University is committed to equality, diversity and inclusion which is reflected in our mission to be open to people, places, methods and ideas. We aim to foster a diverse and inclusive environment so that all in our OU community can reach their potential. We recognise that different people bring different perspectives, ideas, knowledge, and culture, and that this difference brings great strength.We strive to recruit, retain and develop the careers of a diverse pool of students and staff, and particularly encourage applications from all underrepresented groups. We also aspire to make The Open University a supportive workplace for all through our policies, services and staff networks.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer - AI Analytics and EdTech Developments

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Data Engineering Tools Do You Need to Know to Get a Data Engineering Job?

If you’re aiming for a career in data engineering, it can feel like you’re staring at a never-ending list of tools and technologies — SQL, Python, Spark, Kafka, Airflow, dbt, Snowflake, Redshift, Terraform, Kubernetes, and the list goes on. Scroll job boards and LinkedIn, and it’s easy to conclude that unless you have experience with every modern tool in the data stack, you won’t even get a callback. Here’s the honest truth most data engineering hiring managers will quietly agree with: 👉 They don’t hire you because you know every tool — they hire you because you can solve real data problems with the tools you know. Tools matter. But only in service of outcomes. Jobs are won by candidates who know why a technology is used, when to use it, and how to explain their decisions. So how many data engineering tools do you actually need to know to get a job? For most job seekers, the answer is far fewer than you think — but you do need them in the right combination and order. This article breaks down what employers really expect, which tools are core, which are role-specific, and how to focus your learning so you look capable and employable rather than overwhelmed.

What Hiring Managers Look for First in Data Engineering Job Applications (UK Guide)

If you’re applying for data engineering jobs in the UK, the first thing to understand is this: Hiring managers don’t read every word of your CV. They scan it. They look for signals of relevance, credibility, delivery and collaboration — and if they don’t see the right signals quickly, your application may never get a second look. In data engineering, hiring managers are especially focused on whether you can build and operate reliable, scalable data systems, handle real-world data challenges and work effectively with analytics, BI, data science and engineering teams. This guide breaks down exactly what they look at first in your application — and how to shape your CV, portfolio and cover letter so you stand out.

The Skills Gap in Data Engineering Jobs: What Universities Aren’t Teaching

Data engineering has quietly become one of the most critical roles in the modern technology stack. While data science and AI often receive the spotlight, data engineers are the professionals who design, build and maintain the systems that make data usable at scale. Across the UK, demand for data engineers continues to rise. Organisations in finance, retail, healthcare, government, media and technology all report difficulty hiring candidates with the right skills. Salaries remain strong, and experienced professionals are in short supply. Yet despite this demand, many graduates with degrees in computer science, data science or related disciplines struggle to secure data engineering roles. The reason is not academic ability. It is a persistent skills gap between university education and real-world data engineering work. This article explores that gap in depth: what universities teach well, what they consistently miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data engineering.