Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer

The AA
City of London
6 days ago
Create job alert
Overview

Location: London (hybrid working 3 office days per week)

Employment Type: Full time / Permanent

Application Closing Date: Friday 17th October 2025

Thought The AA only provide roadside assistance? Think again. For over 100 years, we’ve evolved and today, as the nation’s number one motoring organisation, we offer a range of products and services from roadside assistance to home and motor insurance as well as driving technologies. As we continue to expand, diversify, and modernise, joining us as our Data Engineer, you’ll play a key part to our success and join us on this exciting motoring journey.

What will I be doing?
  • Shape the future of data by designing and building robust pipelines that ingest, transform, and deliver underwriting insights from a variety of sources.
  • Harness Azure to develop and maintain cloud-native data architectures using services such as Azure Data Factory, Synapse, and Databricks.
  • Collaborate with stakeholders to translate complex data needs into scalable technical solutions.
  • Champion data integrity by ensuring systems meet quality, governance, and regulatory compliance.
  • Drive performance by optimising data systems for real-time and batch processing, ensuring speed and scalability.
  • Monitor pipelines, troubleshoot issues, and keep data flowing smoothly.
  • Build intelligence into underwriting datasets through data modelling and metadata management.
  • Support users by responding to data incidents and assisting the team with triage and resolution.
  • Work within the technical architecture, documentation standards, governance policies, and procedures to deliver excellence.
What do I need?
  • Proven experience as a Data Engineer or in a similar role, with hands-on Python, ETL, SQL, and cloud-based environments.
  • Strong proficiency in Python for data processing and automation tasks.
  • Experience with ETL tools/frameworks such as Apache Airflow, Talend, or Informatica.
  • Deep understanding of cloud platforms, ideally Microsoft Azure, and services like Azure Data Factory, Azure Databricks, and Azure SQL Database.
  • Experience working with end users to gather requirements and deliver user-centric data solutions.
  • Hands-on experience with Databricks for big data processing and analytics.
  • Familiarity with big data technologies like Apache Spark.
  • Experience in real-time data processing and handling XML files.
Benefits
  • 25 days annual leave plus bank holidays + holiday buying scheme
  • Worksave pension scheme with up to 7% employer contribution
  • Free AA breakdown membership from Day 1 plus 50% discount for family and friends
  • Discounts on AA products including car and home insurance
  • Employee discount scheme including car salary sacrifice and discounts on healthcare, shopping, holidays and more
  • Company funded life assurance
  • Diverse learning and development opportunities
  • Dedicated Employee Assistance Programme and 24/7 remote GP service for you and your family

We’re an equal opportunities employer and welcome applications from everyone. The AA values diversity and the difference this brings to our culture and our customers. We actively seek people from diverse backgrounds to join us and become part of an inclusive company where you can be yourself, be empowered to be your best and feel like you truly belong. We have five communities to bring together people with shared characteristics and backgrounds and drive positive change.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data engineering hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise reliable pipelines, modern lakehouse/streaming stacks, data contracts & governance, observability, performance/cost discipline & measurable business outcomes. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for platform‑oriented DEs, analytics engineers, streaming specialists, data reliability engineers, DEs supporting AI/ML platforms & data product managers. Who this is for: Data engineers, analytics engineers, streaming engineers, data reliability/SRE, data platform engineers, data product owners, ML/feature‑store engineers & SQL/ELT specialists targeting roles in the UK.

Why Data Engineering Careers in the UK Are Becoming More Multidisciplinary

For many years, data engineering in the UK meant designing pipelines, moving data between systems, and ensuring analysts had what they needed. Today, the field is expanding. With cloud platforms, machine learning, real-time analytics and the explosion of sensitive personal data, employers expect data engineers to do much more. Modern data engineering is no longer just about code and storage. It requires legal awareness, ethical judgement, psychological insight, linguistic clarity and human-centred design. These disciplines shape how data is collected, processed, explained and trusted. In this article, we’ll explore why data engineering careers in the UK are becoming more multidisciplinary, how law, ethics, psychology, linguistics & design now influence job descriptions, and what job-seekers & employers must do to thrive.

Data Engineering Team Structures Explained: Who Does What in a Modern Data Engineering Department

Data has become the lifeblood of modern organisations. Every sector in the UK—finance, healthcare, retail, government, technology—is increasingly relying on insights derived from data to drive decisions, deliver products, and improve operations. But raw data on its own isn’t enough. To make data useful, reliable, secure, and scalable, companies must build strong data engineering teams. If you’re recruiting for data engineering or seeking a role, understanding the structure of such a team and who does what is essential. This article breaks down the typical roles in a modern data engineering department, how they collaborate, required skills and qualifications, expected UK salaries, common challenges, and advice on structuring and growing a data engineering team.