National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Principle Data Engineer ( AWS & Airflow )

London
2 weeks ago
Create job alert

Job Title: Principal Data Engineer

Location: London, UK - Hybrid (Liverpool Street office)

Department: Data & Engineering

Reports To: Head of Data Science

Employment Type: Permanent

A leading global payments and fintech platform, empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and digital assets.

As they continue to scale their data infrastructure, they're seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines.

The ideal candidate will bring both technical depth and strategic thinking, with the ability to communicate effectively across business and technical teams.

Key Responsibilities

Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics.
Define and drive the long-term architecture and data strategy in alignment with business goals.
Own orchestration of ETL/ELT workflows using Apache Airflow, including scheduling, monitoring, and alerting.
Collaborate with cross-functional teams (Product, Engineering, Data Science, Compliance) to define data requirements and build reliable data flows.
Champion best practices in data modelling, governance, and DevOps for data engineering (CI/CD, IaC).
Serve as a key communicator between technical teams and business stakeholders, translating complex data needs into actionable plans.
Mentor and lead data engineers, fostering continuous learning and technical excellence.
Ensure compliance with data security, privacy, and regulatory standards (e.g., PCI-DSS, GDPR).

Essential:

7+ years in Data Engineering, with 2+ years in a Principal or Lead role.
Proven experience designing and delivering enterprise data strategies.
Exceptional communication and stakeholder management skills.
Expertise in enterprise-grade data warehouses (Snowflake, BigQuery, Redshift).
Hands-on experience with Apache Airflow (or similar orchestration tools).
Strong proficiency in Python and SQL for pipeline development.
Deep understanding of data architecture, dimensional modelling, and metadata management.
Experience with cloud platforms (AWS, GCP, or Azure).
Familiarity with version control, CI/CD, and Infrastructure-as-Code (Terraform or similar).

Desirable:

Background in fintech or payments.
Knowledge of streaming frameworks (Kafka, Kinesis).
Experience with dbt and data quality frameworks (e.g., Great Expectations).

What's on Offer

Competitive base salary + bonus
Flexible hybrid working model (Liverpool Street office)
Private healthcare & wellness benefits
Learning and development support
The opportunity to shape the future of payments data infrastructure

Related Jobs

View all jobs

Principle DevOps Engineer

Maths Teacher

Senior Network Engineer

Data Visualisation Analyst

Senior Azure Data Engineer - UK remote

Data Asset Register Lead

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Jobs UK 2025: 50 Companies Hiring Now

Bookmark this guide—refreshed every quarter—so you always know who’s really expanding their data engineering teams. Driven by the UK’s Digital Economy Strategy, the AI & GenAI boom, cheaper cloud storage and a squeeze on legacy batch pipelines, data engineering hiring is in overdrive for 2025. Employers from hyperscale tech firms to NHS trusts want lake‑house architects, streaming‑platform specialists, ETL developers, MLOps pipeline gurus, analytics engineers & FinOps‑savvy cost guardians—right now. Below you’ll find 50 organisations that posted UK‑based data engineering vacancies or announced head‑count growth in the last eight weeks. They’re grouped into five easy‑scan categories. For each company you’ll see its main UK hub, an example live or recent vacancy, and a quick reason it’s worth your time. Search any employer on DataEngineeringJobs.co.uk to view current ads, or set a free alert so fresh openings land straight in your inbox.

Return-to-Work Pathways: Relaunch Your Data Engineering Career with Returnships, Flexible & Hybrid Roles

Re-entering the workforce after a career break can feel like stepping into a rapidly shifting data pipeline—especially in a specialist field like data engineering. Whether you paused your career for parenting, caring responsibilities or another life chapter, the UK’s data engineering sector now offers a variety of return-to-work pathways. From structured returnships to flexible, hybrid and full-time roles, these programmes recognise the value of your transferable skills and life experience. With tailored mentorship, targeted upskilling and supportive networks, you can confidently relaunch your data engineering career. In this guide, you’ll learn how to: Understand the current demand for data engineers in the UK Leverage your organisational, communication and problem-solving skills in data contexts Overcome common re-entry challenges with practical solutions Refresh your technical knowledge through targeted learning Access returnship and re-entry programmes tailored to data engineering Find roles that fit around family commitments—whether flexible, hybrid or full-time Balance your relaunch with caring responsibilities Master applications, interviews and networking specific to data engineering Draw inspiration from real returner success stories Get answers to common questions in our FAQ section Whether you aim to return as a data pipeline developer, ETL specialist, big-data architect or analytics engineer, this article maps out the steps and resources you need to reignite your data engineering career.

LinkedIn Profile Checklist for Data Engineering Jobs: 10 Tweaks to Maximise Recruiter Visibility

As organisations harness vast volumes of data, the demand for skilled data engineers—experts in ETL pipelines, data warehousing, and scalable architectures—has surged. Recruiters routinely search LinkedIn for candidates proficient in tools like Spark, Kafka and SQL pipelines. To stand out, your profile must be optimised for relevant keywords and showcase your technical impact. This LinkedIn for data engineering jobs checklist provides ten precise tweaks to maximise recruiter visibility. Whether you’re building your first data platform or architecting petabyte-scale systems, these targeted adjustments will make your profile attract hiring managers and land interviews.