Data Engineering Jobs in London

• London
• Hybrid
• £55,000 – £65,000 pa
• Mid-level
• Permanent

Design, build and maintain ETL/data pipelines and secure cloud-based data platforms using Python and SQL, applying DataOps and DevOps practices. Work with architects, analysts and software engineers on high-impact projects supporting UK national security, covering data modelling, orchestration and governance.

AWS

• London
• Hybrid · 2 days in office
• Lead · manages people

Lead a data engineering team, setting technical direction and mentoring developers while driving solution design and stakeholder decisions. Day-to-day involves monitoring delivery against plans, ensuring scalability and performance, and promoting software engineering best practices including AI-based development. Requires SQL, Python, microservices and test-driven development experience.

Git

• London
• Hybrid
• £100,000 – £120,000 pa
• Director · manages people

Own the design, build and delivery of a modern enterprise cloud data platform for a large UK financial services organisation, leading migration off legacy environments. Responsibilities span platform strategy and architecture, building and scaling a data engineering function, supplier management, and embedding governance, security and data quality standards in a regulated setting.

• London
• Hybrid · 3 days in office
• £90,000 – £110,000 pa
• Senior
• Permanent · Flexible

Defines and evolves the architecture of a modern cloud-based data platform, providing technical leadership across data platform and engineering teams. Designs scalable, secure data solutions and champions DataOps practices including CI/CD, testing, monitoring and automation, while guiding ETL/ELT implementation and AI-enablement initiatives.

Google Cloud Platform · BigQuery · dbt +1

• London
• £60,000 – £65,000 pa
• Mid-level

Design, build and optimise scalable data pipelines, platforms and logical/physical data models on cloud-based, enterprise-scale initiatives. Work with technical teams and business stakeholders in agile delivery, embedding data quality and governance while contributing to architecture discussions and technology recommendations.

• London
• Hybrid · 2 days in office
• £85,000 – £90,000 pa
• Senior
• Permanent

Defines and maintains enterprise data architecture strategy and roadmap across all business capabilities, assuring change initiatives and supporting procurement from a data perspective. Works alongside enterprise architects and the data quality team on cloud migration, system consolidation, AI adoption and enterprise data modelling, with a tech stack spanning Oracle, SQL Server, Data Factory and Fabric. Based on site two days a week near London Bridge in a highly collaborative team.

Oracle · SQL Server · Azure Data Factory +1

• London
• Hybrid
• £40,000 – £70,000 pa
• Mid-level

Client-facing role designing and building scalable cloud data platforms for enterprise clients, with hands-on work on ETL/ELT pipelines, data architectures and ingestion, transformation and orchestration tooling. Tech stack centres on AWS, Databricks, Python, SQL and DBT, with scope to apply emerging technologies such as Agentic AI.

AWS · Databricks · S3 +6

• London
• £70,000 – £90,000 pa
• Senior

Designs scalable, secure data architectures and builds data platforms, lakes and ETL/ELT pipelines, translating business needs into technical roadmaps. Works with cloud stacks such as AWS, Azure, GCP or Snowflake and applies data governance, quality and security principles, typically within regulated financial services settings.

AWS · Azure · GCP +4

• London
• £60,000 – £75,000 pa
• Senior

Own the architecture, orchestration and production readiness of a data pipeline, implementing arbitration, eligibility, consent and contact-policy logic. Handle activation datasets, manifests, SFTP delivery, PR review, CI/CD, observability and incident response using SQL, Python/Spark and Databricks.

Databricks · Spark · Azure DevOps +4

• Bromley
• Hybrid · 3 days in office
• £700 – £750 pd
• Mid-level
• Contract

Builds and supports enterprise data pipelines and OpenShift-based solutions for an investment banking client, using Scala, Apache Spark and containerisation. Works on batch and real-time processing, CI/CD and cloud-native deployment within a cross-functional Agile team on a 12-month contract.

Scala · Apache Spark · OpenShift +1

• London
• Mid-level
• Contract

Lead the shift from manual to automated processing across a Lloyd's insurer's Consortium and Facility business, designing scalable data pipelines that deliver bordereaux and feeds to follow markets. Hands-on role automating fee and profit commission calculations, including Consortia fees and Coverholder commissions, while maintaining Power BI reporting and working with underwriting, finance and operations teams.

Microsoft SQL Server · Power BI · Azure +2

• London
• Hybrid
• £50,000 – £60,000 pa
• Mid-level
• Permanent

Builds and maintains scalable data pipelines using Azure Data Factory and Databricks, integrating data from finance, HR and operational systems. Develops a lakehouse architecture with Kimball and star-schema models, and supports the Power BI reporting layer including semantic models and DAX. Joins an early-stage data function, shaping standards and working closely with business stakeholders.

Azure Data Factory · Databricks · Power BI +1

• London
• Hybrid
• £100,000 – £110,000 pa
• Lead
• Permanent

Hands-on data engineering lead role at a private equity firm, designing and scaling modern data platforms across a portfolio of companies. Combines technical delivery, data architecture and senior stakeholder advisory, with direct C-suite exposure and a focus on making infrastructure AI-ready for advanced analytics and agentic AI use cases.

• London
• On-site
• £100,000 – £120,000 pa
• Senior
• Permanent

Hands-on data engineering lead designing scalable, AI-ready data platforms and architectures across an investment firm's portfolio. Combines building end-to-end infrastructure in SQL and Python with advising C-suite teams on data strategy, prioritisation and commercial impact, working tech-agnostically across varied environments.

• London
• Remote
• £60,000 – £75,000 pa
• Senior
• Permanent

Lead the design and delivery of greenfield data engineering projects from concept to production, building pipelines, transformations and orchestration workflows on modern cloud data platforms. The role offers genuine ownership, acting as technical point of contact for stakeholders and clients, within a fully remote team across the UK and Ireland.

Terraform