Data Engineering Jobs

• Leeds
• Hybrid · 2 days in office
• £50,000 pa
• Mid-level

First dedicated data engineering hire in a growing data function, designing and maintaining scalable ETL/ELT pipelines and integrating internal and external sources including APIs. Builds and optimises data models for analytics and customer insight, working in cloud environments and helping evolve Microsoft Fabric capabilities alongside data science and analytics teams.

Microsoft Fabric · Azure · AWS +1

• London
• Mid-level
• Contract

Lead the shift from manual to automated processing across a Lloyd's insurer's Consortium and Facility business, designing scalable data pipelines that deliver bordereaux and feeds to follow markets. Hands-on role automating fee and profit commission calculations, including Consortia fees and Coverholder commissions, while maintaining Power BI reporting and working with underwriting, finance and operations teams.

Microsoft SQL Server · Power BI · Azure +2

• Newcastle upon Tyne
• Hybrid · 2 days in office
• £84,000 pa
• Senior

Own and oversee a business-critical enterprise data platform built on Microsoft Azure, acting as technical lead for architecture, scalability, governance and operational excellence. Work with Infrastructure, Security and Architecture teams on CI/CD, automation, monitoring and Infrastructure-as-Code, supporting production and incident management while enabling Data Engineers and shaping platform strategy across Data and AI initiatives.

Microsoft Azure · Azure Data Factory · Microsoft Fabric +5

• York
• Hybrid
• £60,000 pa
• Senior

Builds and maintains ETL pipelines and an in-house ingestion framework on a cloud-based data platform, while administering Databricks and supporting BI, analytics and AI initiatives. Works in a small, collaborative team serving an AI lab and group functions, with governance and Power BI enablement duties.

Databricks · PySpark · Python +7

• London
• Hybrid · 2–3 days in office
• Contract

Hands-on data engineering role building scalable pipelines and entity resolution for a Quantexa-led AML and financial crime programme in a global bank. Day to day involves Scala, Spark, Python and SQL work across Azure, Databricks and Elasticsearch, plus reusable frameworks and automation, collaborating with technology, product and business stakeholders across EMEA.

Quantexa · Azure · Databricks +4

• United Kingdom
• Remote
• £750 – £770 pd
• Senior
• Contract

Lead the design and governance of secure, scalable cloud-based data architectures on AWS within a complex enterprise environment. The role covers data platforms, APIs, microservices, event-driven and serverless solutions, plus cloud migration, architecture reviews and technical leadership across engineering, DevOps and security teams. Requires active SC and NPPV3 clearance and sole UK nationality.

AWS · EC2 · Lambda +7

• Cardiff
• Hybrid
• £61,500 – £67,500 pa
• Senior
• Permanent

Lead the establishment of an enterprise data architecture capability and design a Microsoft Fabric-based common data platform. Define data models, architecture principles, standards, governance and lineage across a complex organisation, working with architects, analysts and senior stakeholders to support reporting, analytics and strategic decision-making.

Microsoft Fabric · Microsoft Purview · Power BI +6

• United Kingdom
• £60,000 – £90,000 pa
• Senior · manages people

Senior consulting role shaping secure, standards-aligned data architectures for UK Government and Public Services programmes. Involves assessing current-state landscapes, defining target-state architectures and roadmaps, providing delivery assurance, leading data and AI proofs of concept, and owning data governance, quality and lineage. Also mentors junior architects and supports proposals and pre-sales.

Collibra · Informatica

• London
• Hybrid · 3 days in office
• £750 – £1,000 pd
• Lead
• Contract

Hands-on Staff-level engineer modernising a large enterprise data estate, migrating thousands of pipelines and building new data products. Requires deep Python/PySpark and Spark internals expertise, AWS Glue and Airflow, plus architectural leadership and AI-assisted development practices. Hybrid, three days per week on-site in London.

AWS Glue · Apache Spark · PySpark +4

• London
• £80,000 – £115,000 pa
• Senior
• Permanent

Hands-on engineering role migrating a Futures algorithmic trading platform's market data integration from the legacy LSEG/Refinitiv RFA to the Real-Time SDK (RTSDK). Involves analysing existing RFA integrations, developing Java applications and shared frameworks, and working with Futures and Options market data across exchanges while maintaining backward compatibility and trading workflows.

LSEG · Refinitiv · RFA +2

• London
• Hybrid · 1 day in office
• £500 pd
• Senior
• Contract

Hands-on senior engineer maintaining and developing data pipelines within a Measurement Innovation Team, focused on automating campaign measurement. Work includes GCP and BigQuery pipelines, privacy-safe joins via BigQuery and Snowflake clean rooms, cloud migration and security, plus some AWS. Day-to-day use of AI coding agents such as Claude Code is expected, alongside direct collaboration with external partners' data teams and internal stakeholders.

GCP · BigQuery · Snowflake +2

• Basildon
• Hybrid
• £300 – £395 pd
• Mid-level
• Contract

Hands-on contract role designing, building and optimising Snowflake data pipelines and ETL/ELT processes on a high-profile programme. You will develop data models, streams, tasks and stored procedures using SQL, Python, Snowpark and Snowpipe, integrate data across cloud and enterprise platforms, and tune performance while upholding data quality and governance standards.

Snowflake · dbt · Snowpipe +7

• London
• Hybrid
• £80,000 – £115,000 pa
• Lead
• Permanent

As one of the first senior data hires, you'll own the company's data architecture, building scalable batch and real-time pipelines, ingestion and storage solutions, and vector search and ML data pipelines. You'll work with AI, backend and product teams on model training and inference, ensure reliability and governance, and mentor future data engineers.

Qdrant · Milvus · pgvector +7

• Manchester
• Hybrid
• £85,000 – £95,000 pa
• Permanent

Designs, builds and maintains data solutions on Microsoft Fabric, including pipelines, lakehouses, warehouses and integrations for financial reporting. Partners with Finance and business stakeholders to turn complex requirements into secure, automated data platforms, while driving best practice in governance, testing and CI/CD.

Microsoft Fabric · Data Factory · OneLake +4

• London
• Remote
• £75,000 – £85,000 pa
• Senior

Own the design and build of scalable data pipelines and data products in Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT processes drawing on CRM, financial and subscription data. Shape enterprise data architecture, embed governance and quality controls, and mentor a junior engineer in a small, high-impact team near the start of its DataOps journey.

Databricks · PySpark · Spark SQL +4