Data Engineering Jobs

• London
• Hybrid · 2–3 days in office
• Contract

Hands-on data engineering role building scalable pipelines and entity resolution for a Quantexa-led AML and financial crime programme in a global bank. Day to day involves Scala, Spark, Python and SQL work across Azure, Databricks and Elasticsearch, plus reusable frameworks and automation, collaborating with technology, product and business stakeholders across EMEA.

Quantexa · Azure · Databricks +4

• United Kingdom
• Lead

Designs and operates core distributed systems for a serverless Elasticsearch offering, focusing on cluster coordination, shard allocation, and consistent indexing across nodes. Involves debugging concurrency and performance issues at petabyte scale, owning operational investigations end-to-end, and collaborating asynchronously across a distributed team.

Elasticsearch · Lucene · JDK +1

• London
• Hybrid
• £85,000 – £115,000 pa
• Mid-level
• Permanent

Develops and maintains high-performance, data-driven applications using KDB+/q and Python, building and optimising data pipelines and time-series solutions. Works on query performance, data processing and system efficiency, troubleshooting issues and collaborating with technical teams. Financial services or capital markets background is preferred.

KDB+ · Python · SQL +2

• Telford
• Hybrid · 2 days in office
• £400 – £460 pd
• Mid-level
• Contract

Support live data platforms and improve service monitoring across a complex technical environment, working with Denodo, Talend, PDI, Git, MySQL and Amazon Redshift. Build and consolidate Grafana dashboards into a unified Live Service view with drill-down, implement alerting for legacy services, and gather requirements from service stakeholders to boost visibility and operational resilience.

Denodo · Talend · PDI +4

• Manchester
• Hybrid · 4 days in office
• £800 – £1,000 pd
• Lead
• Contract

Hands-on technical leadership role shaping a strategic data platform for an investment management firm, with Snowflake at its core. Responsibilities span designing scalable platform solutions, building and optimising end-to-end ELT pipelines, defining engineering standards and governance, and developing Infrastructure as Code with Cloud Engineering. Works in an Agile team supporting analytics, AI and ML adoption.

Snowflake · Snowpark · dbt +7

• Liverpool
• Hybrid · 2 days in office
• £48,000 pa

Manages and optimises on-premise and Azure MS SQL database systems supporting mission-critical logistics applications, covering performance tuning, security, backup and disaster recovery, and capacity planning. Works with T-SQL, Python, Spark, Databricks, Airflow and dbt, collaborating closely with development and IT teams. Hybrid role with two days a week at the Liverpool Docks office.

MS SQL Server · Azure · AWS +5

• Leeds
• Hybrid
• £60,000 – £75,000 pa
• Senior

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role based in Leeds supporting client data engineering and integration engagements.

Quantexa · Spark · Scala +7

• London
• Hybrid
• £60,000 – £80,000 pa
• Senior
• Permanent

Design and implement robust data pipelines and configure Quantexa components while leading the technical development of Quantexa-based solutions for established clients. Work with Spark, Scala and Python Databricks, with exposure to DevOps and CI/CD tooling such as Jenkins, GitHub Actions, Azure DevOps, Docker and Kubernetes. Hybrid role in London supporting client data engineering and integration engagements.

Quantexa · Spark · Scala +7

• Birmingham
• £38,000 – £45,000 pa
• Mid-level

Hands-on role developing and maintaining data pipelines, models and SQL-based transformations, plus dashboards and reporting datasets. Works with cloud data platforms and relational databases, monitoring data quality and collaborating with technical and non-technical stakeholders across business functions.

• United Kingdom
• Remote
• £700 – £750 pd
• Senior · manages people
• Contract

Lead the design and implementation of data flows connecting operational systems, analytics and BI platforms, plus data streaming systems and database management. The role involves building and testing complex or large-scale data products, selecting technologies for resilient, scalable solutions, and designing metadata repositories. It also covers troubleshooting databases and data processes, and facilitating discussions across technical and non-technical stakeholders.

• Derby
• Hybrid · 2 days in office
• £40,000 pa
• Mid-level
• Permanent

Builds and establishes modern data engineering solutions in Microsoft Fabric, covering OneLake, Lakehouses, Warehouses, pipelines, Dataflows, Notebooks and Eventstreams. Uses SQL, T-SQL, Spark SQL, PySpark and Python for ingestion, transformation, modelling and Delta table validation, plus Power BI semantic models and third-party API integration. Hybrid role with an initial office-based induction period.

Microsoft Fabric · OneLake · Lakehouses +7

• London
• Hybrid
• £80,000 – £85,000 pa

Designs and builds cloud data solutions on Snowflake for a global consultancy's Data and AI function, supporting analytics, ML and emerging AI capabilities. Works on client transformation programmes modernising data platforms, with a focus on security, governance and performance optimisation across AWS, Azure or GCP.

Snowflake · AWS · Azure +3

• Leeds
• Hybrid · 3 days in office
• £85,000 – £95,000 pa
• Mid-level

Hands-on role building the next generation of a financial data platform on Microsoft Fabric, designing pipelines, lakehouses and warehouses and integrating financial systems with enterprise platforms and APIs. You will build data models and reporting layers for Finance, applying testing, source control and deployment practices, and work closely with senior business stakeholders in a collaborative in-house team.

Microsoft Fabric · Data Factory · OneLake +5

• Manchester
• Hybrid · 3 days in office
• £85,000 – £95,000 pa
• Mid-level

Hands-on role building the next generation of a financial data platform on Microsoft Fabric, designing pipelines, lakehouses and warehouses and integrating financial systems with enterprise platforms and APIs. You will build data models and reporting layers for Finance, working closely with senior business stakeholders, and apply testing, source control and deployment practices. The team is a growing in-house data engineering function in a major professional services firm.

Microsoft Fabric · Data Factory · OneLake +4

• Derby
• Hybrid · 2 days in office
• £40,000 pa
• Permanent

Builds and establishes modern data engineering solutions on Microsoft Fabric, working hands-on with OneLake, Lakehouses, Warehouses, Data Pipelines, Dataflows, Notebooks and Eventstreams. Uses SQL, T-SQL, Spark SQL, PySpark and Python for ingestion, transformation, modelling and converting source data into validated Delta tables, plus Power BI for semantic models. Integrates third-party APIs and migrates legacy data platforms, joining an established team with hybrid working.

Microsoft Fabric · OneLake · Lakehouses +7