Data Engineering Jobs

• Sheffield
• Remote
• £65,000 – £75,000 pa
• Senior

Owns the curated data layer within a Databricks Lakehouse, designing dimensional and semantic models and building complex SQL and PySpark transformation pipelines. Defines KPI logic, conformed dimensions and data quality standards, leads modelling design reviews and mentors engineers while working with architects, BI developers and business stakeholders. Remote with ad-hoc client site travel.

Databricks · Lakehouse

• London
• On-site
• £900 – £1,000 pd
• Contract

Design, build and maintain regulatory reporting applications and data pipelines covering global trade and transaction reporting. Work with compliance, operations and business stakeholders to turn regulatory obligations into scalable technical solutions, investigating exceptions and reconciling data discrepancies. Uses Python, SQL and modern data engineering tooling, with AI-enabled workflows for automation and control.

Relational Databases

• London
• Hybrid · 3 days in office
• £50,000 – £60,000 pa

Builds and maintains scalable ETL/ELT pipelines and curated, business-ready datasets that power reporting, dashboards and self-service analytics. Works closely with BI Developers and stakeholders to optimise SQL, data models and pipeline performance, with a focus on cloud platforms such as AWS Redshift, Athena, S3 and Glue. Backend-focused rather than dashboard or reporting development.

AWS · Redshift · Athena +6

• Malvern
• Hybrid
• £550 – £600 pd
• Mid-level
• Contract

Designs, builds and maintains secure data pipelines and ETL/ELT processes for a major Ministry of Defence programme, working with SQL, Python, data modelling and integration across complex datasets. Ensures data quality, security and governance within a highly regulated defence environment, collaborating with analysts, architects and wider technical teams.

• Bristol
• Remote
• £80,000 – £90,000 pa
• Senior

Owns the design and build of scalable data pipelines and data products on Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT optimisation and enterprise data architecture. Partners with Finance, Product, Sales, Marketing and Engineering stakeholders, embeds data quality and governance, and mentors a junior engineer in a small, high-impact team.

Databricks · PySpark · Spark SQL +3

• Eastleigh
• £70,000 – £85,000 pa
• Senior

Builds and supports data products on a modern cloud data platform, developing pipelines, integrations and orchestration with Databricks or Snowflake on AWS, Python, Spark, Airflow and SQL. Works in agile squads with data scientists, architects and product teams, supporting ML and GenAI infrastructure and promoting strong engineering standards.

Databricks · Snowflake · AWS +7

• West Yorkshire
• Remote
• £80,000 – £90,000 pa
• Senior

Owns the design and build of scalable data pipelines and data products on Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT optimisation and enterprise data architecture. Partners with Finance, Product, Sales, Marketing and Engineering to enable trusted self-service data, embeds governance and quality, and mentors a junior engineer in a small, high-impact team.

Databricks · PySpark · Spark SQL +3

• North Richmond, Australia
• Hybrid · 3 days in office
• Mid-level
• Contract

Designs, builds and supports cloud data solutions on Microsoft Fabric, creating ingestion pipelines, lakehouses and warehouses using Medallion Architecture. Writes SQL, ETL/ELT processes with Data Factory, Notebooks and Spark, and Power BI semantic models, while handling governance, security and CI/CD. Sits within the Group Finance Technical Analysts team supporting financial data.

Microsoft Fabric · Azure Data Services · OneLake +7

• London
• Hybrid · 3 days in office
• Mid-level
• Contract

Designs, builds and supports cloud-based data solutions on Microsoft Fabric, creating ingestion pipelines, lakehouses, warehouses and reporting for Group Finance. Implements Medallion Architecture and ETL/ELT with Data Factory, Notebooks and Spark, plus SQL, Power BI and CI/CD practices. Works with analysts, architects and stakeholders in a 12-month contract role.

Microsoft Fabric · Azure Data Services · Power BI +7

• London
• Remote
• £75,000 – £105,000 pa
• Senior

Design, build and deploy production-grade LLM and Generative AI applications, including RAG solutions, scalable data pipelines and AI-powered services for enterprise clients. The role blends software and data engineering with modern AI platforms, plus deployment, monitoring and optimisation of live systems, in a fully remote team of engineers, architects and AI specialists.

Databricks · MLflow · LangChain +5

• London
• Hybrid · 2 days in office
• £70,000 – £78,000 pa
• Senior

Design, develop and maintain ETL/ELT pipelines and data models supporting reporting and analytics, while helping implement a new enterprise data platform using Medallion architecture. Work alongside Data and Technical Architects on major transformation programmes, including financial reporting improvements and a legacy core system replacement, with strong stakeholder engagement and ownership expected.

Microsoft Azure · Microsoft Fabric · Informatica +3

• Windsor
• £60,000 – £70,000 pa
• Senior

Hands-on data engineering role owning complex analytics initiatives, building scalable pipelines, models and reporting on Databricks with Python, PySpark and SQL. Combines technical leadership, mentoring and setting engineering standards with stakeholder-facing work translating business needs into data solutions, including Power BI reporting and data governance.

Databricks · Power BI

• London
• Hybrid · 3 days in office
• £45,000 – £70,000 pa
• Senior
• Permanent

Design, build and maintain scalable data pipelines and cloud-based data platforms on AWS, working with data architects, scientists and analysts to turn complex data into reliable, accessible information. Combines hands-on engineering with technical leadership, shaping data solutions and guiding delivery across national security, government and public-sector environments.

AWS · S3 · AWS Glue +6

• London
• Hybrid
• £55,000 – £65,000 pa
• Mid-level
• Permanent

Design, build and maintain ETL/data pipelines and secure cloud-based data platforms using Python and SQL, applying DataOps and DevOps practices. Work with architects, analysts and software engineers on high-impact projects supporting UK national security, covering data modelling, orchestration and governance.

AWS

• Berkshire
• Hybrid
• £55,000 – £67,000 pa
• Senior
• Permanent

Owns the end-to-end data journey for a financial services business, building Azure Databricks pipelines with PySpark, SQL, ADF and ADLS Gen2, and governed lakehouse solutions using Delta Lake, medallion architecture and Unity Catalog. Also owns Power BI semantic models, DAX measures and row-level security, translating marketing and contact-centre requirements into trusted metrics while mentoring colleagues and improving engineering standards.

Azure Databricks · Unity Catalog · Power BI +7