Data Engineering Jobs

• Reading
• Hybrid
• £55,000 – £65,000 pa
• Mid-level

Designs and builds scalable cloud data solutions, supporting a migration from a legacy SQL environment to Azure Databricks. Works with Python, PySpark, Delta Lake and Unity Catalog to create pipelines, transformation frameworks and curated data layers, while optimising models for analytics and self-service BI. Involves governance, security and data architecture decisions within a growing data function.

Azure Databricks · Databricks · Python +5

• London
• Remote
• £80,000 – £110,000 pa
• Lead

Own the company's data platform as a senior individual contributor, designing scalable cloud-based data infrastructure and ETL/ELT pipelines on AWS. Build analytical datasets, APIs and trusted data products supporting machine learning and AI initiatives, while establishing governance, lineage and observability standards. Works closely with Product, Engineering and Data Science, with scope to build and lead a future data team.

AWS · Power BI · Tableau +2

• Birmingham
• Remote
• Lead · manages people

Lead BI Developer role focused on designing and building data platforms as the business transitions to Microsoft Fabric. Core technologies include SQL, Microsoft Fabric, Python/PySpark and Data Factory, with exposure to AI tools such as Microsoft Copilot. Managerial and leadership experience is beneficial as the project and team are expected to grow.

Microsoft Fabric · Python · PySpark +2

• Norwich
• £50,000 – £60,000 pa
• Mid-level

Develops, tunes and supports the databases behind insurance claims systems, writing stored procedures, functions and schema changes while resolving production data incidents. Works in a team of six developers on a major data migration and modernisation programme, using SQL Server or PostgreSQL, Git, Jira and CI/CD pipelines, with AI-assisted development tools.

SQL Server · PostgreSQL · Python +6

• Newcastle upon Tyne
• On-site
• Permanent

Design and build data-intensive applications and production pipelines for complex Defence and national security projects, working from ingestion through to end-user consumption. The role involves taming sensitive, hard-to-access datasets and testing data products for reliability, using SQL, Python, Spark, Databricks, cloud platforms and orchestration tools like Airflow alongside analysts, scientists and engineers.

Spark · Databricks · AWS +3

• Welwyn Garden City
• Hybrid
• £500 – £600 pd
• Mid-level
• Contract

Hands-on engineering role building AI-powered applications, automation workflows and internal business tools. You will develop and deploy R Shiny apps, build data pipelines, integrate systems via REST APIs and work with LLMs and Generative AI to create AI assistants and decision-support tools, collaborating directly with business stakeholders from concept to production.

Shiny · Snowflake · LangChain +3

• United Kingdom
• £45,000 – £70,000 pa

Design, build and deploy scalable solutions on the Palantir Foundry platform, including data pipelines, data models, integrations and Foundry Ontologies. Create governed data assets for operational, analytical and AI use cases and build user-facing applications using low-code and pro-code capabilities, working directly with client stakeholders in agile teams across Defence and Security programmes.

Palantir Foundry

• Newcastle upon Tyne
• Hybrid
• £60,000 – £85,000 pa
• Mid-level

Design, build and support cloud-native integration solutions on Microsoft Azure, connecting critical business systems, data platforms and applications. Day to day involves Azure Logic Apps Standard, Azure Functions, Service Bus, Terraform IaC and API development, plus 2nd/3rd line support, documentation and stakeholder-facing requirements work in an international organisation.

Microsoft Azure · Azure Logic Apps · Azure Functions +2

• Blandford Forum
• Hybrid · 2–3 days in office
• £65,000 – £75,000 pa
• Mid-level

Builds and maintains ETL frameworks and large-scale data pipelines, handling ingestion, transformation, cleansing and validation of datasets for mission-critical defence projects. Develops data models for analytics and reporting while managing data quality, governance and security, using Snowflake, Databricks, SQL and Python in a hybrid secure environment.

Snowflake · Databricks · AWS

• London
• Hybrid
• £60,000 – £65,000 pa
• Mid-level

Designs and builds data solutions using Microsoft Fabric and Azure, developing and maintaining ETL/ELT pipelines across multiple sources. Works with Fabric Lakehouses, Notebooks, Pipelines and Workspaces alongside Azure Data Factory, Databricks, Azure SQL and Synapse, coding in SQL, Python and PowerShell. Also supports Power BI reporting and ensures data quality, security and governance, using Azure DevOps/GIT for source control and deployment.

Microsoft Fabric · Azure · Azure Data Factory +6

• Milton Keynes
• Hybrid
• £40,000 – £45,000 pa
• Mid-level

Design, build and own enterprise BI solutions on Microsoft Fabric and Power BI, including semantic models, advanced DAX and paginated reports. Lead the migration of a legacy SSRS estate to Power BI within a six-person reporting team, while handling governance, security and Fabric capacity management.

Power BI · Microsoft Fabric · DAX Studio +7

• Birmingham
• Hybrid
• £60,000 – £80,000 pa
• Senior

Designs and maintains end-to-end data pipelines for large, complex datasets, transforming data into insights, analytical tools and dashboards. Works with software engineers, researchers and technical specialists on projects supporting national security infrastructure, with a focus on automation and process improvement in Linux-based environments.

• Welwyn

Design, build and maintain AI agents, dashboards and data pipelines that automate reporting, document checks and business workflows. Work with Python, R/Shiny, SQL, LLM APIs and cloud tooling alongside data science, IT and compliance teams, validating tools for regulated pharmaceutical use cases.

R Shiny · Shiny for Python · pandas +6

• Birkenhead
• £50,000 – £55,000 pa
• Mid-level
• Permanent

Operates the observability and data infrastructure behind an industrial energy-telemetry platform, covering the full data lifecycle from ingestion and storage to transformation, analysis and visualisation. Builds and maintains ETL/ELT pipelines over time-series and event data, creates dashboards and alerting tools, and integrates platforms with custom software and external APIs. Full training is provided and the employer values engineering judgment over specific prior tooling.

Git

• London
• Hybrid · 3 days in office
• £110,000 pa
• Lead · manages people

Lead technical direction across a modern cloud data platform built on AWS, Snowflake and dbt, staying hands-on while unblocking engineers on complex issues. Combines mentoring a team of engineers with influencing senior stakeholders and shaping engineering standards in a federated data model.

AWS · Snowflake · dbt