Data Engineering Jobs

• London
• Senior

Customer-facing engineering role owning architecture and design decisions while building production-grade data, AI and application systems on the Databricks platform. Works embedded with client teams from technical ICs to executives, spanning data engineering, ML/AI integration, distributed Spark workloads and cloud ecosystems, with roughly 20% travel.

Databricks · AWS · Azure +7

• London
• Hybrid
• Senior

Customer-facing engineering role building and productionising data and AI solutions on the Databricks platform, owning architecture and design decisions for end-to-end systems spanning data engineering, ML/AI and application development. Engineers embed with client teams, from technical ICs to executives, and contribute reusable frameworks back to the product. Travel to customer sites around 20% of the time.

Databricks · AWS · Azure +7

• Sydney, Australia
• Hybrid
• Entry level
• Internship

Forward Deployed Software Engineers embed with government customers to understand open-ended problems and build data-driven solutions, spanning architecture discussions, large-scale data wrangling, custom web apps and executive briefings. Interns work in small teams with minimal supervision and own end-to-end delivery of high-stakes projects, using languages such as Python, Java, C++ or TypeScript.

Palantir

• Birmingham
• Remote
• Lead · manages people

Lead BI Developer role focused on designing and building data platforms as the business transitions to Microsoft Fabric. Core technologies include SQL, Microsoft Fabric, Python/PySpark and Data Factory, with exposure to AI tools such as Microsoft Copilot. Managerial and leadership experience is beneficial as the project and team are expected to grow.

Microsoft Fabric · Python · PySpark +2

• Edinburgh
• Senior · manages people

Designs, builds and optimises scalable data pipelines in Azure Databricks, Spark and Python to support actuarial modelling and assumption setting. Applies machine learning and advanced analytics, drives process reengineering and embeds controls for audit and risk assurance, while guiding and reviewing the work of junior team members.

Azure Databricks · Spark · PySpark +1

• Stirling
• Mid-level

Hands-on engineering role building and running multi-cloud AI and data platforms, delivering production services, APIs, automation and infrastructure as code. Applies AI and agentic capabilities to platform operations, provisioning, access management and remediation, while owning resilience, observability, governance and measurable outcomes alongside product, security and business teams.

Multi-Cloud

• Cardiff
• Hybrid
• £61,500 – £67,500 pa
• Senior
• Permanent

Lead the establishment of an enterprise data architecture capability and design a Microsoft Fabric-based common data platform. Define data models, architecture principles, standards, governance and lineage across a complex organisation, working with architects, analysts and senior stakeholders to support reporting, analytics and strategic decision-making.

Microsoft Fabric · Microsoft Purview · Power BI +6

• Newcastle upon Tyne
• Hybrid
• £60,000 – £85,000 pa
• Mid-level

Design, build and support cloud-native integration solutions on Microsoft Azure, connecting critical business systems, data platforms and applications. Day to day involves Azure Logic Apps Standard, Azure Functions, Service Bus, Terraform IaC and API development, plus 2nd/3rd line support, documentation and stakeholder-facing requirements work in an international organisation.

Microsoft Azure · Azure Logic Apps · Azure Functions +2

• London
• Hybrid
• £60,000 – £65,000 pa
• Mid-level

Designs and builds data solutions using Microsoft Fabric and Azure, developing and maintaining ETL/ELT pipelines across multiple sources. Works with Fabric Lakehouses, Notebooks, Pipelines and Workspaces alongside Azure Data Factory, Databricks, Azure SQL and Synapse, coding in SQL, Python and PowerShell. Also supports Power BI reporting and ensures data quality, security and governance, using Azure DevOps/GIT for source control and deployment.

Microsoft Fabric · Azure · Azure Data Factory +6

• Bristol
• Hybrid · 3 days in office
• £80,000 – £85,000 pa
• Lead · manages people

Lead a team of data engineers while staying hands-on with complex data challenges, providing technical direction and coaching. Drive the migration and modernisation of legacy platforms into a Databricks lakehouse environment, building pipelines, models and curated datasets, and championing engineering best practice within Agile delivery.

Databricks · Spark · Tableau

• Liverpool
• Hybrid · 2 days in office
• £48,000 pa

Manages and optimises on-premise and Azure MS SQL database systems supporting mission-critical logistics applications, covering performance tuning, security, backup and disaster recovery, and capacity planning. Works with T-SQL, Python, Spark, Databricks, Airflow and dbt, collaborating closely with development and IT teams. Hybrid role with two days a week at the Liverpool Docks office.

MS SQL Server · Azure · AWS +5

• Cardiff
• Hybrid
• £61,500 – £67,500 pa
• Senior
• Permanent

Lead the establishment of an enterprise data architecture capability and design a Microsoft Fabric-based common data platform. Define data models, principles, standards, governance and lineage across a complex organisation, providing architectural oversight and advising senior stakeholders as part of a major digital transformation programme.

Microsoft Fabric · Microsoft Purview · Power BI +6

• Newcastle upon Tyne
• On-site
• £45,000 – £80,000 pa
• Mid-level

Builds and optimises high-quality data pipelines processing large volumes from internal and external sources, and helps maintain a central data platform supporting investment decision-making. Works closely with business stakeholders on how data is accessed, tested and leveraged, using SQL, Python, AWS, Git and Airflow. Requires direct hedge fund sector experience.

SQL · Python · AWS +2

• London
• £500 – £600 pd
• Senior

Client-facing consulting role advising pharmaceutical stakeholders on Snowflake architecture and enterprise data governance. You will implement Snowflake Cortex AI and Write-Back, build Collibra cataloging, lineage and GxP-compliant policies, and integrate Collibra with GitHub to parse dbt and LookML lineage via custom APIs.

Snowflake · Snowflake Cortex AI · Snowflake Write-Back +7

• Manchester
• Hybrid
• £90,000 – £100,000 pa
• Director · manages people
• Permanent

Owns the data engineering strategy, architecture and roadmap for an established online business, leading a team of ten through a migration from on-prem SQL to Azure. Sets engineering standards across data modelling, pipelines, governance and automated deployments, and makes the calls on tooling, budget and suppliers while reporting into the C-suite. Microsoft Fabric adoption and practical AI use are open questions the role holder will shape.

Azure · Microsoft Fabric · Azure Data Factory +1