Data Engineering Jobs

Staff Software Engineer - Backend

This role involves building and improving scalable backend systems for Databricks' Lakehouse Platform, focusing on distributed systems, data storage, and reliability. You'll work across the full development lifecycle to deliver secure, high-performance services that handle massive data workloads on cloud infrastructure. The position emphasizes solving deep technical challenges in data access, workflow orchestration, and system reliability as part of a foundational engineering team in London.

Databricks London, United Kingdom

On-site Permanent

Senior Staff Software Engineer - Delta

Design and develop high-performance backend systems for Databricks workspaces, focusing on scalability, low latency, and reliability. Lead technical projects, mentor engineers, and contribute to the core write-path of Delta Lake. Work on large-scale distributed systems processing exabytes of data daily.

Databricks London, United Kingdom

Business Planning Manager

This role involves shaping business strategy and leading the annual planning cycle for Tesco Media, translating strategic goals into actionable plans and performance metrics. The manager will drive financial analysis, forecasting, and cross-team alignment while delivering insights to senior leadership. Emphasis is placed on improving planning processes and enabling data-driven decision-making across a high-impact media and retail environment.

dunnhumby London, United Kingdom

Hybrid Permanent

Lead Engineer - Workplace Technology & Automation

This role involves leading technical architecture and automation initiatives for workplace technology, focusing on the Microsoft ecosystem including M365, Copilot, Intune, and Entra ID. The engineer will drive AI adoption, design custom automation solutions, and improve integrations between platforms like ServiceNow and Microsoft 365. It’s a hands-on, consultative position emphasizing agile practices, infrastructure-as-code, and operational maturity in enterprise support environments.

dunnhumby London, United Kingdom

Hybrid Permanent

Senior Data Engineer

The role involves building and optimising production-grade data pipelines at scale using AWS and Snowflake. The engineer will focus on performance tuning, modular data modelling, and CI/CD practices within an engineering-led environment. Collaboration with cross-functional product and data teams is key, with regular onsite presence required in London.

Vallum Associates London, United Kingdom £430 – £500 pd

AI-Native Software Engineer

Build production software, APIs, and data pipelines that integrate with LLMs and agentic workflows. Work on AI-powered systems that analyze brand visibility across AI search and answer engines. Combine strong software engineering practices with cutting-edge AI patterns in a real-world commercial product.

Hyre Ai Paddington, London, W2 1HU, United Kingdom £60,000 – £70,000 pa

Principal AI Data Engineer

This role involves developing and deploying AI, GenAI, and agentic AI systems using Azure AI Foundry, Databricks Mosaic AI, and LangChain-based frameworks. The engineer will build production-ready generative AI applications, focusing on RAG pipelines, agent design, and scalable workflows on Databricks. Responsibilities include prompt engineering, evaluation framework development, and applying DevOps practices to ensure robust, high-performing AI solutions for commercial trading teams.

Tatton Recruitment South Bank, London, SE1 9PZ, United Kingdom £750 – £800 pd

Software Architect

This role involves designing scalable, cloud-first SaaS platforms handling high data throughput, with a focus on modernising architecture using Node.js, NestJS, and AWS. The architect will lead microservices and event-driven design, influence AI and data practices, and collaborate with distributed teams. Emphasis is on strong engineering principles and DevOps-aligned patterns in a technology-agnostic environment.

Spectrum IT Recruitment Portsmouth, Hampshire, United Kingdom £85,000 – £95,000 pa

Senior Data Engineer

Design and maintain scalable data pipelines and systems to support analytics and business decision-making, with a focus on data quality, governance, and integration across multiple sources. Collaborate with analytics teams and provide technical leadership to junior engineers. Work within a centralised data platform using modern cloud technologies in a hybrid environment.

Michael Page Manchester, United Kingdom £58,000 – £63,000 pa

Hybrid Permanent

SC Cleared Splunk SIEM Engineer

Design and enhance Splunk SIEM systems within a large-scale enterprise security environment, focusing on threat detection, data pipeline management, and automation. Work across Splunk Enterprise Security, Microsoft Sentinel, and Cribl for log routing and normalisation. Collaborate in a hybrid setup with strong documentation and cross-functional communication.

Hays Technology Knutsford, Cheshire, United Kingdom £500 – £638 pd

Data Architect

Design and implement a proof of value using the Microsoft stack in a secure defence environment, with a focus on Power BI dashboards, SharePoint and Jira configuration, and operational process improvement. Establish governance and an end-to-end operating model alongside an experienced delivery team. Role involves hands-on solution delivery within a transformation programme.

Ncounter Dorchester, Dorset, United Kingdom £700 – £800 pd

Hybrid Contract Clearance Required

IT Data & Platform Engineer

Design and maintain data pipelines, lakehouses, and data warehouses within Microsoft Fabric using PySpark, Python, T-SQL, and DAX. Employ Infrastructure as Code, Git, and Azure DevOps for scalable, secure data platforms while ensuring data quality and compliance. Collaborate with stakeholders to enhance analytics and business intelligence through innovative engineering solutions.

Frontpoint Partners Ltd Canary Wharf, London, E14 5AB, United Kingdom £70,000 – £80,000 pa

Lead Data Engineer

Lead Data EngineerAre you an experienced Lead Data Engineer looking to shape the future of a modern cloud data platform? This is an exciting opportunity to join a growing technology business where you'll provide technical leadership, define engineering best practices,...

Hatched Recruitment Group London, United Kingdom £80,000 – £95,000 pa

Data Engineer

Data EngineerDartford£35,000 - £40,100 + £25,000 Available in Overtime / Travel Time (£60,000 realistic first-year earnings) + Van + Fuel Card + Holiday + Pension Stability + Family Feel Company + Immediate StartStep into a role working with a family-feel...

Excellis Recruitment Ltd Dartford, Kent, United Kingdom £35,000 – £40,000 pa

Data Scientist

Purpose of the roleTo support the design, prototype and delivery of innovative, data-led products by combining market insight, advanced analytics and modern data platforms. Working in closely with Product Managers and Data Analysts, this role will convert data assets and...

Sagacity London, United Kingdom

Permanent