Data Engineering Jobs

identifi Global Resources · Harrow

Hands-on architect role at an Elastic partner, designing SOC and SIEM architectures on Elastic/ELK for UK Defence and NATO clients. You own the architecture with the client and stay close to delivery, supporting greenfield builds and recovering existing environments alongside a team of 30+ SMEs, mostly working remotely with occasional client-site visits.

Atom Learning · London · £76,000 – £90,000 pa

Owns data modelling and pipelines powering customer-facing features like predicted grades and adaptive learning, working with BigQuery, dbt, Airflow and CockroachDB. As the go-to data specialist in a small cross-functional team, sets modelling standards, improves data quality and observability, and mentors other engineers.

Experis · London · £700 pw

Six-month contract guiding technical design for a data migration discovery within a Legacy Tech Debt programme. Involves assessing data extraction feasibility, analysing 54 Oracle database instances, overseeing reverse engineering and assuring technical artefacts, while aligning design decisions with wider architecture standards.

Experis · London · £500 pd

Builds and supports ETL pipelines to move and transform data efficiently, developing reliable data flows so teams can access the right information at the right time. Works within a secure public-sector environment, following controls and best practices while ensuring data quality and consistency across downstream usage. IBM DataStage and Oracle experience are desirable.

Databricks · London

Lead a delivery team of 8+ engineers building and productionising data and AI solutions on the Databricks platform for enterprise customers. Balances people leadership and hiring with hands-on technical oversight of architectures spanning Spark, Python/Scala, AWS/Azure/GCP, CI/CD and MLOps, while driving professional services metrics such as bookings, revenue, margin and CSAT.

Adecco · London · £745 pd

Lead data delivery squads supporting a Corporate & Investment Banking data platform, overseeing how banking data is integrated, processed, mapped and consumed across enterprise platforms. The role is delivery-focused rather than hands-on engineering, running Scrum ceremonies, managing stakeholders and challenging technical teams on data logic and modelling.

Databricks · London

Customer-facing role building and productionizing data and AI solutions on the Databricks platform, owning architecture and design decisions for end-to-end systems spanning data engineering, ML/AI and application development. Embeds with client teams, leads technical delivery, and contributes reusable frameworks, with around 20% travel to customer sites.

Adecco · Bromley · £700 – £750 pd

Builds and supports enterprise data pipelines and OpenShift-based solutions for an investment banking client, using Scala, Apache Spark and containerisation. Works on batch and real-time processing, CI/CD and cloud-native deployment within a cross-functional Agile team on a 12-month contract.

GlobalData Plc · Birmingham

Build and maintain data ingestion pipelines feeding an AI-enabled pharma competitive intelligence platform, pulling from internal drug, clinical trial and company data plus external news and regulatory sources. Work with Python, SQL and PostgreSQL on AWS, handling data modelling, quality monitoring, performance tuning and schema changes within a small Birmingham-based team.

Humanoid · London

Build an internal data platform from the ground up, defining architecture for petabyte-scale robot telemetry pipelines, compute infrastructure and orchestration. Work spans backend services, data warehousing, BI dashboards and MLOps evaluation workflows, collaborating closely with machine learning teams on humanoid robot training data.

HAYS Specialist Recruitment · London · £70,000 – £90,000 pa

Designs and builds modern machine learning and AI services within a collaborative data team, developing and optimising data pipelines across a cloud analytics platform. Works with PySpark, Python, SQL, Databricks or Snowflake on AWS, supporting ML and GenAI infrastructure in agile squads.

HAYS Specialist Recruitment · Manchester · £85,000 – £95,000 pa

Designs, builds and maintains data solutions on Microsoft Fabric, including pipelines, lakehouses, warehouses and integrations for financial reporting. Partners with Finance and business stakeholders to turn complex requirements into secure, automated data platforms, while driving best practice in governance, testing and CI/CD.

VIQU IT · London · £500 – £650 pd

Build and maintain document ingestion and RAG retrieval pipelines for AI-enabled defence planning tools, extracting clean text from PDF, DOCX and HTML and designing chunking, embedding and vector search strategies. Own the Postgres layer, build labelled ground-truth datasets to measure retrieval quality, and harden prototypes into production services with Docker and CI/CD.

Genomics England · London

Company DescriptionGenomics England is a global leader in enabling genomic medicine and research, focused on creating a world where everyone benefits from genomic healthcare. Building on the 100,000 Genomes Project, we support the NHS’s world-first national whole genome sequencing service...

hireful · London · £75,000 – £85,000 pa

Own the design and build of scalable data pipelines and data products in Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT processes drawing on CRM, financial and subscription data. Shape enterprise data architecture, embed governance and quality controls, and mentor a junior engineer in a small, high-impact team near the start of its DataOps journey.