Data Engineering Jobs

• London
• Hybrid · 3 days in office
• £45,000 – £70,000 pa
• Senior
• Permanent

Design, build and maintain scalable data pipelines and cloud-based data platforms on AWS, working with data architects, scientists and analysts to turn complex data into reliable, accessible information. Combines hands-on engineering with technical leadership, shaping data solutions and guiding delivery across national security, government and public-sector environments.

AWS · S3 · AWS Glue +6

• London
• Hybrid
• £65,000 – £75,000 pa
• Senior
• Permanent

Designs, architects and scales enterprise-grade AI platforms, building data pipelines, cloud-native services and RESTful APIs that productionise ML, NLP and LLM models. Works alongside Data Scientists, Software Engineers and Product teams, mentoring engineers and shaping engineering standards. Remote-first with optional hybrid London working.

AWS · Azure · Docker +7

• United Kingdom
• Hybrid
• Lead

Owns the production improvement loop for a knowledge layer that AI agents use to work with enterprise data in Elasticsearch, covering extraction automations, retrieval tools and memory. Writes production TypeScript, designs telemetry and evaluation for agent traces, tool calls and retrieval, and sets the technical bar for safe iteration on agentic behaviour alongside data scientists, backend engineers, product and UX.

Elasticsearch · LangChain · LangGraph +5

• London
• Mid-level
• Permanent

Designs and builds ETL pipelines and data models at scale, working across the full data lifecycle from ingesting semi-structured streams to enabling self-service analytics. Collaborates with analysts, scientists and engineers on data quality, lineage and query performance, and mentors peers on architecture best practices. Sits within a supply chain planning data infrastructure team.

Generative AI

• London
• Hybrid
• £75,500 pa
• Senior

Designs, builds and optimises scalable data pipelines and processing systems for large volumes of clinical and genomic data, covering acquisition, transformation, lineage, metadata and de-identification. Works cloud-first in AWS using Python, Prefect, Tableau, Semarchy, Aspera and Globus, within the Generate Research Data service supporting the National Genomic Research Library.

AWS · Prefect · Tableau +7

• London
• Permanent

Builds and maintains scalable ETL/ELT pipelines and logical/physical data models for supplier mapping, performance and risk analysis, and a trusted supplier data repository. Partners with engineers, scientists and business teams to deliver self-service data products, with cross-timezone collaboration and evaluation of generative AI tooling for data workflows.

• Eastleigh
• £70,000 – £85,000 pa
• Senior

Builds and supports data products on a modern cloud data platform, developing pipelines, integrations and orchestration with Databricks or Snowflake on AWS, Python, Spark, Airflow and SQL. Works in agile squads with data scientists, architects and product teams, supporting ML and GenAI infrastructure and promoting strong engineering standards.

Databricks · Snowflake · AWS +7

• Newcastle upon Tyne
• On-site
• Permanent

Design and build data-intensive applications and production pipelines for complex Defence and national security projects, working from ingestion through to end-user consumption. The role involves taming sensitive, hard-to-access datasets and testing data products for reliability, using SQL, Python, Spark, Databricks, cloud platforms and orchestration tools like Airflow alongside analysts, scientists and engineers.

Spark · Databricks · AWS +3

• United Kingdom
• Remote
• Permanent

Conduct applied research on open-source database systems like ClickHouse and PostgreSQL, focusing on query optimization, execution engines, distributed systems, indexing and benchmarking. Build research prototypes and production-grade implementations, analyze large-scale workloads, and publish at venues such as SIGMOD and VLDB while collaborating with engineering teams.

ClickHouse · PostgreSQL · MySQL +7

• London
• Hybrid · 3 days in office
• £94,000 pa
• Lead · manages people
• Permanent

Senior strategic role shaping data linkage, data architecture and digital technology initiatives across the UK health data ecosystem. Involves identifying emerging technologies and investment opportunities, assessing existing programmes, building partnerships with research, government and funding bodies, and providing technical leadership across complex multidisciplinary programmes.

• London
• Hybrid
• £80,000 – £90,000 pa
• Senior

Designs and scales Azure Databricks data platforms, building pipelines with PySpark, Delta Lake and Airbyte while developing LLM and RAG-powered features in customer-facing products. Works closely with Product and Engineering stakeholders, optimising Azure environments for performance and cost, and mentoring colleagues in a growing data function.

Azure · Databricks · PySpark +4

• Telford
• Hybrid
• £500 pd
• Mid-level
• Contract

Build and maintain Talend ETL jobs, Oracle DDL and SQL, and GitLab pipeline enhancements within an existing Talend framework on Oracle RDS. Investigate defects, review colleagues' artefacts, run component and performance testing, and mentor junior engineers while reporting to a lead engineer.

Talend · Oracle RDS · GitLab +2

• London
• Remote
• £700 pw
• Senior
• Contract

Six-month contract guiding technical design for a data migration discovery within a Legacy Tech Debt programme. Involves assessing data extraction feasibility, analysing 54 Oracle database instances, overseeing reverse engineering and assuring technical artefacts, while aligning design decisions with wider architecture standards.

Oracle

• London
• Hybrid · 2–3 days in office
• £745 pd
• Lead · manages people
• Contract

Lead data delivery squads supporting a Corporate & Investment Banking data platform, overseeing how banking data is integrated, processed, mapped and consumed across enterprise platforms. The role is delivery-focused rather than hands-on engineering, running Scrum ceremonies, managing stakeholders and challenging technical teams on data logic and modelling.

Jira · Databricks · Data Lakes +1

• Birmingham
• Hybrid
• Mid-level

Build and maintain data ingestion pipelines feeding an AI-enabled pharma competitive intelligence platform, pulling from internal drug, clinical trial and company data plus external news and regulatory sources. Work with Python, SQL and PostgreSQL on AWS, handling data modelling, quality monitoring, performance tuning and schema changes within a small Birmingham-based team.

AWS · Python · PostgreSQL +5