Data Engineering Jobs

22 jobs for “Big Data Engineer”

Results

Atom Learning logo

Atom Learning · 101–500 people · Series B

Senior Data Engineer

  • London
  • Remote
  • £76,000 – £90,000 pa
  • Senior
  • Permanent

Owns data modelling and pipelines powering customer-facing features like predicted grades and adaptive learning, working with BigQuery, dbt, Airflow and CockroachDB. As the go-to data specialist in a small cross-functional team, sets modelling standards, improves data quality and observability, and mentors other engineers.

BigQuery · dbt · Airflow +5

Featured 2 weeks ago
identifi Global Resources logo

identifi Global Resources · 11–50 people · Series A

Elastic SIEM & SOC Security Engineer/Architect

  • Harrow
  • Remote
  • Senior
  • Permanent

Hands-on architect role at an Elastic partner, designing SOC and SIEM architectures on Elastic/ELK for UK Defence and NATO clients. You own the architecture with the client and stay close to delivery, supporting greenfield builds and recovering existing environments alongside a team of 30+ SMEs, mostly working remotely with occasional client-site visits.

Elastic · ELK · Elasticsearch +4

Featured DV clearance 2 weeks ago

Appcast Enterprise

Senior data engineer

  • Sunbury-on-Thames
  • Hybrid
  • Senior

Design, build and operate scalable cloud data platforms, pipelines and data products supporting Finance, with strong software engineering practices such as CI/CD, automated testing and observability. The role involves data modelling, governance, and technical leadership, mentoring engineers and working with product, architecture and analytics teams. Azure is preferred, with Databricks, Fabric or Snowflake also relevant.

Azure · Databricks · Microsoft Fabric +5

6 days ago

Matchtech

Data Engineer I SC Cleared

  • Newcastle upon Tyne
  • Hybrid · 2–3 days in office
  • £390 – £500 pd
  • Mid-level
  • Contract

Designs, builds and maintains scalable cloud data pipelines and ETL processes across AWS, Kafka, Kubernetes, Java and Big Data platforms. Provides technical leadership, contributes to architectural decisions and mentors junior engineers while working with cross-functional stakeholders in an Agile delivery environment.

AWS · Kafka · Kubernetes +1

2 weeks ago

Datatech

Data Engineer DV Cleared

  • United Kingdom
  • Hybrid

Hands-on engineering of secure, enterprise-scale data platforms for defence and national security programmes, building production-grade pipelines across ingestion, processing and serving layers. You'll work with Python, SQL, Spark, Java or Scala on AWS, Azure or GCP, integrating structured and unstructured data at scale in live operational environments.

AWS · Azure · GCP +1

DV clearance Last month

Capgemini

Data Engineer

  • Birmingham
  • Hybrid
  • Senior

Builds and maintains scalable, secure data platforms, designing ETL/ELT pipelines into cloud data lakes, warehouses and lakehouses, and integrating AI/ML models. Works with Azure Databricks or AWS tooling alongside business analysts, data scientists and DevOps engineers, optimising pipelines for performance and governance.

Azure Databricks · Azure Data Lake Storage · Azure Data Factory +7

SC clearance 3 days ago
Databricks logo

Databricks · 1001–5000 people · Late stage

Forward Deployed Engineering - Senior Architect

  • London
  • Senior

Customer-facing engineering role owning architecture and design decisions while building production-grade data, AI and application systems on the Databricks platform. Works embedded with client teams from technical ICs to executives, spanning data engineering, ML/AI integration, distributed Spark workloads and cloud ecosystems, with roughly 20% travel.

Databricks · AWS · Azure +7

Last month

Get new Big Data Engineer roles by email. One email a week when new roles match, or daily if you prefer. Stop any time.

Databricks logo

Databricks · 1001–5000 people · Late stage

Forward Deployed Engineer - Emerging Enterprise & DNB

  • London
  • Mid-level

Customer-facing, billable engineering role embedding with clients to design, build and productionize end-to-end data and AI systems on the Databricks platform. You own architecture and design decisions across data engineering, ML/AI model integration and application development, working alongside engagement managers, architects and customer teams, with around 20% travel.

Databricks · Apache Spark · AWS +5

Last month

Capgemini

Azure Data Solution Architect

  • Birmingham
  • Hybrid
  • Senior

Designs and leads delivery of secure, governed Azure data platforms using Databricks, Apache Spark, and Azure Data Factory, building data warehouses, lakehouses, and AI/ML pipelines. Works within the Data Platforms team on public sector projects, collaborating with analysts, data scientists, and DevOps engineers and acting as a Databricks champion.

Azure · Databricks · Apache Spark +6

3 days ago

Socium Recruitment

Head of Data Engineering

  • Manchester
  • Hybrid
  • £90,000 – £100,000 pa
  • Director · manages people
  • Permanent

Owns the data engineering strategy, architecture and roadmap for an established online business, leading a team of ten through a migration from on-prem SQL to Azure. Sets engineering standards across data modelling, pipelines, governance and automated deployments, and makes the calls on tooling, budget and suppliers while reporting into the C-suite. Microsoft Fabric adoption and practical AI use are open questions the role holder will shape.

Azure · Microsoft Fabric · Azure Data Factory +1

3 weeks ago
Genomics England logo

Genomics England · 101–500 people · Public

Data Engineer (we have office locations in Cambridge, Leeds and London)

  • London
  • Hybrid
  • £75,500 pa
  • Senior

Designs, builds and optimises scalable data pipelines and processing systems for large volumes of clinical and genomic data, covering acquisition, transformation, lineage, metadata and de-identification. Works cloud-first in AWS using Python, Prefect, Tableau, Semarchy, Aspera and Globus, within the Generate Research Data service supporting the National Genomic Research Library.

AWS · Prefect · Tableau +7

2 weeks ago

BDO

Digital Data, Analytics and AI Manager (Engineering & Migration Specialism)

  • Birmingham
  • Mid-level · manages people

Manager-level role in BDO's Digital consulting team focused on leading data migration engagements from source discovery and profiling through mapping, transformation, testing, reconciliation and cutover. Involves designing lakehouse and modern data platform architectures using Databricks, Microsoft Fabric, Python, PySpark and SQL, while managing client stakeholders and multidisciplinary project teams.

Databricks · Microsoft Fabric · Delta Lake +2

2 days ago

BDO

Digital Data, Analytics and AI Manager (Engineering & Migration Specialism)

  • Manchester
  • Mid-level · manages people

Manager-level role in BDO's Digital consulting team focused on data migration alongside data engineering, governance or analytics. You'll lead migrations from source assessment and planning through transformation, testing and cutover, while helping clients build reliable data foundations and turn data into insights.

Databricks · Microsoft Fabric · Delta Lake +2

2 days ago

Matillion

Staff Forward Deployed Engineer

  • Manchester
  • Remote
  • £84,160 – £126,240 pa
  • Senior

Owns complex customer rollouts of an AI data automation platform end to end, running discovery, architecting multi-cloud deployments and writing production-grade code. Modifies the product's own codebase where features are missing, builds data pipelines across Snowflake, Databricks, Redshift or BigQuery, and mentors junior engineers while working agentic-first with AI tools.

Matillion · Maia · Snowflake +7

4 months ago

eFinancialCareers

Lead Funds Data Architect - Citi

  • Belfast
  • Hybrid · 3 days in office
  • Lead

Lead the design and implementation of data strategies and architectures for the Funds domain, covering fund accounting, ETFs, IBOR and ABOR. The role owns data modelling, governance, lineage and metadata management, and partners with engineering and business stakeholders on regulatory and client reporting. It combines deep funds-industry domain knowledge with hands-on architecture leadership.

ER/Studio · Erwin · SQL Server +7

3 days ago

eFinancialCareers

Distributed Systems Software Engineer- Leading Quantitative Trading Firms

  • London
  • £200,000 – £500,000 pa

Engineers design and build large-scale distributed systems for quantitative trading and research infrastructure, spanning compute scheduling, storage, real-time event-driven systems, messaging, fault tolerance and state replication. Teams are small with significant ownership, working on petabyte-scale data and HPC/CPU/GPU workloads where performance and reliability gains have immediate measurable impact.

C++ · Java · Python +4

Yesterday

Filters

Work policy

Job type

Seniority

Are you sure?