Data Engineering Jobs

• Birmingham
• Remote
• £90,000 – £110,000 pa
• Lead

Hands-on senior role designing and building scalable data platforms, ETL/ELT pipelines and Data-as-a-Service capabilities that power analytics, machine learning and AI products for enterprise clients. Involves setting standards for data quality, governance and observability, plus shaping data strategy and growing into a leadership position.

AWS

• Birmingham
• Remote
• £85,000 – £110,000 pa
• Lead

Lead the design of AWS-based data platforms that make enterprise data trusted, governed and observable for analytics, machine learning and agentic AI. Combines hands-on architecture with customer-facing technical leadership, shaping data and AI strategy and standards while guiding enterprise clients from AI experimentation into production.

AWS · Python · SQL

• London
• Hybrid · 1 day in office
• £150,000 – £180,000 pa
• Director · manages people

Executive role owning the data vision for a private equity-backed financial services firm, leading a large-scale transformation of its data and analytics function. Responsibilities span reshaping the operating model, building a modern cloud data platform with lake and warehousing capabilities, and driving data engineering, governance and self-service analytics. Also involves applying AI to engineering productivity and improving customer onboarding and personalisation.

Azure · Microsoft Data Ecosystem

• London
• Hybrid
• £100,000 – £120,000 pa
• Director · manages people

Own the design, build and delivery of a modern enterprise cloud data platform for a large UK financial services organisation, leading migration off legacy environments. Responsibilities span platform strategy and architecture, building and scaling a data engineering function, supplier management, and embedding governance, security and data quality standards in a regulated setting.

• London
• Hybrid · 2 days in office
• £100,000 – £130,000 pa
• Lead · manages people

Take technical ownership of a large-scale analytical data platform, leading architecture, performance and cost optimisation of multi-tenant ClickHouse/OLAP systems. Build automation, observability and capacity management, shape a secure Data-as-a-Service offering and the data foundations for agentic AI, while mentoring and line-managing a small team hands-on.

ClickHouse

• Hounslow
• Hybrid · 1–2 days in office
• £625 – £650 pd
• Lead
• Contract · Flexible

Lead data and AI engineering work for a major airline, focused on AWS, Snowflake and CI/CD pipelines. The role is inside IR35 and requires one to two days per week on-site at Heathrow, with the remainder likely remote.

AWS · Snowflake · CI/CD

• Chester
• Hybrid · 3 days in office
• Senior
• Contract

Hands-on engineering role building and maintaining scalable data platforms for compliance assurance in a regulated enterprise. Owns the end-to-end data lifecycle, from ingesting source systems through streaming, processing and storage to automated reconciliation and data-quality controls. Developer-led, with Python, PySpark, Kafka and NiFi at its core.

Apache Kafka · Apache NiFi · Hadoop +7

• London
• Hybrid
• Lead

Sets technical direction for large-scale data platforms on secure government and defence programmes, designing end-to-end architectures from ingestion to analytics. Hands-on role guiding engineering teams through implementation across AWS, Azure, GCP, Databricks and Snowflake, with governance and secure deployment. Requires active DV clearance and hybrid working with client site visits.

AWS · Azure · GCP +2

• Bradford
• Hybrid · 2 days in office
• Senior

Design and build end-to-end ETL/ELT solutions on Microsoft Fabric, including Dataflow Gen2 pipelines, Fabric Notebooks and Lakehouse with Medallion architecture. Work with SQL, Python, Spark SQL and Delta Lake, integrating APIs, databases, CRM and ERP sources, plus CI/CD, monitoring and data quality. Collaborate with Data Architects and BI teams on a modern platform supporting analytics, AI and operational use cases.

Microsoft Fabric · Dataflow Gen2 · Fabric Notebooks +5

• Belfast
• Hybrid · 3 days in office
• Lead

Hands-on lead role building and optimising large-scale Scala Spark reconciliation pipelines on Databricks, migrating legacy Cloudera Hadoop workloads to cloud-native AWS architectures using Delta Lake and Databricks Workflows. Involves refactoring over-engineered Spark jobs, translating architectural designs into reusable components, and collaborating daily with architects, platform and DevOps teams.

Databricks · AWS · Delta Lake +7

• London
• Hybrid · 2 days in office
• Lead · manages people

Lead a data engineering team, setting technical direction and mentoring developers while driving solution design and stakeholder decisions. Day-to-day involves monitoring delivery against plans, ensuring scalability and performance, and promoting software engineering best practices including AI-based development. Requires SQL, Python, microservices and test-driven development experience.

Git

• Newark
• Hybrid · 2 days in office
• £60,000 – £65,000 pa
• Senior

Lead the design and development of secure, scalable data pipelines across an AWS data lake and established data warehouse using Python and SQL. The role shapes engineering standards, automation and AI-assisted development while mentoring colleagues through code reviews and pair programming, as the in-house data engineering function grows.

AWS · Data Warehouse · Data Lake

• London
• On-site
• Senior
• Permanent

Build an internal data platform from the ground up, defining architecture for petabyte-scale robot telemetry pipelines, compute infrastructure and orchestration. Work spans backend services, data warehousing, BI dashboards and MLOps evaluation workflows, collaborating closely with machine learning teams on humanoid robot training data.

Kubernetes

• London
• Hybrid · 3 days in office
• £600 – £650 pd
• Senior
• Contract

Designs, builds and supports end-to-end ETL integrations from source systems into Oracle ERP, primarily General Ledger, using IBM DataStage and Azure Data Factory. Leads technical architecture for an on-prem to cloud migration and cloud consolidation, building large-scale batch and real-time pipelines with Databricks, ADLS and Azure SQL. Works in an Agile team alongside architects, analysts and business stakeholders.

Azure Data Factory · IBM DataStage · Azure Databricks +7

• Derby
• Hybrid · 1 day in office
• £60,000 – £75,000 pa
• Mid-level

Design and build data pipelines, ETL processes, APIs and microservices in Python, deploying machine learning models and statistical analysis into production. Manage AWS infrastructure (S3, Lambda, EC2, RDS, Glue) supporting data and application workloads, working with large complex datasets in an innovative technology team.

AWS · NumPy · Pandas +7