Data Engineering Jobs

• London
• Hybrid
• £70,000 – £85,000 pa
• Senior

Builds and maintains scalable data pipelines in Databricks, developing batch and streaming workflows and designing Lakehouse architectures with medallion models. Works alongside data scientists, analysts and product teams in a cloud-first Azure environment, implementing data quality, governance and observability frameworks while driving engineering best practice through code reviews.

Databricks · Apache Spark · Delta Lake +10

• London
• Remote
• £80,000 – £110,000 pa
• Lead

Own the company's data platform as a senior individual contributor, designing scalable cloud-based data infrastructure and ETL/ELT pipelines on AWS. Build analytical datasets, APIs and trusted data products supporting machine learning and AI initiatives, while establishing governance, lineage and observability standards. Works closely with Product, Engineering and Data Science, with scope to build and lead a future data team.

AWS · Power BI · Tableau +2

• Sydney, Australia
• Hybrid
• Entry level
• Internship

Forward Deployed Software Engineers embed with government customers to understand open-ended problems and build data-driven solutions, spanning architecture discussions, large-scale data wrangling, custom web apps and executive briefings. Interns work in small teams with minimal supervision and own end-to-end delivery of high-stakes projects, using languages such as Python, Java, C++ or TypeScript.

Palantir

• Southampton
• Hybrid · 2–3 days in office
• £40,000 – £45,000 pa
• Mid-level
• Permanent

Owns the day-to-day reliability and development of an established Azure and Databricks cloud data platform for a professional sports organisation. Builds and maintains Python pipelines, SQL transformations and data models, improves data quality and governance, manages database performance, and develops AI-based monitoring tools, working closely with data scientists and performance teams.

Azure · Databricks · Azure DevOps

• Hillingdon East
• Hybrid · 3 days in office
• Mid-level
• Contract

Designs, builds and supports cloud-based data solutions on Microsoft Fabric, creating scalable ingestion pipelines, lakehouses and warehouses using Medallion Architecture. Develops ETL/ELT with Data Factory, Notebooks and Spark, plus SQL models and Power BI reporting, while handling governance, security and CI/CD. Sits in the Group Finance Technical Analysts team, working with multi-currency financial data and Elite 3E systems.

Microsoft Fabric · Azure Data Services · Power BI +7

• London
• US$104,435 – US$182,604 pa
• Director · manages people

Serves as primary business partner for the Market Intelligence division, owning the data platform lifecycle for large, complex sales compensation datasets. Leads database build-out, schema design, ETL workflows and governance, translating commercial contracts into structured data constructs while mentoring a team of analysts. Acts as first point of contact for sales leadership on data anomalies and SOX-compliant reporting.

SQL · Python · Pandas +3

• Chester
• Hybrid · 3 days in office
• Senior
• Contract

Hands-on engineering role building and maintaining scalable data platforms for compliance assurance in a regulated enterprise. Owns the end-to-end data lifecycle, from ingesting source systems through streaming, processing and storage to automated reconciliation and data-quality controls. Developer-led, with Python, PySpark, Kafka and NiFi at its core.

Apache Kafka · Apache NiFi · Hadoop +7

• Hounslow
• Hybrid · 1–2 days in office
• £625 – £650 pd
• Lead
• Contract · Flexible

Lead data and AI engineering work for a major airline, focused on AWS, Snowflake and CI/CD pipelines. The role is inside IR35 and requires one to two days per week on-site at Heathrow, with the remainder likely remote.

AWS · Snowflake · CI/CD

• United Kingdom
• Remote
• £94,000 – £118,000 pa
• Senior

Builds frontend experiences for Grafana Cloud's Database Observability squad, helping users explore database telemetry, spot slow queries and troubleshoot performance. Primarily TypeScript and React work with chances to contribute to Go backends and APIs, plus on-call, mentoring and open source involvement.

Grafana · Grafana Cloud · Prometheus +6

• London
• Hybrid
• £50,000 – £60,000 pa
• Mid-level
• Permanent

Builds and maintains scalable data pipelines using Azure Data Factory and Databricks, integrating data from finance, HR and operational systems. Develops a lakehouse architecture with Kimball and star-schema models, and supports the Power BI reporting layer including semantic models and DAX. Joins an early-stage data function, shaping standards and working closely with business stakeholders.

Azure Data Factory · Databricks · Power BI +1

• London
• On-site
• £100,000 – £120,000 pa
• Senior
• Permanent

Hands-on data engineering lead designing scalable, AI-ready data platforms and architectures across an investment firm's portfolio. Combines building end-to-end infrastructure in SQL and Python with advising C-suite teams on data strategy, prioritisation and commercial impact, working tech-agnostically across varied environments.

• Birmingham
• Remote
• Mid-level
• Permanent

Hands-on role taking technical ownership of data migration workstreams for law firms moving from legacy systems to cloud platforms, primarily Actionstep. Involves analysing legacy databases, building SQL scripts and ETL routines, profiling and cleansing data, running trial migrations, UAT and production cutovers, and reconciling financial records across concurrent client projects.

Actionstep · Python · PowerShell +7

• Bradford
• Hybrid · 2 days in office
• Senior

Design and build end-to-end ETL/ELT solutions on Microsoft Fabric, including Dataflow Gen2 pipelines, Fabric Notebooks and Lakehouse with Medallion architecture. Work with SQL, Python, Spark SQL and Delta Lake, integrating APIs, databases, CRM and ERP sources, plus CI/CD, monitoring and data quality. Collaborate with Data Architects and BI teams on a modern platform supporting analytics, AI and operational use cases.

Microsoft Fabric · Dataflow Gen2 · Fabric Notebooks +5

• United Kingdom
• Remote
• Senior
• Permanent

Builds and operates a cloud-native database platform on public cloud, working on an in-house Kubernetes operator and improving metrics pipelines and build systems. Partners closely with the core database team and other data plane teams on scalable, highly available distributed infrastructure, including production on-call and debugging.

ClickHouse · Kubernetes · AWS +6

• New York, United States
• Hybrid
• US$135,000 – US$200,000 pa
• Mid-level

Works deep inside the data processing infrastructure behind Palantir Foundry, designing query planning and optimization, extending execution engines, and improving operators, parallelism and memory management. Builds on and extends Apache Spark, DataFusion, Comet, Velox and Iceberg, owning changes from design through production with a high bar for correctness and performance.

Apache Spark · Apache DataFusion · Apache Iceberg +7