Data Engineering Jobs

• London
• Hybrid
• £60,000 – £90,000 pa
• Senior
• Permanent

Builds cloud-native data platforms using medallion architecture and engineers batch and near real-time pipelines with Python, PySpark, Databricks and Snowflake. Integrates data from PAS, claims, broker and market feeds for underwriting, pricing, claims and reinsurance, while mentoring juniors and supporting CI/CD. Distinct for its London Market insurance domain focus and senior stakeholder exposure.

Databricks · Snowflake · Azure +3

• Fleet
• Hybrid
• Lead · manages people

Hands-on leadership role setting the technical direction of an AWS-based data engineering function while remaining close to engineering work. Involves designing and reviewing architecture and code, building batch and real-time pipelines, and evolving the data platform using dbt, Python, Redshift, Airflow and Terraform, plus mentoring a team of data engineers.

AWS · dbt · Amazon Redshift +2

• London
• Hybrid · 1–2 days in office
• £60,000 – £70,000 pa
• Contract

Hands-on engineering role building a modern Azure data platform, designing and developing scalable automated pipelines with Data Factory, Databricks, Synapse and Logic Apps. Covers the full data lifecycle from ingestion to transformation and delivery, with work on performance, data quality and monitoring alongside data engineers, architects, product owners and BI teams in an agile setting.

Azure Data Factory · Databricks · Azure Synapse +7

• Manchester
• Hybrid · 1–2 days in office
• £50,000 – £60,000 pa
• Contract

Hands-on engineering role building a modern Azure data platform, designing and developing scalable automated pipelines with Data Factory, Databricks, Synapse and Logic Apps. Covers the full data lifecycle from ingestion to transformation and delivery, optimising flows for performance and reliability while supporting data quality and monitoring. Works in an agile team alongside data engineers, architects, product owners, test analysts and BI teams.

Azure Data Factory · Databricks · Azure Synapse +7

• London
• Hybrid · 2 days in office
• £70,000 – £85,000 pa
• Senior
• Permanent

Designs and maintains data transformations, builds trusted datasets and scalable data products for business intelligence. Works with SQL, cloud platforms like Databricks, Snowflake or BigQuery, dbt and Python, delivering to Power BI while partnering with analysts and stakeholders to define requirements and champion analytics engineering best practices.

Databricks · Snowflake · BigQuery +3

• Almondsbury
• Hybrid · 3 days in office
• £80,000 – £130,000 pa
• Mid-level
• Permanent

Owns the infrastructure behind internal AI deployments, building and maintaining data pipelines, APIs, webhooks and middleware that connect AI agents to CRMs, ERPs and SaaS systems. Takes prototypes to production-grade, handling hardening, scaling, monitoring and troubleshooting across AWS, GCP or Azure with Docker and Kubernetes.

Airflow · Prefect · Dagster +7

• United Kingdom
• £50,000 – £65,000 pa
• Senior

Hands-on role designing, building and scaling an AWS-native data platform, migrating data from a large on-premise estate into the cloud. Involves building ingestion frameworks using CDC, event-driven and batch patterns, ETL/ELT with Python and SQL, plus data modelling, governance and observability. Also provides technical leadership and mentoring while remaining hands-on.

AWS · S3 · Glue +3

• Darlington
• £75,000 – £80,000 pa
• Director · manages people

Lead the data function for a building society undergoing technology transformation, reporting to the CFO and working closely with IT. Initially focus on understanding the existing landscape, defining architecture and setting principles, then build a modern Azure data platform with ADF, Databricks, Synapse and Purview governance. Also develop the data team, champion data literacy and create foundations for future AI enablement.

Microsoft Azure · Azure Data Factory · Databricks +3

• London
• Hybrid · 2 days in office
• £85,000 – £90,000 pa
• Senior

Builds and scales customer-facing data products on an Azure Databricks lakehouse, turning raw and third-party data into enriched, product-ready datasets delivered via APIs and internal tools. Applies LLMs, RAG, embeddings and semantic search to add classification, tagging and insight features, while owning platform performance, cost and governance. Works closely with product and commercial teams and mentors junior engineers.

Azure Databricks · Azure · Unity Catalog +7

• London
• Remote
• £50,000 – £70,000 pa
• Senior

Design, build and operate resilient AWS cloud infrastructure for public-sector workflow and AI orchestration platforms, working across platform and delivery teams. The role spans Terraform and Kubernetes, CI/CD pipelines, Kafka event-driven systems, databases, Keycloak IdAM and observability stacks, with a strong DevSecOps and secure-by-design focus. Fully remote with paid travel to client sites, and SC/DV clearance eligibility required.

AWS · Azure · GCP +7

• New York, United States
• US$135,000 – US$145,000 pa
• Entry level

New-grad engineers embed directly with customers on the Warp Speed team, working from factory floor to board room to understand problems and build data-driven solutions. Day to day involves architecting custom applications, wrangling massive-scale data with AI, and owning projects end to end in small agile teams, with up to 25% travel to client sites.

Palantir

• London
• £90,000 – £105,000 pa
• Senior

Hands-on senior role designing, building and maintaining automated data pipelines while supporting an on-premise to cloud migration. You'll develop scalable Snowflake data models, optimise schemas, use Azure DevOps, Git and CI/CD, monitor production pipelines, and mentor colleagues in the Business Intelligence team. Involves architectural input, direct stakeholder engagement and contributing to AI and Automation initiatives.

Snowflake · Azure DevOps · Git +2

• Sydney, Australia
• Hybrid
• Entry level
• Internship

Forward Deployed Software Engineers embed with government customers to understand open-ended problems and build data-driven solutions, spanning architecture discussions, large-scale data wrangling, custom web apps and executive briefings. Interns work in small teams with minimal supervision and own end-to-end delivery of high-stakes projects, using languages such as Python, Java, C++ or TypeScript.

Palantir

• London
• Hybrid
• £500 – £650 pd
• Senior
• Contract · Flexible

Design, develop and optimise scalable data pipelines and cloud-based data warehousing solutions, improving platform performance, reliability and scalability. Work with Data and Analytics Engineers on ETL/ELT processes, data architecture and reusable data solutions, with GCP and BigQuery highly desirable alongside Python and SQL.

GCP · BigQuery

• Chester
• Hybrid · 3 days in office
• Senior
• Contract

Hands-on engineering role building and maintaining scalable data platforms for compliance assurance in a regulated enterprise. Owns the end-to-end data lifecycle, from ingesting source systems through streaming, processing and storage to automated reconciliation and data-quality controls. Developer-led, with Python, PySpark, Kafka and NiFi at its core.

Apache Kafka · Apache NiFi · Hadoop +7