Data Engineering Jobs

• London
• Hybrid
• Mid-level

Works deep inside the data processing infrastructure behind Palantir Foundry, designing query planning and optimization, extending execution engines, and improving operators, parallelism and memory management. Builds on and extends Apache Spark, DataFusion, Comet, Velox and Iceberg, owning changes from design through production with a high bar for correctness and predictable performance.

Apache Spark · Apache DataFusion · Apache Iceberg +7

• London
• Mid-level

Customer-facing, billable engineering role embedding with clients to design, build and productionize end-to-end data and AI systems on the Databricks platform. You own architecture and design decisions across data engineering, ML/AI model integration and application development, working alongside engagement managers, architects and customer teams, with around 20% travel.

Databricks · Apache Spark · AWS +5

• London
• Hybrid
• Senior

Customer-facing engineering role building and productionising data and AI solutions on the Databricks platform, owning architecture and design decisions for end-to-end systems spanning data engineering, ML/AI and application development. Engineers embed with client teams, from technical ICs to executives, and contribute reusable frameworks back to the product. Travel to customer sites around 20% of the time.

Databricks · AWS · Azure +7

• London
• Hybrid · 2–3 days in office
• £98,500 pa
• Senior
• Contract

Technical architect role within a dedicated design team, building automated and agentic production pipelines that scale paid media creative across EMEA. Involves designing agentic workflows with Anthropic Claude and OpenAI APIs, architecting MCP servers, and building agents that read design systems and output production-ready static and video assets.

Anthropic Claude · OpenAI · Model Context Protocol +5

• United Kingdom
• Remote
• £107,077 – £128,493 pa
• Senior

Builds and operates multi-tenant SaaS observability databases (Mimir, Loki, Tempo, Pyroscope) across AWS, GCP and Azure, writing production code and automation to make them self-healing and scalable. Owns the SLO framework, leads incident response and customer bridge calls for high-SLA customers, and sets technical direction across squads while mentoring engineers.

Grafana · Mimir · Loki +7

• Oxford
• Hybrid
• £78,174 – £94,686 pa
• Senior
• Contract

Hands-on infrastructure and platform role building the secure cloud, ML model serving and training pipelines, and agentic development tooling behind a privacy-preserving AI research programme. Works in a small engineering team under a Technical Lead, contributing to CI/CD, shared standards and partner integrations, with scope to shape the stack as the programme scales.

AWS · Kubernetes · Helm +7

• Nottingham
• Hybrid · 2–3 days in office
• £60,000 – £65,000 pa
• Mid-level

Designs and delivers Power BI dashboards, semantic models and ETL/ELT pipelines across a Snowflake, SQL and Python environment, supporting operational and commercial decisions in vehicle rental and automotive services. Combines hands-on engineering with stakeholder engagement, data governance and exploration of automation and AI-enabled analysis.

Power BI · Snowflake · SQL +1

• London
• On-site
• £900 – £1,000 pd
• Contract

Design, build and maintain regulatory reporting applications and data pipelines covering global trade and transaction reporting. Work with compliance, operations and business stakeholders to turn regulatory obligations into scalable technical solutions, investigating exceptions and reconciling data discrepancies. Uses Python, SQL and modern data engineering tooling, with AI-enabled workflows for automation and control.

Relational Databases

• London
• Remote
• £432 – £484 pd
• Senior
• Contract

Design and deploy production-grade Generative AI workflows and backend security guardrails for a global financial institution's AI Centre of Excellence. The role blends Python/Java engineering, AWS/Azure cloud pipelines with Airflow, and roughly 20-25% frontend/UI work for guardrail tooling, plus production support and ML evaluation metrics.

AWS · Azure · Apache Airflow

• Haywards Heath
• On-site
• £40,000 – £60,000 pa
• Senior
• Contract

Own the end-to-end migration of legacy Microsoft Access databases to a modern stack, auditing schemas and VBA logic, designing the target database, and writing Node.js ETL pipelines. Also builds RESTful or GraphQL APIs in Express/NestJS with TypeScript and writes unit and integration tests to validate migrated data and business rules.

Microsoft Access · Node.js · Express +7

• Welwyn

Design, build and maintain AI agents, dashboards and data pipelines that automate reporting, document checks and business workflows. Work with Python, R/Shiny, SQL, LLM APIs and cloud tooling alongside data science, IT and compliance teams, validating tools for regulated pharmaceutical use cases.

R Shiny · Shiny for Python · pandas +6

• Butterrow
• £55,000 – £65,000 pa

Designs and builds real-time embedded software in C and C++ for sensors and microelectronics, alongside ML pipelines, CI/CD, and MLOps for live model monitoring. Develops generative AI and LLM systems including RAG and fine-tuning, plus Spark or dbt ETL pipelines and IoT data services. Joins a small team owning the full SDLC from clean-sheet design to tested, deployed code.

Spark · dbt · CI/CD +1

• Almondsbury
• Hybrid · 3 days in office
• £80,000 – £130,000 pa
• Mid-level
• Permanent

Owns the infrastructure behind internal AI deployments, building and maintaining data pipelines, APIs, webhooks and middleware that connect AI agents to CRMs, ERPs and SaaS systems. Takes prototypes to production-grade, handling hardening, scaling, monitoring and troubleshooting across AWS, GCP or Azure with Docker and Kubernetes.

Airflow · Prefect · Dagster +7

• London
• Remote
• £50,000 – £70,000 pa
• Senior

Design, build and operate resilient AWS cloud infrastructure for public-sector workflow and AI orchestration platforms, working across platform and delivery teams. The role spans Terraform and Kubernetes, CI/CD pipelines, Kafka event-driven systems, databases, Keycloak IdAM and observability stacks, with a strong DevSecOps and secure-by-design focus. Fully remote with paid travel to client sites, and SC/DV clearance eligibility required.

AWS · Azure · GCP +7

• Bristol
• On-site
• £50,000 – £55,000 pa
• Junior
• Permanent

Build and maintain Python backend systems for an independent energy trading firm, focused on financial data processing, risk management, reporting and trade reconciliation. You'll write and optimise SQL, build data pipelines and automation tools, and deploy containerised services to AWS ECS with monitoring and production support.

AWS · AWS ECS · Docker +2