Data Engineering Jobs

• New York, United States
• Hybrid
• US$10,500 pm
• Entry level
• Internship

Works deep inside the data processing infrastructure behind Palantir Foundry, covering query plan optimization, operator execution, and efficient data reads and writes. Extends open-source engines and table formats such as Apache Spark, DataFusion, and Iceberg, shipping changes through design, code review, testing, and release. An internship for candidates graduating in 2028.

Apache Spark · Apache DataFusion · Apache Iceberg +7

• London
• Hybrid
• US$10,500 pm
• Entry level
• Internship

Works deep inside the data processing infrastructure behind Foundry, covering query plan optimisation, execution operators, and efficient data reads and writes. Extends open-source engines and table formats such as Apache Spark, DataFusion, and Iceberg, with work spanning design, code review, testing, and release. An internship aimed at students graduating in 2028.

Apache Spark · Apache DataFusion · Apache Iceberg +7

• London

Embed with strategic enterprise customers to design, build and productionise custom fullstack data and AI applications on the Databricks Data Intelligence Platform. Own architecture and end-to-end delivery spanning data engineering, ML/AI integration and user-facing interfaces, partnering with Sales, Product and Field Engineering. Requires up to 50% travel to client sites.

Databricks · OpenAI · Anthropic +7

• United Kingdom
• Remote
• Senior
• Permanent

Builds and operates a cloud-native database platform on public cloud, working on an in-house Kubernetes operator and improving metrics pipelines and build systems. Partners closely with the core database team and other data plane teams on scalable, highly available distributed infrastructure, including production on-call and debugging.

ClickHouse · Kubernetes · AWS +6

• London
• Mid-level

Customer-facing, billable engineering role embedding with clients to design, build and productionize end-to-end data and AI systems on the Databricks platform. You own architecture and design decisions across data engineering, ML/AI model integration and application development, working alongside engagement managers, architects and customer teams, with around 20% travel.

Databricks · Apache Spark · AWS +5

• Derby
• Hybrid · 1 day in office
• £60,000 – £75,000 pa
• Mid-level

Design and build data pipelines, ETL processes, APIs and microservices in Python, deploying machine learning models and statistical analysis into production. Manage AWS infrastructure (S3, Lambda, EC2, RDS, Glue) supporting data and application workloads, working with large complex datasets in an innovative technology team.

AWS · NumPy · Pandas +7

• United Kingdom
• Remote
• £107,077 – £128,493 pa
• Senior

Builds and operates multi-tenant SaaS observability databases (Mimir, Loki, Tempo, Pyroscope) across AWS, GCP and Azure, writing production code and automation to make them self-healing and scalable. Owns the SLO framework, leads incident response and customer bridge calls for high-SLA customers, and sets technical direction across squads while mentoring engineers.

Grafana · Mimir · Loki +7

• Oxford
• Hybrid
• £78,174 – £94,686 pa
• Senior
• Contract

Hands-on infrastructure and platform role building the secure cloud, ML model serving and training pipelines, and agentic development tooling behind a privacy-preserving AI research programme. Works in a small engineering team under a Technical Lead, contributing to CI/CD, shared standards and partner integrations, with scope to shape the stack as the programme scales.

AWS · Kubernetes · Helm +7

• London
• On-site
• Senior
• Permanent

Build an internal data platform from the ground up, defining architecture for petabyte-scale robot telemetry pipelines, compute infrastructure and orchestration. Work spans backend services, data warehousing, BI dashboards and MLOps evaluation workflows, collaborating closely with machine learning teams on humanoid robot training data.

Kubernetes

• Bristol
• On-site
• £50,000 – £55,000 pa
• Junior
• Permanent

Build and maintain Python backend systems for an independent energy trading firm, focused on financial data processing, risk management, reporting and trade reconciliation. You'll write and optimise SQL, build data pipelines and automation tools, and deploy containerised services to AWS ECS with monitoring and production support.

AWS · AWS ECS · Docker +2

• Uxbridge
• Hybrid · 1–2 days in office
• £600 – £625 pd
• Senior
• Contract · Flexible

Hands-on technical leadership across a major airline's Data & AI team, driving a 2026 data engineering workstream. You will design scalable AWS data pipelines, implement CI/CD and DevOps practices, and mentor data and software engineers. Snowflake and AI-assisted development are desirable, with 1-2 days per week on-site at Heathrow.

AWS · Snowflake · Git

• Bromley
• Hybrid · 3 days in office
• £700 – £750 pd
• Mid-level
• Contract

Builds and supports enterprise data pipelines and OpenShift-based solutions for an investment banking client, using Scala, Apache Spark and containerisation. Works on batch and real-time processing, CI/CD and cloud-native deployment within a cross-functional Agile team on a 12-month contract.

Scala · Apache Spark · OpenShift +1

• London
• On-site
• Mid-level
• Permanent

Embedded within a hedge fund's investment team, building Python research platforms, simulation and backtesting frameworks, data pipelines and tooling for systematic trading strategies. Works daily with quantitative researchers and portfolio managers to productionise signals and models, with a focus on testing, CI/CD and scalable system design.

• London
• Mid-level
• Permanent

Design and build real-time middleware and runtime software connecting industrial control hardware to AWS cloud services, including data-exchange layers, type systems, and pub/sub or request/reply communication patterns. The role involves industrial protocol integrations (OPC-UA, Modbus, EtherCAT), edge-to-cloud telemetry with delivery guarantees, and engineering for bounded latency and real-time correctness on constrained hardware.

AWS · IEC 61131-3 · EtherCAT +6

• London
• Remote
• £75,000 – £85,000 pa
• Senior

Own the design and build of scalable data pipelines and data products in Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT processes drawing on CRM, financial and subscription data. Shape enterprise data architecture, embed governance and quality controls, and mentor a junior engineer in a small, high-impact team near the start of its DataOps journey.

Databricks · PySpark · Spark SQL +4