Data Engineering Jobs in London

• London
• £80,000 – £115,000 pa
• Senior
• Permanent

Hands-on engineering role migrating a Futures algorithmic trading platform's market data integration from the legacy LSEG/Refinitiv RFA to the Real-Time SDK (RTSDK). Involves analysing existing RFA integrations, developing Java applications and shared frameworks, and working with Futures and Options market data across exchanges while maintaining backward compatibility and trading workflows.

LSEG · Refinitiv · RFA +2

• London
• Hybrid · 1 day in office
• £500 pd
• Senior
• Contract

Hands-on senior engineer maintaining and developing data pipelines within a Measurement Innovation Team, focused on automating campaign measurement. Work includes GCP and BigQuery pipelines, privacy-safe joins via BigQuery and Snowflake clean rooms, cloud migration and security, plus some AWS. Day-to-day use of AI coding agents such as Claude Code is expected, alongside direct collaboration with external partners' data teams and internal stakeholders.

GCP · BigQuery · Snowflake +2

• London
• £75,000 – £90,000 pa
• Mid-level
• Permanent

Builds and operates an Azure Databricks platform supporting analytics, customer insight and AI, owning infrastructure, tooling and integrations. Manages Azure resources via Terraform, configures Databricks workspaces, Unity Catalog and networking, and maintains CI/CD with GitHub Actions. Also handles monitoring, incident response, security and cost efficiency while supporting data engineers and AI teams.

Azure Databricks · Terraform · GitHub Actions +7

• London

Design, build and own a generalized reporting system that generates business-critical outputs from a backend data platform for a global prime brokerage and financing business. The role demands deep ownership of correctness, reliability and performance, with tight SLO workflows on scheduling systems and heavy Python, Pandas and SQL work across Snowflake and Postgres.

Datadog · Grafana · Prometheus +5

• London

Build a greenfield research and trading platform from scratch within a pod-like team at a prop trading firm, working on GPU-heavy distributed training and MapReduce-style systems. The role centres on Ray, Spark, Dask, Databricks/Anyscale and Kubernetes for ML clusters, with strong autonomy to shape direction early in a deep learning-first environment.

Ray · Spark · Dask +6

• London
• £500 – £600 pd
• Mid-level

Hands-on builder role reporting to the Digital, Data & AI Infrastructure Lead, turning operational business challenges into rapid prototypes, automated data flows and AI-enabled dashboards. Day to day involves building AI assistants, R Shiny apps with natural-language co-pilots, ETL jobs via REST APIs and SQL, and supervised human-in-the-loop automation, iterating directly with non-technical users.

R Shiny · Shiny for Python · pandas +7

• London
• Hybrid
• Entry level
• Permanent

Design, build and automate distributed data pipelines, schemas, warehouses and SQL/NoSQL systems, and own metrics, reports and dashboards that drive business decisions. Interns work with a manager and mentor alongside engineers, analysts and data scientists, troubleshooting data issues and contributing to mission-critical projects.

SQL · NoSQL · MapReduce