Data Engineering Jobs in London

• London
• Entry level

New-grad engineers join a cohort to build infrastructure and products across backend, full stack, infrastructure, databases, systems, cloud and customer-facing teams. You own the full development lifecycle from design and testing to running services in production, with a dedicated mentor supporting your onboarding.

Databricks · Unity Catalog · Lakehouse +4

• London
• Hybrid · 3 days in office
• £600 – £650 pd
• Senior
• Contract

Designs, builds and supports end-to-end ETL integrations from source systems into Oracle ERP, primarily General Ledger, using IBM DataStage and Azure Data Factory. Leads technical architecture for an on-prem to cloud migration and cloud consolidation, building large-scale batch and real-time pipelines with Databricks, ADLS and Azure SQL. Works in an Agile team alongside architects, analysts and business stakeholders.

Azure Data Factory · IBM DataStage · Azure Databricks +7

• London
• Hybrid · 2–3 days in office
• Senior
• Contract

Hands-on engineering role building scalable data pipelines and entity resolution capabilities on the Quantexa platform for a major financial crime and AML transformation programme. Day to day involves Scala, Spark, Python and SQL work across Azure, Databricks and Elasticsearch, developing reusable frameworks and supporting testing, deployment and automation alongside global technology, product and business stakeholders.

Quantexa · Azure · Databricks +4

• London

Embed with strategic enterprise customers to design, build and productionise custom fullstack data and AI applications on the Databricks Data Intelligence Platform. Own architecture and end-to-end delivery spanning data engineering, ML/AI integration and user-facing interfaces, partnering with Sales, Product and Field Engineering. Requires up to 50% travel to client sites.

Databricks · OpenAI · Anthropic +7

• London
• £75,000 – £90,000 pa
• Mid-level
• Permanent

Builds and operates an Azure Databricks platform supporting analytics, customer insight and AI, owning infrastructure, tooling and integrations. Manages Azure resources via Terraform, configures Databricks workspaces, Unity Catalog and networking, and maintains CI/CD with GitHub Actions. Also handles monitoring, incident response, security and cost efficiency while supporting data engineers and AI teams.

Azure Databricks · Terraform · GitHub Actions +7

• London
• Remote
• £75,000 – £85,000 pa
• Senior

Own the design and build of scalable data pipelines and data products in Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT processes drawing on CRM, financial and subscription data. Shape enterprise data architecture, embed governance and quality controls, and mentor a junior engineer in a small, high-impact team near the start of its DataOps journey.

Databricks · PySpark · Spark SQL +4

• London
• Hybrid · 3 days in office
• £600 – £675 pd
• Senior
• Contract

Lead the design of end-to-end Microsoft Fabric solutions spanning Lakehouse, Warehouse, Real-Time Intelligence, Semantic Models and Governance, while defining enterprise data architectures for analytics and AI. Combine hands-on architecture, data modelling and delivery leadership with client engagement, creating reusable patterns and accelerators across a Data & AI practice.

Microsoft Fabric · OneLake · Lakehouse +7

• London
• Hybrid
• £85,000 – £105,000 pa
• Senior

Design and implement scalable data pipelines and models while migrating legacy SQL Server environments to Snowflake. Work closely with senior stakeholders and technical leadership on architectural decisions, data quality and CI/CD practices, with scope to contribute to AI and automation initiatives and mentor colleagues.

Snowflake · dbt · SQL Server +2

• London
• Hybrid
• £80,000 – £90,000 pa
• Lead · manages people
• Permanent

A hands-on lead role in a founder-led consultancy's data infrastructure practice, spanning pipelines, lakehouse, modelling, BI and integrations. You set technical direction, stay a primary engineer on client missions, and line manage engineers with the aim of growing them into leads. Hybrid working with direct founder and client stakeholder access.

Fivetran · Databricks · dbt +3

• London
• Hybrid
• £70,000 – £80,000 pa
• Mid-level
• Permanent

Hands-on engineering role building, maintaining and optimising data pipelines using KDB+/q and Python, working with large financial datasets and high-performance data solutions in a banking environment. Sits within a capital markets context, with banking or financial services experience considered an advantage.

KDB+ · Python

• London
• On-site
• £500 – £1,000 pd
• Contract

Owns a government programme's data platform end to end, building batch and streaming ETL/ELT pipelines, data models, quality monitoring and governance in an SC-cleared environment. On top of core data engineering, builds production RAG pipelines covering chunking, embeddings, hybrid search, reranking and query-time access control, with evaluation of retrieval quality.

Airflow · Dagster · Spark +7

• London
• Hybrid
• £85,000 – £115,000 pa
• Mid-level
• Permanent

Develops and maintains high-performance, data-driven applications using KDB+/q and Python, building and optimising data pipelines and time-series solutions. Works on query performance, data processing and system efficiency, troubleshooting issues and collaborating with technical teams. Financial services or capital markets background is preferred.

KDB+ · Python · SQL +2

• London
• Hybrid
• £700 – £900 pd
• Senior
• Permanent

Hands-on data engineering role focused on building and optimising pipelines that consolidate client and market data from multiple sources, with ownership of data logic, transformations and validation. Involves data modelling, reconciliation, quality monitoring and Snowflake performance tuning, applying Medallion Architecture to a growing wealth management platform.

Snowflake · PostgreSQL · Python +2

• London
• On-site
• £900 – £1,000 pd
• Contract

Design, build and maintain regulatory reporting applications and data pipelines covering global trade and transaction reporting. Work with compliance, operations and business stakeholders to turn regulatory obligations into scalable technical solutions, investigating exceptions and reconciling data discrepancies. Uses Python, SQL and modern data engineering tooling, with AI-enabled workflows for automation and control.

Relational Databases

• London
• Hybrid
• £60,000 – £80,000 pa
• Mid-level
• Permanent

Hands-on role building and maintaining a scalable data platform for a wealth management business, developing pipelines in Python and SQL and transforming data from multiple sources. You'll work with PostgreSQL and Snowflake, build data models, and implement quality checks, validation and reconciliation processes, applying Medallion Architecture principles.

PostgreSQL · Snowflake · APIs