Data Engineering Jobs in London

• London
• Senior

Expert-level technical leader owning the most complex enterprise customer engagements, driving consumption strategy and executive relationships as the definitive technical authority. Leads multi-workload platform architectures, real-time systems and AI/ML at scale, mentors junior architects, and orchestrates cross-functional teams. Requires deep Databricks, Python, SQL and Spark expertise with a declared technical specialisation.

Databricks · Snowflake · AWS +7

• London
• Entry level
• Internship

Join an engineering team to build features for a data and AI infrastructure platform, owning a project end-to-end from design through code and feedback. Work spans full stack, backend, infrastructure, systems, tools, cloud and databases, with a dedicated mentor and a 12-week summer cohort.

Databricks · Genie · Lakebase +4

• London
• US$104,435 – US$182,604 pa
• Director · manages people

Serves as primary business partner for the Market Intelligence division, owning the data platform lifecycle for large, complex sales compensation datasets. Leads database build-out, schema design, ETL workflows and governance, translating commercial contracts into structured data constructs while mentoring a team of analysts. Acts as first point of contact for sales leadership on data anomalies and SOX-compliant reporting.

SQL · Python · Pandas +3

• London
• Hybrid
• Lead

Sets technical direction for large-scale data platforms on secure government and defence programmes, designing end-to-end architectures from ingestion to analytics. Hands-on role guiding engineering teams through implementation across AWS, Azure, GCP, Databricks and Snowflake, with governance and secure deployment. Requires active DV clearance and hybrid working with client site visits.

AWS · Azure · GCP +2

• London
• Hybrid · 3 days in office
• £45,000 – £70,000 pa
• Senior
• Permanent

Design, build and maintain scalable data pipelines and cloud-based data platforms on AWS, working with data architects, scientists and analysts to turn complex data into reliable, accessible information. Combines hands-on engineering with technical leadership, shaping data solutions and guiding delivery across national security, government and public-sector environments.

AWS · S3 · AWS Glue +6

• London
• Hybrid · 3 days in office
• Senior

Defines and delivers a group-wide data architecture strategy underpinning BI and self-service analytics across multiple operating units. Sets technical vision, standards and frameworks for scalable, secure data solutions, acting as technical authority alongside BI engineers and senior stakeholders. Involves evaluating and adopting new technologies in a large multi-country transport business.

AWS · Databricks · Snowflake +4

• London
• Hybrid
• £40,000 – £85,000 pa
• Mid-level
• Permanent

Builds and maintains cloud data platforms that support analytics, AI and business-critical decision-making for financial services clients. Works within a growing consultancy delivering modern data solutions, in a hybrid UK-based setup. The description is truncated, so day-to-day tooling is not detailed.

• London
• Remote
• £120,000 – £135,000 pa
• Director · manages people

Lead a newly formed Data Hub engineering function, owning delivery, technical direction and team development while consolidating fragmented legacy systems into a single governed platform. Combines strategic leadership with hands-on oversight across Snowflake, DBT, SQL and Python, managing distributed teams and establishing Agile, DevOps and reliability best practices.

Snowflake · DBT · Databricks

• London
• Mid-level

Hands-on role owning tag management implementation and optimisation across web and app platforms, developing data layer specifications and tracking documentation. Integrates and models data from multiple sources to support customer journey analysis, experimentation and conversion optimisation, using JavaScript, HTML, CSS and exposure to React/React Native.

Tealium IQ · Google Tag Manager · Adobe Launch +2

• London
• £150,000 – £180,000 pa
• Director · manages people

Lead a unified enterprise data, technology, architecture and AI function, bringing together Data & Analytics, Engineering, IT, Salesforce and Architecture teams under a single vision. Own enterprise architecture standards, data governance and analytics capabilities while driving AI adoption and a 360-degree customer view. The role balances quick wins with long-term strategy, including build-versus-buy decisions and technology roadmaps.

Salesforce

• London
• Hybrid
• Mid-level

Works deep inside the data processing infrastructure behind Palantir Foundry, designing query planning and optimization, extending execution engines, and improving operators, parallelism and memory management. Builds on and extends Apache Spark, DataFusion, Comet, Velox and Iceberg, owning changes from design through production with a high bar for correctness and predictable performance.

Apache Spark · Apache DataFusion · Apache Iceberg +7

• London
• Mid-level

Supports geospatial data governance and quality assurance within a large-scale Common Data Environment on a major UK rail infrastructure programme. Manages GIS data exchanges with suppliers, investigates data quality issues, builds workflows and automations using ESRI ArcGIS and Safe FME, and delivers training on GIS standards. Sits in a Digital Engineering team working to BIM ISO 19650 standards.

ESRI ArcGIS Enterprise · ArcGIS Online · ArcGIS Portal +4

• London
• Hybrid
• £60,000 – £90,000 pa
• Senior
• Permanent

Builds cloud-native data platforms using medallion architecture and engineers batch and near real-time pipelines with Python, PySpark, Databricks and Snowflake. Integrates data from PAS, claims, broker and market feeds for underwriting, pricing, claims and reinsurance, while mentoring juniors and supporting CI/CD. Distinct for its London Market insurance domain focus and senior stakeholder exposure.

Databricks · Snowflake · Azure +3

• London
• Hybrid
• Contract

Builds and maintains dashboards in Amazon Quick and develops robust data pipelines, bridging backend processing and frontend visualization. Handles complex SQL data wrangling and works with AWS services including S3, Athena, Redshift and Glue, plus Python for automation. Partners with business stakeholders to translate requirements into KPIs and technical specifications.

Amazon QuickSight · AWS · Amazon S3 +3

• London
• Remote
• £80,000 – £110,000 pa
• Lead

Own the company's data platform as a senior individual contributor, designing scalable cloud-based data infrastructure and ETL/ELT pipelines on AWS. Build analytical datasets, APIs and trusted data products supporting machine learning and AI initiatives, while establishing governance, lineage and observability standards. Works closely with Product, Engineering and Data Science, with scope to build and lead a future data team.

AWS · Power BI · Tableau +2