Jobs in London

Lead Data Engineer (Databricks)

Lead and mentor a team of data engineers while designing and optimizing a Databricks-based lakehouse platform on the cloud. Own the architecture and engineering standards for large-scale data processing, supporting AI and machine learning initiatives through robust ETL/ELT pipelines and scalable data models. Work closely with data scientists and product teams to enable advanced analytics in a hybrid environment.

Tenth Revolution Group London, United Kingdom £85,000 – £110,000 pa

Data Engineer

The Data Engineer role involves designing and building scalable data infrastructure, automating workflows, and optimizing data pipelines using modern cloud technologies. You will work closely with business stakeholders to gather requirements and implement solutions that enhance operational efficiency and data-driven decision-making.

Oscar Technology London, United Kingdom £55,000 – £70,000 pa

Hybrid Permanent

Senior Data Engineer

This role involves designing and optimising scalable cloud data platforms, with a focus on Azure technologies and modern data architecture patterns. The engineer will lead best practices in data engineering, mentor team members, and work extensively with IoT and high-volume telemetry data. Emphasis is placed on governance, automation, and improving data pipeline efficiency in a cloud-native environment.

CAP Resourcing LTD London, United Kingdom

Senior Forward Deployed Engineering - Architect

Lead the design and implementation of production-grade data and AI solutions for strategic customers using the Databricks platform. Embed with client teams to understand technical challenges, build end-to-end systems, and deliver scalable architectures combining data engineering, ML/AI integration, and application development. Contribute reusable frameworks and influence product direction through customer-driven insights.

Databricks London, United Kingdom

Hybrid Permanent

Databricks Data Engineer

Design and build scalable data pipelines and analytics solutions using Azure Databricks and Azure Data Factory within an HR technology environment. Work with complex, multi-format datasets to deliver production-ready, secure, and observable data products integrated across the employee lifecycle. Collaborate with engineering, product, and HR teams in an Agile environment with strong DevOps and CI/CD practices.

Coltech Recruitment London, United Kingdom £400 – £600 pa

MLOps Platform Developer / Full-Stack AI Engineer

This role involves end-to-end ownership of a full-stack MLOps platform, combining React/TypeScript web development with large-scale PostgreSQL telemetry systems, MQTT data ingestion from building management systems, and operational LLM model pipelines. You'll manage fine-tuning and serving of domain-specific LLMs using GPU infrastructure and vLLM, while maintaining serverless deployments and data integrity across real-world engineering environments. The position uniquely blends AI operations, full-stack development, and hands-on integration with industrial control systems in the context of UK energy decarbonisation.

Anonymous London, United Kingdom

Senior Data Engineer (Snowflake)

This role involves designing and building scalable data solutions in Snowflake for a high-priority, regulatory-driven portfolio suitability programme within a wealth management firm. The engineer will develop data pipelines using dbt, implement dimensional data models, and ensure data quality and governance across complex financial datasets. Collaboration with investment, risk, and business stakeholders is central, with exposure to AI-assisted development and modern data engineering practices.

Experis London, United Kingdom £70,000 – £90,000 pa

Data Engineer - Sales Data - Azure Databricks

The role involves working with sales and product data to measure year-on-year subscription growth, focusing on accurate categorisation of retired and active products. The engineer will ensure data integrity across historical and current sales datasets within an Azure Databricks environment. Key tasks include data mapping, pipeline development, and alignment with business-defined metrics for uplift, upsell, cross-sell, and cancellations.

Square One Resources London, United Kingdom £500 – £560 pd

Senior AI Engineer - Perm UK

Design and build scalable AI data pipelines, cloud-native services, and production ML systems using Python, FastAPI, and cloud platforms. Collaborate with data scientists to deploy NLP and generative AI models, with a focus on observability, CI/CD, and distributed architectures. Mentor engineers and shape AI engineering standards in a remote-first, innovation-driven environment.

Infused Solutions London, United Kingdom £65,000 – £80,000 pa

Data Architect

This role involves designing and delivering enterprise-scale cloud data platforms for the insurance and financial services sectors. The Data Architect will lead data modernization, cloud migration, and Lakehouse architecture initiatives using AWS and Databricks, while ensuring compliance with regulatory standards. The position requires deep expertise in data governance, security, and insurance-specific data models.

Randstad Technologies Recruitment London, United Kingdom £80,000 – £85,000 pa

Hybrid Permanent

Infrastructure Engineer (Azure Platform Migration)

Role: Infrastructure Engineer (Azure Platform Migration)Location: London, UKDuration: 6-Month Contract(Inside IR35)Job OverviewWe are looking for an experienced Infrastructure Engineer with 6 to 10 years of professional expertise, focusing on Microsoft Azure Infrastructure, Cloud Migration, and DevOps frameworks.Core Requirements (Must Have)Extensive...

Randstad Technologies Recruitment London, United Kingdom £400 – £450 pd

Data Engineer

This role involves designing and building cloud-based data platforms using modern technologies like Python, PySpark, Databricks, and Snowflake. You will work on complex data pipelines, ensure data quality, and collaborate closely with underwriting, actuarial, and regulatory teams. The position offers a high-impact, engineering-led environment with opportunities for technical leadership and mentorship.

Tenth Revolution Group London, United Kingdom £60,000 – £90,000 pa

Hybrid Permanent

Lead Data Engineer

This role involves designing and building scalable data pipelines and distributed systems to support AI-driven operations. The engineer will implement real-time and batch processing, optimize vector search for AI features, and ensure data quality and governance. Close collaboration with backend and AI teams is required to support product development and model deployment.

Matchtech London, United Kingdom £80,000 – £110,000 pa

On-site Permanent

Principal Data Engineer / Principal Software Engineer

Principal Data Engineer / Principal Software Engineer – Data PlatformsLocation: London (Hybrid 3 days onsite)Contract - Inside IR35 - Intitally 6 Months - Investment / Finance / Wealth / Banking related projectsAre you a Lead / Senior data-focused engineer who...

Cooper Lomaz Recruitment London, United Kingdom

Lead Data Engineer - Start-Up / Scale-up experience required

Lead the design and development of scalable data pipelines and distributed systems that power an AI-driven operations platform. Build vector search infrastructure, define data architecture, and collaborate with AI and backend teams in a high-growth startup environment. Focus on real-time data workflows, data quality, and modern AI integration.

Matchtech London, United Kingdom £100,000 – £160,000 pa