Data Engineering Jobs

Intec Select · London · £650 – £750 pd

Lead the migration of log sources from Splunk ingestion to Cribl Stream/Edge, designing load-balanced, fault-tolerant pipelines for high ingest volumes. Onboard and tune security log sources for SOC and IR teams, build Splunk and Cribl configs, and monitor pipeline health while reporting on ingest reduction and cost savings.

Opus Recruitment Solutions · Nottingham · £450 – £500 pd

Builds and optimises scalable ETL/ELT pipelines and Lakehouse architectures on Azure Databricks, working with Python, PySpark and Spark SQL across Bronze, Silver and Gold layers on ADLS Gen2. Handles ingestion via Auto Loader and CDC, orchestrates workflows with Lakeflow, and applies Unity Catalog governance and Azure DevOps CI/CD. Hybrid role with three days per week on site in Nottingham.

Opus Recruitment Solutions · Liverpool · £400 – £500 pd

Hands-on role migrating an established reporting estate into a modern Microsoft Fabric environment, covering data ingestion pipelines, data modelling and semantic layer design. You will also build Power BI reports, optimise SQL and ETL processes, and coach analysts and report developers on new tools and best practices.

Michael Page · Leeds · £40,000 – £48,000 pa

Analyse large datasets to uncover trends and build predictive models and algorithms that support strategic decisions in a financial services setting. Work within a collaborative analytics team, presenting findings to non-technical stakeholders and helping maintain data pipelines and infrastructure.

Spectrum IT Recruitment · Southampton · £80,000 – £100,000 pa

Hands-on technical leadership role guiding a 10+ developer squad through solution design, system architecture and domain modelling, while still writing production code across the full stack. Work spans Node.js microservices, TypeScript, Vue.js, Redis, SQL Server, Snowflake and AWS with CI/CD and DevSecOps practices, including building proof-of-concepts and supporting live systems.

Artis Recruitment · Bristol · £80,000 – £85,000 pa

Lead a team of data engineers while staying hands-on with complex data challenges, providing technical direction and coaching. Drive the migration and modernisation of legacy platforms into a Databricks lakehouse environment, building pipelines, models and curated datasets, and championing engineering best practice within Agile delivery.

Amtis Professional · Birmingham · £40,000 – £45,000 pa

Builds and develops a central data platform supporting reporting, analytics and emerging AI use cases. Covers the full data lifecycle: ingesting from internal and external sources and APIs, ETL/ELT transformation, data modelling and database design, plus Power BI dashboards. Works in a Microsoft Fabric/Azure stack with SQL, Python and Git in a collaborative team.

Siamo Recruitment a division of Siamo Group · Cirencester · £35,000 – £36,000 pa

Lead the design, maintenance and optimisation of a college's database infrastructure, building and managing ETL processes, system integrations and data flows while monitoring performance, security and integrity. Work on site within a multi-skilled IT team of 450 staff, supported by the Head of IT and a third-party database consultant, ensuring GDPR and data governance compliance.

J&J Search · Bath · £80,000 – £100,000 pa

Owns the enterprise data strategy and roadmap for a UK wealth management group, defining architecture and leading the technical build of a data warehouse, lake and pipelines. Combines governance, data quality and lineage work with hands-on engineering in Microsoft Fabric and Azure, partnering with the IT Director and senior stakeholders across multiple group businesses.

Vaerdi Recruitment Limited · London · £750 pd

Hands-on lead architecture role shaping data architecture for a major financial services technology programme. Involves designing scalable, distributed data solutions, developing complex data models, and applying Domain-Driven Design, with heavy use of NoSQL technologies, particularly Cassandra. Provides architectural direction while remaining technically hands-on, working closely with technical teams.

Socium Recruitment · Manchester · £90,000 – £100,000 pa

Owns the data engineering strategy, architecture and roadmap for an established online business, leading a team of ten through a migration from on-prem SQL to Azure. Sets engineering standards across data modelling, pipelines, governance and automated deployments, and makes the calls on tooling, budget and suppliers while reporting into the C-suite. Microsoft Fabric adoption and practical AI use are open questions the role holder will shape.

Palantir Technologies · New York, United States · US$100,000 – US$145,000 pa

Builds and maintains data pipelines, reporting datasets and dashboards that support Recruiting and Hiring Operations, integrating systems such as Lever, Workday and Foundry. Works cross-functionally with recruiters, data, security and privacy partners, moving between pipeline work, integration debugging, documentation and stakeholder enablement.

ClickHouse · United Kingdom

Conduct applied research on open-source database systems like ClickHouse and PostgreSQL, focusing on query optimization, execution engines, distributed systems, indexing, and emerging agentic workloads. Design and evaluate new algorithms and prototypes, analyze production workloads, and work with engineers to ship improvements, with encouragement to publish at venues such as SIGMOD and VLDB.

WeDoTech · London · £100,000 – £140,000 pa

Hands-on Staff-level role leading a large-scale data engineering modernisation, migrating thousands of pipelines across AWS. You'll stay deeply technical in Python, PySpark and Spark, shape scalable frameworks and standards, and champion AI-assisted development across multiple engineering teams.

WeDoTech · London · £800 – £1,000 pd

A hands-on Staff-level role leading a major data estate modernisation for a UK financial services organisation, migrating large-scale pipelines and building new data products. You will shape architecture and engineering patterns while remaining deeply involved in Python, PySpark, Spark, AWS Glue and Airflow, and champion AI-assisted development across multiple teams.