Data Engineering Jobs

• London
• Senior

Expert-level technical leader owning the most complex enterprise customer engagements, driving consumption strategy and executive relationships as the definitive technical authority. Leads multi-workload platform architectures, real-time systems and AI/ML at scale, mentors junior architects, and orchestrates cross-functional teams. Requires deep Databricks, Python, SQL and Spark expertise with a declared technical specialisation.

Databricks · Snowflake · AWS +7

• Manchester
• Hybrid
• £70,000 – £95,000 pa
• Lead · manages people

Hands-on lead role owning an existing SQL Server, SSIS and Power BI data estate and modernising it into a governed AWS lakehouse with batch and real-time processing. Combines architecture and technology selection with line management of a small Data Engineering team, plus building a Customer Data Platform and enabling BI, Data Science and Applied AI.

AWS · SQL Server · SSIS +7

• United Kingdom
• Hybrid
• £370 – £420 pd
• Mid-level
• Contract

Builds and maintains scalable data pipelines and ETL/ELT processes, developing SQL data models and reporting dashboards with Qlik, Kibana and Elasticsearch. Works in Agile teams on cloud-native AWS data services, integrating APIs and third-party sources while ensuring data quality and governance. Occasional travel to Newcastle for a secure, SC-eligible public sector programme.

Qlik Sense · QlikView · Kibana +6

• Nottingham
• Hybrid · 3 days in office
• £450 – £500 pd
• Mid-level
• Contract

Builds and optimises scalable ETL/ELT pipelines and Lakehouse architectures on Azure Databricks, working with Python, PySpark and Spark SQL across Bronze, Silver and Gold layers on ADLS Gen2. Handles ingestion via Auto Loader and CDC, orchestrates workflows with Lakeflow, and applies Unity Catalog governance and Azure DevOps CI/CD. Hybrid role with three days per week on site in Nottingham.

Azure Databricks · Apache Spark · Azure Data Lake Storage Gen2 +7

• Basildon
• On-site
• £75,000 – £80,000 pa
• Senior
• Permanent

Designs and builds end-to-end ETL/ELT pipelines and data models on Snowflake, covering staging, integration layers and data marts. Develops production-ready dbt models, maps source data to target structures and tunes query performance, materialization and clustering. Works on-site with analytics, engineering and platform teams across the EMEA Data Solutions domain.

Snowflake · dbt · Informatica +7

• London
• Hybrid
• £85,000 – £105,000 pa
• Senior

Design and implement scalable data pipelines and models while migrating legacy SQL Server environments to Snowflake. Work closely with senior stakeholders and technical leadership on architectural decisions, data quality and CI/CD practices, with scope to contribute to AI and automation initiatives and mentor colleagues.

Snowflake · dbt · SQL Server +2

• Malvern
• Hybrid
• £550 – £600 pd
• Contract

Builds and maintains Azure-based data pipelines and integration solutions for a long-term defence programme, transforming data from multiple enterprise systems. Supports operational reporting, KPIs and SLA metrics while improving data quality and governance, working with service architects and service management teams. Requires active DV clearance and MOD/defence context.

Azure · Azure Data Factory · Databricks +2

• United Kingdom
• Remote
• Permanent

Conduct applied research on open-source database systems like ClickHouse and PostgreSQL, focusing on query optimization, execution engines, distributed systems, indexing and benchmarking. Build research prototypes and production-grade implementations, analyze large-scale workloads, and publish at venues such as SIGMOD and VLDB while collaborating with engineering teams.

ClickHouse · PostgreSQL · MySQL +7

• Hertfordshire
• Director · manages people

Lead the Data & Analytics strategy for a major civil engineering and construction group, building a high-performing team and modern cloud data ecosystem. Own data governance, MDM, and Power BI environments while acting as senior technical authority across Microsoft Fabric, Databricks, SQL, DAX and ETL pipelines. Distinct for combining strategic leadership with hands-on delivery to support future AI ambitions.

Microsoft Fabric · Databricks · Power BI +1

• Newcastle upon Tyne
• On-site
• £45,000 – £80,000 pa
• Mid-level

Builds and optimises high-quality data pipelines processing large volumes from internal and external sources, and helps maintain a central data platform supporting investment decision-making. Works closely with business stakeholders on how data is accessed, tested and leveraged, using SQL, Python, AWS, Git and Airflow. Requires direct hedge fund sector experience.

SQL · Python · AWS +2

• London
• Hybrid · 3 days in office
• £500 – £600 pd
• Mid-level
• Contract

Designs, builds and maintains scalable data pipelines and ETL processes, working hands-on with Scala, Java or Python alongside Spark, Elastic, REST APIs and Tomcat. Builds reusable shared libraries and platform capabilities, with Azure Data Factory, Databricks and Elasticsearch exposure, collaborating with Technology, Product and Business stakeholders on data quality and reliability.

Spark · Apache Airflow · Azure +7

• London

Embed with strategic enterprise customers to design, build and productionise custom fullstack data and AI applications on the Databricks Data Intelligence Platform. Own architecture and end-to-end delivery spanning data engineering, ML/AI integration and user-facing interfaces, partnering with Sales, Product and Field Engineering. Requires up to 50% travel to client sites.

Databricks · OpenAI · Anthropic +7

• London
• Hybrid
• £80,000 – £115,000 pa
• Lead
• Permanent

As one of the first senior data hires, you'll own the company's data architecture, building scalable batch and real-time pipelines, ingestion and storage solutions, and vector search and ML data pipelines. You'll work with AI, backend and product teams on model training and inference, ensure reliability and governance, and mentor future data engineers.

Qdrant · Milvus · pgvector +7

• London
• Remote
• £75,000 – £85,000 pa
• Senior

Own the design and build of scalable data pipelines and data products in Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT processes drawing on CRM, financial and subscription data. Shape enterprise data architecture, embed governance and quality controls, and mentor a junior engineer in a small, high-impact team near the start of its DataOps journey.

Databricks · PySpark · Spark SQL +4

• Welwyn Garden City
• Hybrid · 2–3 days in office
• £500 – £600 pd
• Mid-level

Hands-on builder of AI solutions within a global pharma company's Business Digital, Data & AI Infrastructure team. You turn business needs into working tools: AI skills and agents, agentified R Shiny dashboards, process automations and scheduled data pipelines, working iteratively with non-technical users and producing validation evidence for regulated use cases.

pandas · Shiny · Snowflake +3