Data Engineering Jobs

Opus Recruitment Solutions · Liverpool · £400 – £500 pd

Hands-on role migrating an established reporting estate into a modern Microsoft Fabric environment, covering data ingestion pipelines, data modelling and semantic layer design. You will also build Power BI reports, optimise SQL and ETL processes, and coach analysts and report developers on new tools and best practices.

Socium Recruitment · Manchester · £90,000 – £100,000 pa

Owns the data engineering strategy, architecture and roadmap for an established online business, leading a team of ten through a migration from on-prem SQL to Azure. Sets engineering standards across data modelling, pipelines, governance and automated deployments, and makes the calls on tooling, budget and suppliers while reporting into the C-suite. Microsoft Fabric adoption and practical AI use are open questions the role holder will shape.

Palantir Technologies · New York, United States · US$145,000 – US$155,000 pa

Works deep inside the data processing infrastructure behind Palantir Foundry, covering query plan optimization, operator execution, and efficient data reads and writes. Extends open-source engines and table formats including Apache Spark, DataFusion, and Iceberg, taking changes through design, code review, testing, and release. Correctness, compatibility, and predictable performance are central to the work.

Palantir Technologies · New York, United States · US$100,000 – US$145,000 pa

Builds and maintains data pipelines, reporting datasets and dashboards that support Recruiting and Hiring Operations, integrating systems such as Lever, Workday and Foundry. Works cross-functionally with recruiters, data, security and privacy partners, moving between pipeline work, integration debugging, documentation and stakeholder enablement.

ClickHouse · United Kingdom

Conduct applied research on open-source database systems like ClickHouse and PostgreSQL, focusing on query optimization, execution engines, distributed systems, indexing, and emerging agentic workloads. Design and evaluate new algorithms and prototypes, analyze production workloads, and work with engineers to ship improvements, with encouragement to publish at venues such as SIGMOD and VLDB.

Harnham - Data and Analytics Recruitment · Nottingham · £60,000 – £65,000 pa

Builds and scales a Microsoft Fabric data platform as the central source of truth for reporting and analytics. Develops Bronze, Silver and Gold architectures, integrates data into Lakehouse environments, and creates pipelines with Python, SQL and PySpark. Works with a Lead Data Engineer and a team spanning engineering, governance and analytics.

Harnham - Data and Analytics Recruitment · Abingdon · US$200,000 – US$225,000 pa

Builds scalable data platforms, pipelines and ML infrastructure, and deploys production AI solutions including LLMs, RAG systems and AI agents. Works in a small, highly visible team partnering with investment and operational stakeholders, owning projects end-to-end from design through production and driving architecture decisions.

Head Resourcing · Falkirk · £60,000 – £70,000 pa

Leads data modelling, transformation and governance to turn data into trusted insights for operational and commercial decisions. Builds scalable data solutions using SQL, dbt, Power BI semantic models and a modern cloud platform such as Databricks, while managing stakeholder and vendor relationships to support a five-year data plan.

Rise Technical Recruitment · London · £35,000 – £50,000 pa

Hands-on role developing and maintaining software with Python, Go and TypeScript, processing and validating live and historical sports datasets, and supporting AWS cloud infrastructure and production systems. Works closely with experienced engineers on SQL databases, troubleshooting and technical projects within the sports and betting sector.

Real · Berkshire · £500 pd

Hands-on Data Engineer to design and build pipelines and data models on a greenfield Microsoft Fabric platform, supporting the end-to-end implementation of a new enterprise data environment. Involves shaping architecture, integration processes and best practice while working closely with business and technical stakeholders.

Matchtech · Surrey · £50,000 – £75,000 pa

Design, build and run scalable batch and streaming data pipelines and data models that turn complex sensor and geospatial sources into reliable datasets for analytics and machine learning. Work across Azure plus edge and on-prem deployments with data scientists, analysts and platform engineers in a Kanban team, supporting embeddings and LLM-enabled conversational analytics.

Additional Resources · Alloa

Day-to-day work centres on managing and analysing operational data from renewable energy assets, including SCADA telemetry, to monitor output, availability, downtime and faults. You will build Python-based models and automated pipelines, create dashboards and reports, and check contractor performance against contractual KPIs. The role also involves troubleshooting data infrastructure such as networks, VPNs and industrial routers.

Tenth Revolution Group · Reading · £60,000 pa

Hands-on role building and evolving scalable data pipelines on a Microsoft-based platform, using Databricks, SQL, Python and PySpark. Covers ETL, data integration, transformations, data warehousing and SQL performance, working with technology and business teams to turn requirements into reliable data solutions.

Tenth Revolution Group · Oxford · £50,000 – £60,000 pa

Hands-on role building and maintaining scalable data pipelines on Databricks, integrating new sources and optimising ETL and transformation processes. You will develop SQL and Python/PySpark transformations, tune queries, stored procedures and database objects, and help mature a modern Microsoft data platform within a Data & Innovation team, contributing to CI/CD and Git practices.

VIQU IT Recruitment · London · £100,000 – £110,000 pa

Lead large-scale data transformation programmes for an insurance organisation, owning the roadmap from planning through delivery and supporting adoption of an Enterprise Data Platform. Work across business, IT and data teams to define requirements, track value from data and AI initiatives, and manage risks, budgets and governance. Hybrid role with three days per week in a London office.