Data Engineering Jobs

• Norfolk, United States
• Hybrid
• US$135,000 – US$200,000 pa

Forward Deployed Software Engineers embed directly with government customers, working in small autonomous teams to scope open-ended problems and build data-driven solutions end to end. The day spans architecture discussions, large-scale data wrangling, custom web app development and executive-level strategy work, with travel to customer sites as needed.

• New York, United States
• US$135,000 – US$145,000 pa
• Entry level

New-grad engineers embed directly with customers on the Warp Speed team, working from factory floor to board room to understand problems and build data-driven solutions. Day to day involves architecting custom applications, wrangling massive-scale data with AI, and owning projects end to end in small agile teams, with up to 25% travel to client sites.

Palantir

• London
• Hybrid
• Senior

Customer-facing engineering role building and productionising data and AI solutions on the Databricks platform, owning architecture and design decisions for end-to-end systems spanning data engineering, ML/AI and application development. Engineers embed with client teams, from technical ICs to executives, and contribute reusable frameworks back to the product. Travel to customer sites around 20% of the time.

Databricks · AWS · Azure +7

• London
• Hybrid
• Senior

Customer-facing, hands-on role building and productionizing data and AI solutions on the Databricks platform. You own architecture and design decisions, implement end-to-end systems spanning data engineering, ML/AI and application development, and embed with client teams from technical ICs to executives. Billable delivery work with around 20% travel to customer sites.

Databricks · AWS · Azure +4

• Bristol
• Remote
• £80,000 – £90,000 pa
• Senior

Owns the design and build of scalable data pipelines and data products on Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT optimisation and enterprise data architecture. Partners with Finance, Product, Sales, Marketing and Engineering stakeholders, embeds data quality and governance, and mentors a junior engineer in a small, high-impact team.

Databricks · PySpark · Spark SQL +3

• West Yorkshire
• Remote
• £80,000 – £90,000 pa
• Senior

Owns the design and build of scalable data pipelines and data products on Databricks using PySpark, Spark SQL and Delta Lake, plus ETL/ELT optimisation and enterprise data architecture. Partners with Finance, Product, Sales, Marketing and Engineering to enable trusted self-service data, embeds governance and quality, and mentors a junior engineer in a small, high-impact team.

Databricks · PySpark · Spark SQL +3

• York
• Hybrid
• £350 – £450 pd
• Mid-level
• Contract

Builds and maintains data pipelines that collect, process and store data from Network Rail routes, applying validation, cleaning and governance so data is accurate and available. Works with the visualisation team to supply well-structured data, using FME, Microsoft Power Platform, SQL, Python and cloud services in an agile rail-sector team.

FME · Microsoft Power Platform · Azure +1

• London
• Hybrid · 2 days in office
• £35,000 – £50,000 pa
• Entry level
• Permanent

Hands-on role developing and maintaining software with Python, Go and TypeScript, processing and validating live and historical sports datasets, and supporting AWS cloud infrastructure and production systems. Works closely with experienced engineers on SQL databases, troubleshooting and technical projects within the sports and betting sector.

Python · Go · TypeScript +3

• London
• Permanent

Builds and maintains scalable ETL/ELT pipelines and logical/physical data models for supplier mapping, performance and risk analysis, and a trusted supplier data repository. Partners with engineers, scientists and business teams to deliver self-service data products, with cross-timezone collaboration and evaluation of generative AI tooling for data workflows.

• Butterrow
• £55,000 – £65,000 pa

Designs and builds real-time embedded software in C and C++ for sensors and microelectronics, alongside ML pipelines, CI/CD, and MLOps for live model monitoring. Develops generative AI and LLM systems including RAG and fine-tuning, plus Spark or dbt ETL pipelines and IoT data services. Joins a small team owning the full SDLC from clean-sheet design to tested, deployed code.

Spark · dbt · CI/CD +1

• Surrey
• Hybrid
• £50,000 – £75,000 pa
• Mid-level
• Permanent

Designs, builds and runs scalable batch and streaming data pipelines and data models, turning complex sensor and geospatial sources into reliable datasets for analytics and ML. Works across Azure plus edge and on-prem deployments with data scientists, analysts and platform engineers in a Kanban agile team, covering orchestration, testing, Docker and Kubernetes.

Azure · InfluxDB · Spark +6

• London
• Hybrid
• £55,000 – £65,000 pa
• Mid-level
• Permanent

Design, build and maintain ETL/data pipelines and secure cloud-based data platforms using Python and SQL, applying DataOps and DevOps practices. Work with architects, analysts and software engineers on high-impact projects supporting UK national security, covering data modelling, orchestration and governance.

AWS

• London
• Hybrid
• £75,500 pa
• Senior

Designs, builds and optimises scalable data pipelines and processing systems for large volumes of clinical and genomic data, covering acquisition, transformation, lineage, metadata and de-identification. Works cloud-first in AWS using Python, Prefect, Tableau, Semarchy, Aspera and Globus, within the Generate Research Data service supporting the National Genomic Research Library.

AWS · Prefect · Tableau +7

• London
• Hybrid · 3 days in office
• £750 – £1,000 pd
• Lead
• Contract

Hands-on Staff-level engineer modernising a large enterprise data estate, migrating thousands of pipelines and building new data products. Requires deep Python/PySpark and Spark internals expertise, AWS Glue and Airflow, plus architectural leadership and AI-assisted development practices. Hybrid, three days per week on-site in London.

AWS Glue · Apache Spark · PySpark +4

• London
• Hybrid
• Entry level
• Permanent

Design, build and automate distributed data pipelines, schemas, warehouses and SQL/NoSQL systems, and own metrics, reports and dashboards that drive business decisions. Interns work with a manager and mentor alongside engineers, analysts and data scientists, troubleshooting data issues and contributing to mission-critical projects.

SQL · NoSQL · MapReduce