Data Engineering Jobs

• Sydney, Australia
• Hybrid
• Entry level
• Internship

Forward Deployed Software Engineers embed with government customers to understand open-ended problems and build data-driven solutions, spanning architecture discussions, large-scale data wrangling, custom web apps and executive briefings. Interns work in small teams with minimal supervision and own end-to-end delivery of high-stakes projects, using languages such as Python, Java, C++ or TypeScript.

Palantir

• London
• Senior

Customer-facing engineering role owning architecture and design decisions while building production-grade data, AI and application systems on the Databricks platform. Works embedded with client teams from technical ICs to executives, spanning data engineering, ML/AI integration, distributed Spark workloads and cloud ecosystems, with roughly 20% travel.

Databricks · AWS · Azure +7

• London
• Entry level
• Internship

Join an engineering team to build features for a data and AI infrastructure platform, owning a project end-to-end from design through code and feedback. Work spans full stack, backend, infrastructure, systems, tools, cloud and databases, with a dedicated mentor and a 12-week summer cohort.

Databricks · Genie · Lakebase +4

• New York, United States
• Hybrid
• US$135,000 – US$200,000 pa
• Mid-level

Works deep inside the data processing infrastructure behind Palantir Foundry, designing query planning and optimization, extending execution engines, and improving operators, parallelism and memory management. Builds on and extends Apache Spark, DataFusion, Comet, Velox and Iceberg, owning changes from design through production with a high bar for correctness and performance.

Apache Spark · Apache DataFusion · Apache Iceberg +7

• London
• Hybrid
• £60,000 – £90,000 pa
• Senior
• Permanent

Builds cloud-native data platforms using medallion architecture and engineers batch and near real-time pipelines with Python, PySpark, Databricks and Snowflake. Integrates data from PAS, claims, broker and market feeds for underwriting, pricing, claims and reinsurance, while mentoring juniors and supporting CI/CD. Distinct for its London Market insurance domain focus and senior stakeholder exposure.

Databricks · Snowflake · Azure +3

• London
• Hybrid
• £65,000 – £75,000 pa
• Senior
• Permanent

Designs, architects and scales enterprise-grade AI platforms, building data pipelines, cloud-native services and RESTful APIs that productionise ML, NLP and LLM models. Works alongside Data Scientists, Software Engineers and Product teams, mentoring engineers and shaping engineering standards. Remote-first with optional hybrid London working.

AWS · Azure · Docker +7

• London
• Hybrid · 2 days in office
• £80,000 – £100,000 pa
• Senior

Manage and secure AWS cloud infrastructure, build infrastructure as code and CI/CD pipelines, and maintain cloud-based data pipelines. Work closely with the CTO and software team on developer access, permissions, security monitoring and incident response, using AWS CDK, GitHub Actions, Lambda, ECS, Fargate and TypeScript.

AWS · AWS CDK · GitHub Actions +7

• London
• Hybrid
• £40,000 – £70,000 pa
• Mid-level

Client-facing role designing and building scalable cloud data platforms for enterprise clients, with hands-on work on ETL/ELT pipelines, data architectures and ingestion, transformation and orchestration tooling. Tech stack centres on AWS, Databricks, Python, SQL and DBT, with scope to apply emerging technologies such as Agentic AI.

AWS · Databricks · S3 +6

• Birmingham
• Hybrid
• £60,000 – £80,000 pa
• Senior

Designs and maintains end-to-end data pipelines for large, complex datasets, transforming data into insights, analytical tools and dashboards. Works with software engineers, researchers and technical specialists on projects supporting national security infrastructure, with a focus on automation and process improvement in Linux-based environments.

• Nottingham
• Hybrid · 2–3 days in office
• £60,000 – £65,000 pa
• Mid-level

Designs and delivers Power BI dashboards, semantic models and ETL/ELT pipelines across a Snowflake, SQL and Python environment, supporting operational and commercial decisions in vehicle rental and automotive services. Combines hands-on engineering with stakeholder engagement, data governance and exploration of automation and AI-enabled analysis.

Power BI · Snowflake · SQL +1

• London
• Mid-level
• Permanent

Designs and builds ETL pipelines and data models at scale, working across the full data lifecycle from ingesting semi-structured streams to enabling self-service analytics. Collaborates with analysts, scientists and engineers on data quality, lineage and query performance, and mentors peers on architecture best practices. Sits within a supply chain planning data infrastructure team.

Generative AI

• Birkenhead
• £50,000 – £55,000 pa
• Mid-level
• Permanent

Operates the observability and data infrastructure behind an industrial energy-telemetry platform, covering the full data lifecycle from ingestion and storage to transformation, analysis and visualisation. Builds and maintains ETL/ELT pipelines over time-series and event data, creates dashboards and alerting tools, and integrates platforms with custom software and external APIs. Full training is provided and the employer values engineering judgment over specific prior tooling.

Git

• London
• Hybrid · 3 days in office
• £110,000 pa
• Lead · manages people

Lead technical direction across a modern cloud data platform built on AWS, Snowflake and dbt, staying hands-on while unblocking engineers on complex issues. Combines mentoring a team of engineers with influencing senior stakeholders and shaping engineering standards in a federated data model.

AWS · Snowflake · dbt

• London
• Hybrid · 3 days in office
• £45,000 – £70,000 pa
• Senior
• Permanent

Design, build and maintain scalable data pipelines and cloud-based data platforms on AWS, working with data architects, scientists and analysts to turn complex data into reliable, accessible information. Combines hands-on engineering with technical leadership, shaping data solutions and guiding delivery across national security, government and public-sector environments.

AWS · S3 · AWS Glue +6

• London
• Hybrid · 2 days in office
• Lead · manages people

Lead a data engineering team, setting technical direction and mentoring developers while driving solution design and stakeholder decisions. Day-to-day involves monitoring delivery against plans, ensuring scalability and performance, and promoting software engineering best practices including AI-based development. Requires SQL, Python, microservices and test-driven development experience.

Git