Data Engineering Jobs

• New York, United States
• Hybrid
• US$100,000 – US$145,000 pa
• Mid-level

Builds and maintains data pipelines, reporting datasets and dashboards that support Recruiting and Hiring Operations, integrating systems such as Lever, Workday and Foundry. Works cross-functionally with recruiters, data, security and privacy partners, moving between pipeline work, integration debugging, documentation and stakeholder enablement.

Foundry · Contour · Lever +4

• Australia
• Remote
• Mid-level

Customer-embedded delivery role deploying and optimising the Maia Foundation platform for enterprise clients, architecting production-grade integrations and distributed data systems in Python, SQL and APIs. Involves modernising legacy ETL/ELT workflows across AWS/Azure/GCP and Kubernetes, integrating AI APIs, and delivering solutions within 8-12 week Accelerator windows while working directly with customer executives.

AWS · Azure · GCP +5

• London
• Remote
• £75,000 – £105,000 pa
• Senior

Design, build and deploy production-grade LLM and Generative AI applications, including RAG solutions, scalable data pipelines and AI-powered services for enterprise clients. The role blends software and data engineering with modern AI platforms, plus deployment, monitoring and optimisation of live systems, in a fully remote team of engineers, architects and AI specialists.

Databricks · MLflow · LangChain +5

• United Kingdom
• Remote
• Lead
• Permanent

Owns database performance end-to-end on a petabyte-scale cloud analytics database, driving improvements across query execution, filters, aggregation, joins and index structures. Involves architecting optimised algorithms and data structures, leading the performance roadmap for latency, throughput and memory efficiency, and mentoring junior engineers.

ClickHouse

• United Kingdom
• Remote
• £94,000 – £118,000 pa
• Senior

Builds frontend experiences for Grafana Cloud's Database Observability squad, helping users explore database telemetry, spot slow queries and troubleshoot performance. Primarily TypeScript and React work with chances to contribute to Go backends and APIs, plus on-call, mentoring and open source involvement.

Grafana · Grafana Cloud · Prometheus +6

• Stirling
• Mid-level

Hands-on engineering role building and running multi-cloud AI and data platforms, delivering production services, APIs, automation and infrastructure as code. Applies AI and agentic capabilities to platform operations, provisioning, access management and remediation, while owning resilience, observability, governance and measurable outcomes alongside product, security and business teams.

Multi-Cloud

• United Kingdom
• Senior

Owns the end-to-end security telemetry pipeline, ingesting cloud, identity, endpoint and asset data into Elasticsearch and keeping the underlying Elastic Cloud on Kubernetes clusters healthy. Builds custom and Elastic integrations, manages ILM, CCS, capacity and shards, and uses Terraform, Helm and AI-assisted automation to reduce operational toil.

Elasticsearch · Elastic Cloud on Kubernetes · Kubernetes +7

• Langley Mill
• £55,000 pa
• Senior
• Contract

Hands-on engineering role building a greenfield AWS Analytics and AI platform on a 12-month fixed term contract, turning operational, telematics and third-party data into governed, reusable data products. You'll build lakehouse pipelines with S3, Glue, Athena, Lake Formation, DMS and Step Functions, embedding data quality, lineage, metadata and access controls, and mentor others in the team.

AWS · S3 · AWS Glue +7

• London

Build a greenfield research and trading platform from scratch within a pod-like team at a prop trading firm, working on GPU-heavy distributed training and MapReduce-style systems. The role centres on Ray, Spark, Dask, Databricks/Anyscale and Kubernetes for ML clusters, with strong autonomy to shape direction early in a deep learning-first environment.

Ray · Spark · Dask +6

• Manchester
• Hybrid · 2 days in office
• £450 – £480 pd
• Senior
• Contract

Define and govern end-to-end architecture for large-scale data migration solutions at a banking client, producing HLDs, architecture decision records and migration patterns. Provide design oversight to Data Engineers and Software Engineers while aligning with enterprise, security and data governance standards. Requires on-site presence two days a week in Manchester.

dbt · GCP

• United Kingdom
• Remote
• Permanent

Conduct applied research on open-source database systems like ClickHouse and PostgreSQL, focusing on query optimization, execution engines, distributed systems, indexing and benchmarking. Build research prototypes and production-grade implementations, analyze large-scale workloads, and publish at venues such as SIGMOD and VLDB while collaborating with engineering teams.

ClickHouse · PostgreSQL · MySQL +7

• Newcastle upon Tyne
• On-site
• Permanent

Design and build data-intensive applications and production pipelines for complex Defence and national security projects, working from ingestion through to end-user consumption. The role involves taming sensitive, hard-to-access datasets and testing data products for reliability, using SQL, Python, Spark, Databricks, cloud platforms and orchestration tools like Airflow alongside analysts, scientists and engineers.

Spark · Databricks · AWS +3

• Birmingham
• Remote
• £85,000 – £110,000 pa
• Lead

Lead the design of AWS-based data platforms that make enterprise data trusted, governed and observable for analytics, machine learning and agentic AI. Combines hands-on architecture with customer-facing technical leadership, shaping data and AI strategy and standards while guiding enterprise clients from AI experimentation into production.

AWS · Python · SQL

• London
• Hybrid · 2–3 days in office
• £98,500 pa
• Senior
• Contract

Technical architect role within a dedicated design team, building automated and agentic production pipelines that scale paid media creative across EMEA. Involves designing agentic workflows with Anthropic Claude and OpenAI APIs, architecting MCP servers, and building agents that read design systems and output production-ready static and video assets.

Anthropic Claude · OpenAI · Model Context Protocol +5

• London
• Hybrid · 2–3 days in office
• £745 pd
• Lead · manages people
• Contract

Lead data delivery squads supporting a Corporate & Investment Banking data platform, overseeing how banking data is integrated, processed, mapped and consumed across enterprise platforms. The role is delivery-focused rather than hands-on engineering, running Scrum ceremonies, managing stakeholders and challenging technical teams on data logic and modelling.

Jira · Databricks · Data Lakes +1