Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer - PySpark, Databricks

City of London
2 weeks ago
Create job alert

A rapidly growing company in the B2B Software as a Service (SaaS) space are looking for a Deployed Engineer to join their expanding team in London (hybrid working - 2-3 days a week in their modern office space).

Their product is a platform that acts as a "digital twin" of a their customers businesses - integrating internal and external data from a variety of sources to act as a "single source of truth", powering actionable insights at scale. When combined with AI algorithms, the platform drives strategic decision-making, and enables planning and effective execution, allowing businesses to achieve their targeted state. They are a true pioneer in their field!

They believe the future of B2B SaaS is about delivering tailored, dynamic solutions for their clients, rather than implementing static tools. This is where you come in - you'll be working within a team who believe value is created not just in the codebase, but in the implementation layer - making this role ideal for someone who thrives in dynamic, customer-facing environments.

The role:

Adapt and deploy a powerful data platform to solve complex business problems
Design scalable generative AI workflows using modern platforms like Palantir AIP
Execute advanced data integration using PySpark and distributed technologies
Collaborate directly with clients to understand priorities and deliver outcomesWhat We're Looking For:

Strong skills in PySpark, Python, and SQL
Ability to translate ambiguous requirements into clean, maintainable pipelines
Quick learner with a passion for new technologies
Experience in startups or top-tier consultancies is a plusNice to Have:

Familiarity with dashboarding tools, Typescript, and API development
Exposure to Airflow, DBT, Databricks
Experience with ERP (e.g. SAP, Oracle) and CRM systemsWhat's On Offer:

Salary: £50,000-£75,000 + share options
Hybrid working: 2-3 days per week in a vibrant Soho office
A highly social culture with regular team events and activities
Work alongside seasoned tech and business leaders
Be part of a mission-driven company with a strong social impact ethosIf you're excited by the idea of working at the intersection of AI, data, and enterprise transformation - and want to be part of a fast-scaling, values-led team - we'd love to hear from you.

Please Note: This is a role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.

Tenth Revolution Group / Nigel Frank are the go-to recruiter for Data and AI roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data engineering hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise reliable pipelines, modern lakehouse/streaming stacks, data contracts & governance, observability, performance/cost discipline & measurable business outcomes. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for platform‑oriented DEs, analytics engineers, streaming specialists, data reliability engineers, DEs supporting AI/ML platforms & data product managers. Who this is for: Data engineers, analytics engineers, streaming engineers, data reliability/SRE, data platform engineers, data product owners, ML/feature‑store engineers & SQL/ELT specialists targeting roles in the UK.

Why Data Engineering Careers in the UK Are Becoming More Multidisciplinary

For many years, data engineering in the UK meant designing pipelines, moving data between systems, and ensuring analysts had what they needed. Today, the field is expanding. With cloud platforms, machine learning, real-time analytics and the explosion of sensitive personal data, employers expect data engineers to do much more. Modern data engineering is no longer just about code and storage. It requires legal awareness, ethical judgement, psychological insight, linguistic clarity and human-centred design. These disciplines shape how data is collected, processed, explained and trusted. In this article, we’ll explore why data engineering careers in the UK are becoming more multidisciplinary, how law, ethics, psychology, linguistics & design now influence job descriptions, and what job-seekers & employers must do to thrive.

Data Engineering Team Structures Explained: Who Does What in a Modern Data Engineering Department

Data has become the lifeblood of modern organisations. Every sector in the UK—finance, healthcare, retail, government, technology—is increasingly relying on insights derived from data to drive decisions, deliver products, and improve operations. But raw data on its own isn’t enough. To make data useful, reliable, secure, and scalable, companies must build strong data engineering teams. If you’re recruiting for data engineering or seeking a role, understanding the structure of such a team and who does what is essential. This article breaks down the typical roles in a modern data engineering department, how they collaborate, required skills and qualifications, expected UK salaries, common challenges, and advice on structuring and growing a data engineering team.