Shape the Future of AIJoin one of the UK's fastest-growing companies and become a Professional Development Expert in Artificial Intelligence.

View Roles

Data Engineer

City of London
5 days ago
Create job alert

Data Engineer - Permanent

As a data Engineer, you will shape next-gen data architecture, build smart solutions with Web and Data Science teams, and harness Gen AI to move faster and smarter. You will be experienced in AI and enjoy writing code.

Responsibilities

Build and maintain scalable distributed systems using Scala and Java
Design complex Spark jobs, asynchronous APIs, and parallel processes
Use Gen AI tools to enhance development speed and quality
Collaborate in Agile teams to improve their data collection pipelines
Apply best practices like TDD, SOLID, and their engineering standards
Design relational and non-relational databases and data models
Support the Data Science team in deploying machine learning models to production
Leverage data structures, algorithms, and design patterns effectively
Foster empathy and collaboration within the team and with customers

Preferred Experience

Degree in Computer Science or equivalent practical experience
Commercial experience with Spark, Scala, and Java (Python is a plus)
Strong background in distributed systems (Hadoop, Spark, AWS)
Skilled in SQL/NoSQL (PostgreSQL, Cassandra) and messaging tech (Kafka, RabbitMQ)
Experience with orchestration tools (Chef, Puppet, Ansible) and ETL workflows (Airflow, Luigi)
Familiarity with cloud platforms (AWS, GCP) and monitoring tools (ELK stack)
Proven problem-solving mindset and ability to adapt solutions to complex challenges
Hands-on use of Gen AI tools for coding, debugging, or system designFully Remote
Brilliant benefits package

Please send me a copy of your CV if you meet all of the requirements

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 Data Engineering Recruitment Agencies in the UK You Should Know (2025 Job‑Seeker Guide)

As organisations prioritise data-driven strategy, UK demand for data engineers has surged. Lightcast observed +52 % YoY growth in UK job ads referencing “data engineering,” “data pipeline,” or “ETL” in Q1 2025. Yet fewer than 15,000 fully credentialled data engineers are active, and monthly live roles hover around 1,600–1,900. Specialist recruiters provide vital shortcuts to hidden roles, technical prep and interview support. We vetted 50+ consultancies and included only those with: UK-registered head offices (Companies House verified) Named Data Engineering or Data & Analytics practice ≥5 UK data engineering roles advertised between March–June 2025 This guide mirrors your AI and biotech layouts: hiring snapshot, 10-agency verified directory (location, contact, website), salary figures, in-demand skills, interview prep, FAQs and next action steps.

Data Engineering Jobs Skills Radar 2026: Emerging Frameworks, Tools & Technologies to Learn Now

Data is the new oil—and data engineers are the pipeline builders. In 2026, UK companies aren’t just collecting data—they’re streaming it, transforming it in real-time, and deploying it into AI and BI tools for instant decision-making. But all of this depends on one thing: highly skilled data engineers with a mastery of modern tools and frameworks. Welcome to the Data Engineering Jobs Skills Radar 2026—your annual guide to the languages, platforms, and tools that are defining the future of data engineering jobs in the UK. Whether you're building data lakes, deploying pipelines, or scaling real-time analytics, this guide will keep your skills up to date with what employers really want.

How to Find Hidden Data Engineering Jobs in the UK Using Professional Bodies like BCS, IET & More

As UK organisations continue to scale their data capabilities, the role of the data engineer has become one of the most vital in the digital economy. From designing pipelines and managing infrastructure to enabling machine learning models, data engineers are the backbone of every data-driven organisation. But while demand is high, the most rewarding roles are often never posted publicly. In this article, we’ll show you how to discover hidden data engineering jobs in the UK by strategically engaging with professional bodies like the BCS, IET, TechUK, and UK data communities. By joining specialist groups, attending CPD events, and using member directories, you can unlock a wave of unseen job leads—and connect with hiring managers long before roles are advertised.