Python Data Engineer

London
9 hours ago
Create job alert

The Company
This business is a rail software and consulting company with a growing team and a solid foundation of project-based revenue. It works with leading organisations across the UK rail industry, helping them harness data to solve complex operational challenges.
Data Engineers are key to this mission - building robust data infrastructure and tooling that powers insights, analytics, and software products used across the rail network.
The Role
As a Data Engineer, you'll be part of a collaborative technical team, working across the data lifecycle: from designing ETL pipelines and integrating real-time data streams, to developing APIs and backend systems that deliver rail data securely and reliably.
You'll work closely with engineers, consultants, and project managers to translate real-world rail problems into scalable technical solutions. This role sits at the intersection of software engineering, data architecture, and delivery.
Key Responsibilities
Data Engineering & Infrastructure
• Design and implement robust data pipelines (batch and real-time) for ingesting, transforming, and serving rail-related datasets.
• Develop and maintain data APIs and services to support analytics, software features, and reporting tools.
• Build data models and storage solutions that balance performance, cost, and scalability.
• Contribute to codebases using modern data stack technologies and cloud platforms (e.g., Azure, AWS).
Collaborative Delivery
• Work with domain consultants and delivery leads to understand client needs and define data solutions.
• Participate in agile delivery practices, including sprint planning, reviews, and retrospectives.
• Help shape end-to-end solutions — from ingestion and transformation to client-facing features and reporting.
Best Practices & Growth
• Write clean, well-documented, and tested code following engineering standards.
• Participate in design reviews, code reviews, and collaborative development sessions.
• Stay up-to-date with new tools and trends in the data engineering space.
• Contribute to internal learning sessions, tech talks, and shared documentation.
The Candidate
You might be a good fit if you have experience with:
• Building ETL/ELT pipelines using tools like Kafka, dbt, or custom frameworks.
• Working with structured and unstructured data at scale.
• Backend development in Python (or similar), and familiarity with data APIs.
• Cloud data platforms (e.g., AWS Redshift, Azure Synapse).
• SQL and database design for analytics, reporting, and product use.
• Agile collaboration with cross-functional teams.
You don’t need experience in rail — just curiosity and a willingness to learn the domain

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer BI

Data Engineer (Azure)

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

New Data Engineering Employers to Watch in 2026: UK and Global Companies Driving the Data Revolution

Data engineering is at the heart of the digital economy, transforming raw data into actionable insights, powering analytics, AI systems, and cloud infrastructure. As the UK and global markets continue to invest heavily in data platforms, pipelines, and real-time analytics, demand for skilled data engineers is growing rapidly. For professionals exploring opportunities on www.DataEngineeringJobs.co.uk , the critical question is: which companies are expanding, hiring, and shaping the future of data-driven business? This article highlights new data engineering employers to watch in 2026, including UK startups, scale-ups, and international firms expanding in the UK.

How Many Data Engineering Tools Do You Need to Know to Get a Data Engineering Job?

If you’re aiming for a career in data engineering, it can feel like you’re staring at a never-ending list of tools and technologies — SQL, Python, Spark, Kafka, Airflow, dbt, Snowflake, Redshift, Terraform, Kubernetes, and the list goes on. Scroll job boards and LinkedIn, and it’s easy to conclude that unless you have experience with every modern tool in the data stack, you won’t even get a callback. Here’s the honest truth most data engineering hiring managers will quietly agree with: 👉 They don’t hire you because you know every tool — they hire you because you can solve real data problems with the tools you know. Tools matter. But only in service of outcomes. Jobs are won by candidates who know why a technology is used, when to use it, and how to explain their decisions. So how many data engineering tools do you actually need to know to get a job? For most job seekers, the answer is far fewer than you think — but you do need them in the right combination and order. This article breaks down what employers really expect, which tools are core, which are role-specific, and how to focus your learning so you look capable and employable rather than overwhelmed.

What Hiring Managers Look for First in Data Engineering Job Applications (UK Guide)

If you’re applying for data engineering jobs in the UK, the first thing to understand is this: Hiring managers don’t read every word of your CV. They scan it. They look for signals of relevance, credibility, delivery and collaboration — and if they don’t see the right signals quickly, your application may never get a second look. In data engineering, hiring managers are especially focused on whether you can build and operate reliable, scalable data systems, handle real-world data challenges and work effectively with analytics, BI, data science and engineering teams. This guide breaks down exactly what they look at first in your application — and how to shape your CV, portfolio and cover letter so you stand out.