Data Engineering Lead (Snowflake & AWS Environment)

Middlesex
1 week ago
Create job alert

Data Engineering Lead (Snowflake & AWS Environment)

Hybrid working: 3 days in TW6, Middlesex offices & 2 days home/remote
Salary: Negotiable to £70,000 DOE plus 40 % bonus potential
Job Ref: J12869

Please note we can only accept applications from those with current UK working rights for this role, this client cannot offer visa sponsorship.

An exciting opportunity has arisen within a FTSE 100 company for a Data Engineering Lead to play a pivotal role in operating and delivering the organisation's data products. This position holds significant responsibility within the data leadership team, ensuring the data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation.

This is an exciting to time to join the organisation as they are in the early stages of a major programme of work to modernise their data infrastructure, tooling and processes to migrate from an on-premise to a cloud native environment. The Data Engineering Lead will be essential to the success of this transformation.

Using your strong communication skills combined with AWS and Snowflake technical expertise, you will be responsible for managing and guiding a team of Data Engineers to develop effective and innovative solutions aligning to the organisation's architectural principles and business needs. You will ensure the team adheres to best practices in data engineering and contributes to the continuous improvement of the data systems.

Key Responsibilities:
·Lead the design, development, and deployment of scalable and efficient data pipelines and architectures.
·Manage and mentor a team of data engineers, ensuring a culture of collaboration and excellence.
·Manage demand for data engineering resources, prioritising tasks and projects based on business needs and strategic goals.
·Monitor and report on the progress of data engineering projects, addressing any issues or risks that may arise.
·Collaborate closely with Analytics Leads, Data Architects, and the wider Digital and Information team to ensure seamless integration and operation of data solutions.
·Develop and implement a robust data operations capability to ensure the smooth running and reliability of our data estate.
·Drive the adoption of cloud technologies and modern data engineering practices within the team.
·Ensure data governance and compliance with relevant regulations and standards.
·Work with the team to define and implement best practices for data engineering, including coding standards, documentation, version control.

Technical Skills Required:
·Proven Engineering Experience using the AWS Services (S3, EC2, Lambda, Glue)
·Proven Data warehousing Experience in Snowflake
·Expert in SQL and database concepts including performance tuning and optimisation
·Solid understanding of data warehousing principles, data modelling practice,
·Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis)
·Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues
·Proficient in data integration techniques including APIs and real-time ingestion
·Excellent communication and collaboration skills to work effectively with cross-functional teams
·Capable of building, leading, and developing a team of data engineers
·Strong project management skills and an ability to manage multiple projects and priorities

Additional Experience:
·Experienced and confident leadership of data engineering activities (essential)
·Expert in data engineering practice on cloud data platforms (essential)
·Background in data analysis and preparation, including experience with large data sets and unstructured data (desirable)
·Knowledge of AI/Data Science principles (desirable)

If you are seeking a fresh challenge to lead and take ownership of an exciting data engineering transformation project, then get in touch to find out more!

Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme.

Datatech is one of the UK's leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: (url removed)

Related Jobs

View all jobs

Senior Test Lead Engineer | Network Services

Data Engineering Lead (Snowflake & AWS Environment)

Project Lead System Engineer

Project Lead System Engineer

Lead data Engineer - Financial Markets - Day rate

Software Engineering Manager

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Job Interview Warm‑Up: 30 Real Coding & System‑Design Questions

The world of data engineering has rapidly emerged as a critical pillar for businesses, enabling them to extract insights from vast amounts of information and power data-driven decision-making. From building scalable ETL pipelines to designing real-time streaming infrastructures and cloud data warehouses, data engineers are in high demand across every industry—from tech giants to healthcare providers to financial institutions. If you’re seeking a data engineering role, you may already know that interviews can be rigorous, spanning software development, database design, distributed systems, and cloud computing. Many organisations need engineers who can handle both traditional batch processing and cutting-edge real-time analytics frameworks, all while keeping data secure, consistent, and optimised. In this guide, we’ll explore 30 real coding & system-design questions that often come up in data engineering interviews. From classic coding challenges to architecture-focused scenarios, these questions will help you gauge your readiness and build confidence before stepping into that interview room. If you’re actively searching for new data engineering opportunities in the UK, www.dataengineeringjobs.co.uk is a fantastic resource. It features a wide range of vacancies—from junior data engineering positions to senior-level cloud architecture roles. Let’s dive in so you can approach your next interview with insight and poise.

Negotiating Your Data Engineering Job Offer: Equity, Bonuses & Perks Explained

How to Secure a Compensation Package That Reflects Your Value in the UK’s Fast-Growing Data Ecosystem Introduction Data engineering has quickly become the backbone of modern business operations. Whether powering analytics platforms, migrating data to the cloud, or building pipelines for machine learning, data engineers enable organisations to extract meaningful insights from vast datasets. With companies across every sector looking to harness data for competitive advantage, mid‑senior data engineers are in especially high demand—and that spells opportunity for you to negotiate a compelling compensation package. Yet for many professionals, negotiations around a job offer still focus primarily on salary, leading them to overlook valuable components such as equity, performance bonuses, and perks that can collectively add significant value to your overall deal. In the world of data engineering, it’s not uncommon to see advanced compensation packages involving shares, annual or quarterly bonuses, and a range of benefits that support both your technical growth and work-life balance. This guide aims to be your comprehensive manual for negotiating a data engineering job offer in the UK. We’ll cover why negotiation isn’t just about your monthly paycheck, explore how equity works in data-centric organisations, break down different bonus structures, and highlight perks that matter most for mid‑senior professionals. By the end, you’ll have the knowledge—and the confidence—to land a package that fully reflects your critical role in unlocking the power of data.

Data Engineering Jobs in the UK Public Sector: Opportunities with GDS, NHS, MOD, and Beyond

Data has become one of the most valuable assets in today’s digital age, enabling organisations to make data-driven decisions, optimise processes, and deliver improved services. Nowhere is the potential impact of robust data engineering practices more significant than in the UK public sector. From the National Health Service (NHS) to the Government Digital Service (GDS) and the Ministry of Defence (MOD), large volumes of data are continually generated and processed, creating a rising demand for data engineering jobs. In this blog post, we’ll explore why data engineering is so essential for public sector bodies, the range of roles available, the skills and qualifications needed to excel, and how you can secure a highly rewarding career in this domain. Whether you’re a seasoned data professional or just starting out in tech, read on to discover how to make a meaningful impact through data engineering jobs in the UK’s public sector.