Scala Data Engineer

London
1 week ago
Create job alert

Scala Data Engineer

I am working with an analytics and digital solutions consultancy that partner with clients from several different industries to unlock their potential to become truly data driven. They work to deliver tailored, bespoke systems to fit the needs of their clients with a focus on cloud-based transformations and AI products.

You will be joining this award-winning consultancy during a period of significant growth off the back of winning new projects. They have undergone year on year growth and are backed by a private equity firm who are committed to continuing to help this business grow. You will work on a UK based project but the business have continued to build on their operations in both central Europe and America.

You will be joining a project with a focus on data migration from Hadoop to the cloud, creating robust data pipelines and working with Scala, Spark and other AWS services to process and manipulate data.

As part of this role, you will be responsible for some of the following areas.

Develop big data solutions utilising Hadoop and Apache Spark
Create, develop and maintain robust ETL pipelines using AWS Glue and Scala
Design and implement Scala-based applications for the use of big data processing
Work with other technical members of the team to enhance the performance of code, promoting best practice at all times
Implement data processing and transformation workflows for both unstructured and structured dataTo be successful in this role you will have.

Previous experience working as a Data Engineer utilising Scala
Hands on experience with Apache Spark and Spark-Scala
Experience working within the Hadoop ecosystem
Experience creating ETL pipelines using Scala or AWS Glue
Strong understanding and experience with AWS technologies such as S3, Lambda and EMRThis is a fully remote role and you would be employed on a fixed-term contract basis for 12 months (the duration of the current project. My client are offering a starting salary of up to £120,000 depending on experience with a benefits packages that includes 28 days annual leave, private medical care and a strong company pension scheme.

This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will call you to discuss further. My client is looking to begin the interview process ASAP, so don't miss out, APPLY now! Or feel free to contact me on (phone number removed) or (url removed)

Related Jobs

View all jobs

Scala Data Engineer

Scala Data Engineer

Scala Data Engineer

Scala Data Engineer

Scala Data Engineer

Scala Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

UK Visa & Work Permits Explained: Your Essential Guide for International Data Engineering Talent

Data engineering has become a foundational pillar for organisations seeking to leverage their data assets effectively. From building robust data pipelines and integrating real-time analytics to migrating entire infrastructures to the cloud, skilled data engineers drive innovation and growth. In the United Kingdom, demand for data engineering professionals spans multiple sectors, including finance, healthcare, retail, tech start-ups, and government services. However, if you’re an international data engineering specialist looking to build or advance your career in the UK, one critical step stands before you: navigating the visa and work permit landscape. This comprehensive guide breaks down key visa routes, eligibility criteria, and practical steps to help you secure employment and settle into the UK’s thriving data ecosystem. Whether you specialise in ETL processes, big data platforms, or cloud infrastructure, understanding the UK visa system is the first step toward realising your ambitions.

Top UK Data Engineering Labs and Institutes: Powering the Future of Data-Driven Innovation

Data is the new “oil” of the modern digital economy, but it only becomes valuable when refined into usable insights. That’s where data engineering steps in—building the pipelines, architectures, and systems that underpin data-intensive applications across every sector. From healthcare analytics to streaming media platforms, from cutting-edge AI research to real-time financial trading, the demand for robust data infrastructure is constantly growing. In the United Kingdom, data engineering has emerged as a fast-expanding field, supported by world-class universities, cutting-edge research institutes, and a thriving tech industry. In this guide—brought to you by DataEngineeringJobs.co.uk—we explore the top UK labs and institutes driving data engineering innovation, examine the country’s data-focused ecosystem, and outline the career paths that can lead you to success in this vital discipline.

Shadowing and Mentorship in Data Engineering: Gaining Experience Before Your First Full-Time Role

Introduction Data engineering has emerged as a critical and fast-growing field in today’s business landscape. With organisations across every industry striving to collect, organise, and derive insights from massive volumes of data, the demand for talented data engineers continues to surge. These professionals design and maintain the frameworks that power data pipelines, ensuring that large datasets can be processed efficiently, securely, and accurately to support analytics and machine learning initiatives. Despite the expanding opportunities, breaking into data engineering can be challenging—particularly if you lack hands-on experience with real-world systems. Even those who have completed relevant degree programmes, bootcamps, or online courses often find themselves seeking more practical knowledge and industry exposure. That’s where shadowing and mentorship become pivotal. Observing seasoned data engineers at work and receiving guidance from mentors can fast-track your learning, helping you bridge the gap between theoretical knowledge and the daily realities of data infrastructure. This article explores how to identify mentors, build productive mentor-mentee relationships, and engage in shadowing opportunities that deepen your technical and professional skills. From landing an internship to leveraging online communities, we’ll cover actionable strategies to strengthen your profile and confidently pursue your first full-time role in data engineering.