Data Engineer

Job description

S.H.I.F.T Talent has partnered with an IT Consultancy looking for Data Engineers.

Their Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to the clients’ needs. They develop, operate, and maintain these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders.

Key responsibilities

They want to positively impact the future of the country by using technology to improve society, for everyone. We want to empower the public sector to deliver and continuously improve digital services that are user-centric, data-driven and freed from legacy technology. A key component of this is developing modern data systems and platforms that drive informed decision-making for our clients.

As a Data Engineer, you'll play a hands-on role as a contributor to client projects, focusing on both delivering engineering work as well as upskilling members of the client team.

As a member of the data capability, you will also participate in our hiring process and continued development of the team, as well as representing us both internally to the organisation and publicly via presentations. You’ll need to have a drive to deliver outcomes for users and have a desire to mentor teams.

You will need to be comfortable sharing your knowledge and skills with others. Maybe you’ve written some blog posts about your discipline, or perhaps even delivered a talk or two that you’d like to share.

Skills, knowledge and expertise

We look for the following skills and experience. But if you don’t have some of the skills and experience listed below, don’t let that stop you from applying!

• Working directly with clients and users
• Strong hands-on Python experience
• Designing and implementing efficient data transformation processes at scale, in either batch or streaming use cases
• Contributing to the cloud infrastructure underpinning data systems through a DevOps approach
• Basic understanding of the possible architectures involved in modern data system design (e.g. warehouses, lakes, and meshes)
• Agile practices such as Scrum, XP, and/or Kanban
• Showcasing and presentation skills
• Evidence of self-development – we value keen learners
• Empathy and people skills

Desirable experience

• Working at a technology consultancy
• Pair programming
• Working with data scientists to productionise advanced data deliverables, such as machine learning models
• Infrastructure-as-Code (e.g. Terraform, Cloud Formation)
• Working knowledge of statistics
• Working with multidisciplinary digital and technology teams
• Working within the public sector

An increasing number of their customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, they're looking for all successful candidates for this role to have eligibility.

Eligibility for SC requires 5 years' continuous UK residency and 5 year' employment history (or back to full-time education). Please note that if at any point during the interview process it is apparent that you may not be eligible for SC, we won't be able to progress your application and we will contact you to let you know why.