Data Engineer

About the Role and our Ideal Candidate

The data engineer will be joining the corporate data service. You will play a key role in the delivery of the data strategy. In this role, you will:

• Lead Platform Development: Take a leading role in the build, and maintenance of the AWS-based data platform, bringing together data from numerous systems.
• Engineer Data Solutions: Build and optimise scalable data pipelines, APIs, and ETL/ELT processes to connect operational systems with our data platforms.
• Deliver Key Projects: Lead complex data engineering projects, managing internal and external partners.
• Collaborate and Innovate: Work closely with data scientists, analysts, and service leaders to build data products and services that provide continuous insight for our staff and residents.
• Drive Data Quality: Work across the organisation to extract, clean, and combine data, establishing rigorous standards to make it a trusted asset for decision-making.

About You

You are a collaborative and adaptable engineer who is eager to grow with our new data service. You have a passion for solving complex problems and building efficient, reliable data systems.

You are:

• Skilled in Cloud services & Data Platforms: You possess excellent Python and SQL/NoSQL skills and have significant experience with AWS cloud services (e.g., Redshift, Athena, Lambda, S3). You can design, build, and optimise scalable data pipelines.
• A Proven Project Leader: You have a track record of leading complex data engineering projects in an agile manner and delivering impactful data products and services.
• A Clear Communicator: You excel at explaining highly technical concepts to diverse audiences and can build strong relationships with stakeholders to foster a data-driven culture.
• A Champion for Data Governance: You have a strong understanding of data security, GDPR, and data protection regulations, especially within the context of sensitive data.
• An Innovator and Problem-Solver: You are passionate about learning new technologies, automating manual processes, and finding innovative solutions to improve data reliability and efficiency.
• Dealing with complex data: You have experience working with complex datasets and working with services to automate manual processes or make existing processing more efficient and cost effective.

Supporting Statement

In your supporting statement please tell us 'What motivates you to pursue a data science role within local government? Please describe a specific project or accomplishment from your professional experience where you used data to solve a complex problem or drive a positive outcome. (250 to 350 words)

About Us

The new Data Service is part of a shared Digital & IT service for the Royal Borough of Kingston upon Thames and the London Borough of Sutton. Both councils have ambitious transformation programmes that depend on a more effective use of data to gain better insights and improve council services for residents. The team will also play a key role in supporting each Council’s AI and digital ambitions.

Being a new service the successful candidate(s) will have an opportunity to grow, learn and set direction.

Both Councils have data strategies with the strong backing of management and colleagues. The data strategy aims to:

• Set a data architecture and build a platform that makes it easier for the organisation to find, combine and use data.
• Establish a data governance framework to improve quality and handling so staff can have confidence in data products.
• Upskill our data analysts and council employees and recruiting data specialists.
• Select and embed new tools and technologies to improve data usage.
• Promote a more data-driven culture at all levels in the organisation.

The role reports directly to the Head of Data.

We support hybrid work but this is not a completely remote working role.