Data Engineer (AWS)

Data Engineer (AWS) 12-month FTC, Canary Wharf, London

One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension.

This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts.

What you’ll do:

* Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities.

* Spend most of your time on hands-on technical work with support for learning and professional development.

* Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data acquisition workflows.

* Implement data transformation, validation, and quality controls to ensure datasets are reliable, reproducible and analysis ready.

* Build and maintain containerised data and analytics applications (such as dashboards and data tools) that run scalable workloads.

* Implement and manage data workflow orchestration and scheduling to ensure observable and maintainable execution of data pipelines and jobs.

* Apply Infrastructure as Code (IaC) where necessary to support data pipelines and processing workflows on our AWS-based infrastructure.

* Design and maintain systems for data version control and reproducible machine learning workflows (MLOps).

* Work with analysts, data scientists, and engineers to translate analytical and operational requirements into data-solutions.

What you’ll need:

* Experience delivering production data pipelines end-to-end, including design, implementation, and operational maintenance, in a cloud environment. (Lead Criteria)

* An undergraduate degree in a quantitative subject OR equivalent experience working in data engineering, data science, or development in the cloud. (Lead Criteria)

* Experience writing production-quality Python code to work with complex or messy datasets. (Lead Criteria)

* Understanding of core data engineering best practices, such as data-modelling, transformation, validation, testing, and reproducibility.

* Experience working collaboratively within multidisciplinary teams, including analysts, data scientists, or other engineers.

* Strong communication skills, with the ability to present work in a straightforward and engaging way, including to non-technical audiences

SmartSourcing are a Disability Confident Employer and we promote, celebrate and value diversity, we are committed to promoting equality and inclusion for all