Data Engineer

Position Title: Advanced Data Engineer

Contract Type: Contract (6-month initial duration, with potential for extension)

Location: Cardiff, UK

Work Arrangement: Onsite

Hours: 37.5 hours per weekJob Description

Core Technical Skills

Strong proficiency in programming languages such as Python, SQL, and R (experience with R is desirable).

Proven experience working with relational database management systems and data warehousing architectures.

Hands-on expertise using Git-based version control tools (e.g., GitHub, GitLab, Azure DevOps) within collaborative software development environments.

Demonstrated experience operating effectively within Agile delivery frameworks.

Background in designing and deploying cloud-native data architectures, with a preference for Google Cloud Platform (GCP).

Proven track record of migrating legacy on-premises data platforms, pipelines, and services to cloud infrastructure.

Solid grasp of data modeling concepts across conceptual, logical, and physical levels.

Proven capability to design, construct, test, and maintain robust, scalable data pipelines and data products.

Experience establishing CI/CD automation and streamlined deployment workflows.

Experience leveraging container technologies such as Docker.

Skilled in architecting and implementing robust ETL and ELT data pipelines.

Familiarity with modern workflow orchestration frameworks (e.g., Airflow, Cloud Composer, Prefect, Dagster).

Experience processing large-scale datasets using distributed computing engines (e.g., BigQuery, Spark, Dataproc).

Proficiency in monitoring, troubleshooting, and optimizing platform performance and data pipelines.

Solid understanding of DataOps and DevOps methodologies.

Experience integrating systems via APIs and standard data integration techniques.Data Architecture and Engineering Practices

Understanding of how enterprise data platforms interoperate with broader organizational systems.

Practical experience utilizing metadata management solutions, data lineage tools, and data catalogs.

Experience implementing comprehensive data quality profiling, assessment, and validation frameworks.

Demonstrated capability to design, develop, test, document, and support production-ready code and end-to-end data pipelines.

Adept at leading code reviews and applying software engineering best practices, including unit testing, refactoring, and comprehensive technical documentation.Governance, Compliance and Ethics

In-depth understanding of information governance, data protection laws (including the Data Protection Act 2018 and UK GDPR), and secure data management standards.

Awareness of ethical standards and considerations related to data processing and analytics.Communication and Stakeholder Collaboration

Strong interpersonal and communication skills for working effectively across cross-functional teams and engaging both technical and non-technical stakeholders.

Proven skill in translating complex business requirements into scalable technical solutions and explaining technical details to non-technical audiences.Qualifications & Experience

Bachelor's degree in Computer Science or a related quantitative field, or equivalent practical industry experience.

Professional certification as a GCP Data Engineer or Cloud Architect is highly desirable.Randstad Technologies is acting as an Employment Business in relation to this vacancy