AWS Data Engineer (Active SC)

AWS Data Engineer (Active SC)

Full time/ perm

Our client is seekingSecurity Cleared AWS Data Engineers at all levels to design, build, and support scalable cloud-based data solutions. You will develop robust data pipelines, automate workflows, and deliver secure, high-performance data platforms using AWS-native technologies.

Key Responsibilities

• Develop and maintain data pipelines usingPython,SQL, andApache Airflow.
• Build and manage containerised data applications usingDocker.
• Design and optimise solutions using AWS services includingRedshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
• Implement CI/CD pipelines usingGitLab or similar tools.
• Monitor, troubleshoot, and improve data pipeline performance and reliability.
• Collaborate with cross-functional teams to deliver secure and scalable data platforms.
• Ensure adherence to data governance, security, and best practice standards.

Essential Skills

• Active Security Clearance
• Strong experience withPython andSQL.
• Hands-on experience withApache Airflow andDocker.
• Proven experience with AWS data services, includingRedshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
• Experience withGit,GitLab, and CI/CD pipelines.
• Understanding of AWS security best practices, IAM, and RBAC.

Desirable Skills

• Experience withAthena, SQS, CloudWatch, CloudTrail, or EMR.
• Knowledge ofTerraform orCloudFormation.
• Experience in consultancy or client-facing environments.

Personal Attributes

• Strong problem-solving and troubleshooting skills.
• Excellent communication and stakeholder management abilities.
• Collaborative approach and experience working in Agile teams.
• Proactive mindset with a focus on continuous improvement.