AWS Data Engineer

Data Engineer - 14-Week Contract (Outside IR35) Likely to Extend

Start Date: 12th January
Rate: £350 per day
Location: Remote (UK-based)
Interview: Immediate - Offer before Christmas

We are seeking an experienced Data Engineer to join a 14-week project focused on building robust data pipelines and integrating complex data sources. This is an outside IR35 engagement, offering flexibility and autonomy.

Key Responsibilities

Design and implement ETL/ELT pipelines with strong error handling and retry logic.
Develop incremental data processing patterns for large-scale datasets.
Work with AWS services including Glue, Step Functions, S3, DynamoDB, Redshift, Lambda, and EventBridge.
Build and optimise vector database solutions and embedding generation pipelines for semantic search.
Implement document processing workflows (PDF parsing, OCR, metadata extraction).
Integrate data from REST APIs, PIM systems, and potentially SAP.
Ensure data quality, governance, and lineage tracking throughout the project.

Required Skills

ETL/ELT pipeline design and data validation frameworks.
Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation).
Experience with AWS Glue, Step Functions, and event-driven architectures.
Knowledge of vector databases, embeddings, and semantic search strategies.
Familiarity with document parsing libraries (PyPDF2, pdfplumber, Textract) and OCR tools.
Understanding of data governance, schema validation, and master data management.
Strong grasp of real-time vs batch processing trade-offs.

Beneficial Experience

CockroachDB deployment and management.
PySpark or similar for large-scale processing.
SAP data structures and PIM systems.
E-commerce and B2B data integration patterns.Why Apply?

Fully remote contract
Outside IR35
Competitive day rate
Immediate interviews - secure your next role before Christmas