Data Engineer

Get AI-powered advice on this job and more exclusive features.

We are looking for an experienced Data Engineer to join us as an individual contributor within the Data Engineering team at Hanson Wade. This role will involve developing and maintaining Hanson Wade Group’s Data Platform system.

• 
  
• Build and maintain the existing Databricks infrastructure.
  
• Create and maintain efficient data pipelines integrating various sources and destinations.
  
• Use infrastructure‑as‑code to support continuous delivery.
  
• Establish monitoring and incident response procedures.
  
• Collaborate with stakeholders to improve deliverability.
  

• 
  
• Excellent knowledge of the Databricks Platform with commercial experience.
  
• Expertise in efficient Python coding.
  
• Strong SQL skills with SQL Server and Postgres.
  
• Experience with Python data libraries such as Pandas/Polars, Requests, SQLAlchemy, Beautiful Soup.
  
• Batch and streaming experience with Apache Spark (PySpark).
  
• Proficiency in Git (GitHub).
  
• Continuous integration and deployment using bash, Python scripts, and GitHub Actions.
  
• Data quality testing (manual and automated).
  
• Experience with Linux VMs (Ubuntu) and WSL.
  
• Knowledge of security best practices, tools, and documentation standards.
  

• 
  
• Experience with Airbyte and custom connectors.
  
• Terraform modules for Databricks, Azure services, and Airbyte.
  
• Agile methodology (Kanban, Scrum).
  
• Microsoft Azure (Functions, Storage, Key Vault).
  
• Terraform for IaaC and Azure Kubernetes Services.
  

• 
  
• Private health and life insurance.
  
• Hybrid working arrangement – 1/2 days per week in the London office.
  
• 1 extra day of annual leave per year (up to 30 days).
  
• Access to the Wader Hub benefits platform (retail, gym, hospitality, wellness discounts).
  
• Volunteer days.
  
• Professional education sponsorship.
  
• Individual career coaching.
  

Salary: £60,000 – £65,000 + Bonus

You must have the right to work in the UK and be living in the UK to be considered for this role.

Please be aware of scams! We have been made aware that individuals are falsely representing themselves as recruiters from Hanson Wade Group to deceive job seekers. These scammers may use false adverts, contact you via email, WhatsApp, or other messaging platforms, offering fake job opportunities and requesting personal information or payments. All legitimate communications from Hanson Wade Group will come from our official email addresses ending in @hansonwade.com. We will never ask for payment or personal financial information during the recruitment process.