Software Developer

Job Advertisement: Software Developer / Senior Data Engineer

Location: London

Contract Length: 12 Months

Daily Rate: £700 (Umbrella)

Are you ready to be part of a transformative journey? Our client is embarking on a major enterprise-wide data platform transformation, and they need a talented Software Developer / Senior Data Engineer to join their dynamic team!

About the Role:

You will play a pivotal role in designing and building a state-of-the-art data platform that consolidates data from various business areas into a centralised environment for reporting, analytics, and business consumption. This is your opportunity to contribute significantly as the project progresses towards crucial go-live milestones between March and June 2027!

Key Responsibilities:

Design & Build: Create and maintain scalable data pipelines using Python and SQL.

Optimise Solutions: Develop, optimise, and support enterprise data platform solutions.

Data Integration: Build and manage data ingestion, transformation, and integration processes.

Infrastructure Management: Create and maintain data models, tables, and supporting infrastructure within Databricks and associated data lake/lakehouse environments.

Business Logic Development: Implement business logic, calculations, and data processing solutions using Python.

Collaboration: Work closely with business stakeholders and engineering teams to deliver high-quality data assets.

Quality Assurance: Ensure data quality, performance, scalability, and governance standards are met.

Documentation: Produce technical documentation, architecture artefacts, and data flow specifications.

Performance Improvement: Identify and resolve performance bottlenecks across pipelines and processing workflows.

Required Skills & Experience:

Essential:

Strong commercial experience in Python development.

Proficient in SQL, including query optimisation and data modelling.

Hands-on experience with Databricks.

Proven track record in designing and building enterprise data platforms.

Experience in developing ETL/ELT pipelines and data integration solutions.

Strong understanding of data lakes and lakehouse architectures.

Experience working with large-scale datasets and modern data engineering practises.

Ability to design and deliver end-to-end data solutions.

Strong analytical and problem-solving skills.

Excellent stakeholder management and communication skills.

Highly Desirable:

Experience with Spark / PySpark.

Familiarity with Azure Data Lake, Snowflake, or similar platforms.

Knowledge of orchestration tools like Airflow or Azure Data Factory.

Exposure to financial services environments.

Experience supporting large-scale data transformation or migration programmes.

What We're Looking For:

A senior-level contractor who can hit the ground running.

Someone comfortable working autonomously with minimal oversight.

Proven experience in delivering long-term contract engagements (12 months or longer).

Strong interpersonal skills with a team-oriented approach.

Immediate availability or able to start quickly.

Key Deliverables:

Delivery of scalable, reliable, and performant data pipelines.

Development of robust data models and platform structures.

Successful implementation of data engineering solutions that support the enterprise data platform.

High-quality data assets for reporting, analytics, and business consumption.

Contribution to platform go-live milestones between March and June 2027.

Join our client and be part of something big! If you are ready to take on a challenging and rewarding role, we want to hear from you! Apply now and help shape the future of data