Data Engineer – GCP/DSS

Hammersmith Broadway
1 month ago
Create job alert

Job Title: Data Engineer – GCP/DSS

Department: Enabling Functions

Location: Hybrid, London

Type: Both Contract (Inside IR35) & Permanent available

Salary: Competitive; depends on experience and open to discussion

Purpose of Job

What you will be working on

While our broker platform is the core technology crucial to success – this role will focus on supporting the middle/back-office operations that will lay the foundations for further and sustained success.

We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact solutions – we favour a highly iterative, analytical approach.

You will be designing and developing complex data processing modules and reporting using Big Query and Tableau. In addition, you will also work closely with the Infrastructure/Platform Team, responsible for architecting and operating the core of the Data Analytics platform.

Principle Accountabilities

Work with both the business teams (finance and actuary initially), data scientists and engineers to design, build, optimise and maintain production grade data pipelines and reporting from an internal Data warehouse solution, based on GCP/Big Query.

Work with finance, actuaries, data scientists and engineers to understand how we can make best use of new internal and external data sources.

Work with our delivery partners at EY/IBM to ensure robustness of design and engineering of the data model/MI and reporting which can support our ambitions for growth and scale.

BAU ownership of data models, reporting and integrations/pipelines.

Create frameworks, infrastructure and systems to manage and govern data assets.

Produce detailed documentation to allow ongoing BAU support and maintenance of data structures, schema, reporting etc.

Work with the broader Engineering community to develop our data and MLOps capability infrastructure.

Ensure data quality, governance, and compliance with internal and external standards.

Monitor and troubleshoot data pipeline issues, ensuring reliability and accuracy

Regulatory Conduct and Rules

  1. Act with integrity

  2. Act with due skill, care and diligence

  3. Be open and co-operative with Lloyd’s, the FCA, the PRA, and other regulators

  4. Pay due regard to the interests of customers and treat them fairly

  5. Observe proper standards of market conduct

    Education, Qualifications, Knowledge, Skills and Experience

  • Experience designing data models and developing industrialised data pipelines.

  • Strong knowledge of database and data lake systems.

  • Hands-on experience in Big Query, dbt, GCP cloud storage.

  • Proficient in Python, SQL and Terraform.

  • Knowledge of Cloud SQL, Airbyte, Dagster.

  • Comfortable with shell scripting with Bash or similar.

  • Experience provisioning new infrastructure in a leading cloud provider, preferably GCP.

  • Proficient with Tableau Cloud for data visualization and reporting.

  • Experience creating DataOps pipelines.

  • Comfortable working in an Agile environment, actively participating in approaches such as Scrum or Kanban

    Desirable Skills

    Experience of streaming data systems and frameworks would be a plus.

    Experience working in regulated industry, especially financial services, would be a plus.

    Experience creating MLOps pipelines is a plus

    The applicant must also demonstrate the following skills and abilities

    Excellent communication skills (both oral and written).

    Pro-active, self-motivated and able to use own initiative.

    Excellent analytical and technical skills.

    Ability to quickly comprehend the functions and capabilities of new technologies.

    Ability to offer balanced opinion regarding existing and future technologies.

    How to Apply

    If you are interested in the Data Engineer – GCP/DSS position, please apply here

Related Jobs

View all jobs

GCP Data Engineer

Data Engineer

Principal Data Engineer

Data Engineer

Lead Data Engineer

Lead Data Engineer (Azure)

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Thinking about switching into data engineering in your 30s, 40s or 50s? You’re not alone. In the UK, companies of all sizes — from fintechs to government agencies, retailers to healthcare providers — are building data teams to turn vast amounts of information into insight and value. That means demand for data engineering talent remains strong, but there’s a gap between media hype and the real pathways available to mid-career professionals. This guide gives you the straight UK reality check: which data engineering roles are genuinely open to career switchers, what skills employers actually look for, how long retraining really takes and how to position your experience for success.

How to Write a Data Engineering Job Ad That Attracts the Right People

Data engineering is the backbone of modern data-driven organisations. From analytics and machine learning to business intelligence and real-time platforms, data engineers build the pipelines, platforms and infrastructure that make data usable at scale. Yet many employers struggle to attract the right data engineering candidates. Job adverts often generate high application volumes, but few applicants have the practical skills needed to build and maintain production-grade data systems. At the same time, experienced data engineers skip over adverts that feel vague, unrealistic or misaligned with real-world data engineering work. In most cases, the issue is not a shortage of talent — it is the quality and clarity of the job advert. Data engineers are pragmatic, technically rigorous and highly selective. A poorly written job ad signals immature data practices and unclear expectations. A well-written one signals strong engineering culture and serious intent. This guide explains how to write a data engineering job ad that attracts the right people, improves applicant quality and positions your organisation as a credible data employer.

Maths for Data Engineering Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are applying for data engineering jobs in the UK, maths can feel like a vague requirement hiding behind phrases like “strong analytical skills”, “performance mindset” or “ability to reason about systems”. Most of the time, hiring managers are not looking for advanced theory. They want confidence with the handful of maths topics that show up in real pipelines: Rates, units & estimation (throughput, cost, latency, storage growth) Statistics for data quality & observability (distributions, percentiles, outliers, variance) Probability for streaming, sampling & approximate results (sketches like HyperLogLog++ & the logic behind false positives) Discrete maths for DAGs, partitioning & systems thinking (graphs, complexity, hashing) Optimisation intuition for SQL plans & Spark performance (joins, shuffles, partition strategy, “what is the bottleneck”) This article is written for UK job seekers targeting roles like Data Engineer, Analytics Engineer, Platform Data Engineer, Data Warehouse Engineer, Streaming Data Engineer or DataOps Engineer.