Data Engineering Jobs in Basildon

• London
• £80,000 – £115,000 pa
• Senior
• Permanent

Hands-on engineering role migrating a Futures algorithmic trading platform's market data integration from the legacy LSEG/Refinitiv RFA to the Real-Time SDK (RTSDK). Involves analysing existing RFA integrations, developing Java applications and shared frameworks, and working with Futures and Options market data across exchanges while maintaining backward compatibility and trading workflows.

LSEG · Refinitiv · RFA +2

• London
• Hybrid · 1 day in office
• £500 pd
• Senior
• Contract

Hands-on senior engineer maintaining and developing data pipelines within a Measurement Innovation Team, focused on automating campaign measurement. Work includes GCP and BigQuery pipelines, privacy-safe joins via BigQuery and Snowflake clean rooms, cloud migration and security, plus some AWS. Day-to-day use of AI coding agents such as Claude Code is expected, alongside direct collaboration with external partners' data teams and internal stakeholders.

GCP · BigQuery · Snowflake +2

• London
• £75,000 – £90,000 pa
• Mid-level
• Permanent

Builds and operates an Azure Databricks platform supporting analytics, customer insight and AI, owning infrastructure, tooling and integrations. Manages Azure resources via Terraform, configures Databricks workspaces, Unity Catalog and networking, and maintains CI/CD with GitHub Actions. Also handles monitoring, incident response, security and cost efficiency while supporting data engineers and AI teams.

Azure Databricks · Terraform · GitHub Actions +7

• London

Design, build and own a generalized reporting system that generates business-critical outputs from a backend data platform for a global prime brokerage and financing business. The role demands deep ownership of correctness, reliability and performance, with tight SLO workflows on scheduling systems and heavy Python, Pandas and SQL work across Snowflake and Postgres.

Datadog · Grafana · Prometheus +5

• London

Build a greenfield research and trading platform from scratch within a pod-like team at a prop trading firm, working on GPU-heavy distributed training and MapReduce-style systems. The role centres on Ray, Spark, Dask, Databricks/Anyscale and Kubernetes for ML clusters, with strong autonomy to shape direction early in a deep learning-first environment.

Ray · Spark · Dask +6

• Harlow
• Hybrid · 2 days in office
• £65,000 – £65,001 pa
• Mid-level
• Permanent

Support and maintain a global aerospace and defence organisation's SAP BW landscape, administering Process Chains, resolving data-load failures and troubleshooting system and performance issues. The role spans data warehousing, data management and database design, working two days a week on-site in Harlow or Glenrothes within the ERP BW development team.

SAP BW · SAP

• London
• Hybrid · 2 days in office
• Lead · manages people

Lead a data engineering team, setting technical direction and mentoring developers while driving solution design and stakeholder decisions. Day-to-day involves monitoring delivery against plans, ensuring scalability and performance, and promoting software engineering best practices including AI-based development. Requires SQL, Python, microservices and test-driven development experience.

Git

• London
• Mid-level
• Contract

Lead the shift from manual to automated processing across a Lloyd's insurer's Consortium and Facility business, designing scalable data pipelines that deliver bordereaux and feeds to follow markets. Hands-on role automating fee and profit commission calculations, including Consortia fees and Coverholder commissions, while maintaining Power BI reporting and working with underwriting, finance and operations teams.

Microsoft SQL Server · Power BI · Azure +2