Data Engineer

BLAZECORP PTE. LTD.
Penarth
4 days ago
Create job alert
Job Overview

As Data Engineer, you willsupport Data Engineering team in setting up the Data Lake on Cloud and theimplementation of standardized Data Model, single view of customer.

You will develop data pipelinesfor new sources, data transformations within the Data Lake, implementingGRAPHQL, work on NO SQL Database, CI/CD and data delivery as per the businessrequirements.

Responsibilities
  • Buildpipelines to bring in wide variety of data from multiple sources withinthe organization as well as from social media and public data sources.
  • Collaboratewith cross functional teams to source data and make it available fordownstream consumption.
  • Workwith the team to provide an effective solution design to meet businessneeds.
  • Ensureregular communication with key stakeholders, understand any key concernsin how the initiative is being delivered or any risks/issues that haveeither not yet been identified or are not being progressed.
  • Ensuredependencies and challenges (risks) are escalated and managed. Escalatecritical issues to the Sponsor and/or Head of Data Engineering team.
  • Ensuretimelines (milestones, decisions and delivery) are managed and achieved,without compromising quality and within budget.
  • Ensurean appropriate and coordinated communications plan is in place forinitiative execution and delivery, both internal and external.
  • Ensurefinal handover of initiative to business-as-usual processes, carry out apost implementation review (as necessary) to ensure initiative objectiveshave been delivered, and any lessons learnt are included in futureprocesses.
Qualifications

Who we are looking for:

Competencies & PersonalTraits

  • Expertise in Databricks
  • Experience with at least one Cloud Infra provider (Azure/AWS)
  • Experiencein building data pipelines using batch processing with Apache Spark (SparkSQL, Dataframe API) or Hive query language (HQL)
  • Experiencein building streaming data pipeline using Apache Spark StructuredStreaming or Apache Flink on Kafka & Data Lake
  • Knowledge of NOSQL databases.
  • Expertise in Cosmos DB, Restful APIs and GraphQL
  • Knowledge of Big data ETL processing tools, Datamodelling and Data mapping.
  • ExperiencewithHive and Hadoop file formats (Avro / Parquet / ORC)
  • Basicknowledge of scripting (shell / bash)
  • Experienceof working with multiple data sources including relational databases (SQLServer / Oracle / DB2 / Netezza), NoSQL / document databases, flat files
  • Experiencewith CI CD tools such as Jenkins, JIRA, Bitbucket, Artifactory, Bamboo andAzure Dev-ops.
  • Basicunderstanding of DevOps practices using Git version control
  • Abilityto debug, fine tune and optimize large scale data processing jobs
  • Excellentproblem analysis skills
Experience
  • 5+years (no upper limit) of experience working with Enterprise ITapplications in cloud platform and big data environments.
Professional Qualifications

Certifications related to Dataand Analytics would be an added advantage


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

What Hiring Managers Look for First in Data Engineering Job Applications (UK Guide)

If you’re applying for data engineering jobs in the UK, the first thing to understand is this: Hiring managers don’t read every word of your CV. They scan it. They look for signals of relevance, credibility, delivery and collaboration — and if they don’t see the right signals quickly, your application may never get a second look. In data engineering, hiring managers are especially focused on whether you can build and operate reliable, scalable data systems, handle real-world data challenges and work effectively with analytics, BI, data science and engineering teams. This guide breaks down exactly what they look at first in your application — and how to shape your CV, portfolio and cover letter so you stand out.

The Skills Gap in Data Engineering Jobs: What Universities Aren’t Teaching

Data engineering has quietly become one of the most critical roles in the modern technology stack. While data science and AI often receive the spotlight, data engineers are the professionals who design, build and maintain the systems that make data usable at scale. Across the UK, demand for data engineers continues to rise. Organisations in finance, retail, healthcare, government, media and technology all report difficulty hiring candidates with the right skills. Salaries remain strong, and experienced professionals are in short supply. Yet despite this demand, many graduates with degrees in computer science, data science or related disciplines struggle to secure data engineering roles. The reason is not academic ability. It is a persistent skills gap between university education and real-world data engineering work. This article explores that gap in depth: what universities teach well, what they consistently miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data engineering.

Data Engineering Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Thinking about switching into data engineering in your 30s, 40s or 50s? You’re not alone. In the UK, companies of all sizes — from fintechs to government agencies, retailers to healthcare providers — are building data teams to turn vast amounts of information into insight and value. That means demand for data engineering talent remains strong, but there’s a gap between media hype and the real pathways available to mid-career professionals. This guide gives you the straight UK reality check: which data engineering roles are genuinely open to career switchers, what skills employers actually look for, how long retraining really takes and how to position your experience for success.