Data Engineer
DataEngineerLondon|Hybrid|Full-timeAreyouaskilledDataEngineereagertoworkwithhigh-volumedatasetsandcutting-edgetechnologies?We’relookingforadata-drivenprofessionaltodevelopandoptimiseascalabledataplatformthatsupportsadvancedanalyticsandquantitativeresearch.You’llplayakeyroleindesigningrobustdatapipelines,integratingreal-timefeeds,andensuringtheseamlessflowofstructuredandunstructureddata.Inthisrole,you'llberesponsibleforbuildingandmaintaininghigh-performancedatapipelinesthatprocesscomplexandlarge-scaledatasets.You'llworkcloselywithanalystsandresearcherstounderstandtheirdatarequirements,optimisingreal-timedataingestionbyintegratingexternalAPIsandalternativedatasources.Youwillfocusonenhancingthedataarchitecturetoimproveaccessibility,efficiency,andsecuritywhileautomatingETLworkflowstostreamlinedatamodellingandanalysis.You’llalsosupportevent-drivensystemsbyimplementingtechnologieslikeKafkaandProtobuf,ensuringseamlessdatastreamingandprocessing.Akeyaspectofyourrolewillbeimplementingrigorousqualityassurancemeasures,ensuringdataintegrityandconsistencyacrossallinputsandoutputs.Additionally,you'llcollaboratewithteamstosupportmachinelearningapplications,facilitatingdatapreparationformodeltraininganddeployment.WhatYou’llNeed3+yearsofexperienceinadataengineeringStrongproficiencyinPythonandRustHands-onexperiencewithAWScloud,Linux,andDocker.Expertiseindistributedcomputingframeworks(Ray,Dask,orApacheArrow).Stronganalyticalskills,withtheabilitytohandlelarge-scale,high-frequencydata.SolidunderstandingofETLpipelines,datamodelling,anddatabaseoptimisation.Experienceworkingwithreal-timestreamingtechnologiesThisisafantasticopportunitytobepartofafast-moving,data-drivenenvironmentwhereyourtechnicalexpertisewillhavearealimpact.You'llworkwithcutting-edgetools,collaboratewithtop-tierprofessionals,andcontributetotheefficiencyandinnovationofagrowingdatateam.Ifyou’rereadytotakeyourdataengineeringcareertothenextlevel,we’dlovetohearfromyou! #J-18808-Ljbffr