Data Engineer

Vortexa is a fast‑growing international technology company solving the information gap in the energy industry by using massive satellite data and AI to provide a real‑time view of global seaborne energy flows.

You will design, build, and maintain the data production pipeline that powers Vortexa’s core SaaS platform. This involves ingesting terabytes of heterogeneous data, training and running complex AI models, and serving predictions to customers worldwide.

• 
  
• Build and operate distributed, scalable data processing pipelines using AWS, Kubernetes, and Airflow.
  
• Integrate raw satellite data with text and market data to generate high‑value forecasts (destination, cargo, vessel traffic, congestion, prices, etc.).
  
• Automate data ingestion, feature engineering, model training, and deployment, ensuring 100 % uptime and fault‑tolerance.
  
• Collaborate closely with data scientists, software engineers, and market analysts to translate research into production‑ready solutions.
  
• Implement observability – logging, monitoring, and tracing – and improve pipeline performance and reliability.
  
• Coach and mentor junior team members, fostering a culture of continuous learning and technical excellence.
  

• 
  
• Experience building scalable backend pipelines that process terabytes of data daily.
  
• Strong software engineering fundamentals; fluency in Java and Python (knowledge of Rust is a plus).
  
• Hands‑on with data lake technologies (Athena, S3), big‑data formats (Parquet, ORC, HDF5), and distributed storage.
  
• Deep understanding of the full SDLC – design, code, review, test, deploy, and operations.
  

• 
  
• Experience with Apache Kafka, Flink, or similar streaming platforms.
  
• Background in web scraping and information extraction.
  
• Observability expertise: logging, monitoring, tracing.
  
• Knowledge of cloud native tools and infrastructure as code.
  

• 
  
• Equity options granted to all staff.
  
• Private health insurance via Vitality.
  
• Global volunteering programme.
  
• Flexible hybrid work: remote and in‑office options.
  
• Tech‑centric, fast‑moving environment that encourages ownership and experimentation.
  

• 
  
• Mid‑Senior level
  
• Full‑time
  
• Location: London, England, United Kingdom (remote options)