Data Engineer

BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments.

Data Engineer — Location: London — Grade: GG10 - GG12

We offer a range of hybrid and flexible working arrangements — please speak to your recruiter about the options for this particular role.

• 
  
• Design, implement, and optimize robust ETL/ELT data pipelines using Apache Airflow as an orchestration tool.
  
• Build and manage data ingestion processes from internal systems and APIs, using tools like Kafka, Spark, or AWS native services.
  
• Develop and maintain data lakes and data warehouses (e.g., AWS S3 + Redshift).
  
• Ensure data quality, validation, and governance using automated testing tools.
  
• Monitor and debug data workflows, implement logging, alerting, and performance tuning.
  
• Handle schema evolution, partitioning, and efficient data modelling.
  
• Collaborate with DevOps to manage CI/CD pipelines for data deployments and ensure version control of DAGs and configs.
  
• Apply best practices in security and compliance, including data encryption, access control (IAM), and regulatory standards (GDPR).
  

• 
  
• Proficient in Python and SQL for data processing.
  
• Hands-on experience with Apache Airflow, writing Airflow DAGs and configuring Airflow jobs.
  
• Experience with AWS cloud platform and services like S3, Redshift.
  
• Familiarity with big data processing using Apache Spark.
  
• Knowledge of data modelling, schema design, and partitioning strategies.
  
• Understanding of batch vs streaming data paradigms and tools like Kafka.
  
• Experience of working with Docker or Kubernetes.
  

We work hard and often go the extra mile, but we recognise people’s efforts and that everyone has a life outside of work. We encourage people to speak up if they want to rotate to a new project.

As well as a competitive pension scheme, BAE Systems also offer employee share plan, an extensive range of flexible discounted health, wellbeing and lifestyle benefits including a green care scheme, private health plans and shopping discounts - you may also be eligible for an annual incentive.

This is a place where you’ll be able to make a real difference. You’ll be part of an inclusive culture which values diversity, rewards integrity and merit, and where you’ll be empowered to fulfil your potential. We welcome candidates from all backgrounds and particularly from sections of the community who are currently under-represented within our industry including women, ethnic minorities, people with disabilities and LGBTQ+ individuals.

We also want to make sure that our recruitment processes are as inclusive as possible. If you have a disability or health condition (for example dyslexia, autism, an anxiety disorder etc.) that may affect your performance in certain assessment types, please speak to your recruiter about potential reasonable adjustments.

Please be aware that many roles at BAE Systems are subject to both security and export control restrictions. These restrictions such as your nationality, any nationalities which you previously may have held and your place of birth can restrict the roles you are able to perform within the organisation.

All applicants must as a minimum achieve Baseline Personnel Security Standard. Many roles also require higher levels of National Security Vetting where applicants must typically have 5 to 10 years of continuous residency in the UK depending on the vetting level required for the role, to allow for meaningful security vetting checks.

We are embracing Hybrid Working. This means you and your colleagues may be working in different locations, such as from home, another BAE Systems office or client site, some or all of the time, and work might be going on at different times of the day.

By embracing technology, we can interact, collaborate and create together, even when we’re working remotely from one another. Hybrid Working allows for increased flexibility in when and where we work, helping us to balance our work and personal life more effectively, and enhance well-being.

Diversity and inclusion are integral to the success of BAE Systems Digital Intelligence. We are proud to have an organisational culture where employees with varying perspectives, skills, life experiences and backgrounds - the best and brightest minds - can work together to achieve excellence and realise individual and organisational potential.

When applying for this role you will be redirected to BAE systems careers site where you will be required to:

• 
  
• Register an account (this is optional, you can apply as a guest)
  
• Provide contact information
  
• Upload your cv
  
• Complete a short diversity & inclusion questionnaire
  

When asked source type, please select "job board advertisement" then "the IET / E+T Jobs"