This talk covers an overview of Airflow as well as lessons learned of its implementation in a banking production environment which is Société Générale. It will be the summary of a two-year experience, a storytelling of an adventure within Société Générale in order to offer an internal cloud solution based on Airflow (AirflowaaS). I will cover the following points: As part of the search for an open source solution for the replacement of a proprietary orchestration suite, we carried out a study that allowed us to choose Apache Airflow as a solution, but why ? The different implementation models (HA, Scalability, ..) How to manage an Airflow platforms in production with 45,000 runs per month?
talk-data.com
A
Speaker
Alaeddine Maaoui
1
talks
Product Owner - Société Générale
Filtering by:
Airflow Summit 2020
×
Filter by Event / Source
Talks & appearances
Showing 1 of 4 activities