Resilient systems have the capability to recover when stressed by load, bugs in the workflow, and failure of any task. Reliability of the infrastructure or platform is not sufficient to run workflows reliably. It is critical to bring in resiliency practices during the design and build phase of the workflow to improve reliability, performance and operational aspects of the workflow. In this session, We will go through Architecture of the Airflow through the lens of reliability Idempotency Designing for failures Applying back pressure Best practices What we do not cover: Infrastructure/Platform/Product reliability
talk-data.com
U
Speaker
Uma Ramadoss
1
talks
Amazon AWS, Specialist Solutions Architect on Serverless
Filtering by:
Airflow Summit 2022
×
Filter by Event / Source
Talks & appearances
Showing 1 of 2 activities