This presentation highlights practical validation techniques to prevent misconfigurations and enhance reliability in Apache Airflow environments. We cover two key safeguards: validating that sensors are correctly tied to their upstream tasks, and checking that critical DAGs have PagerDuty alerting enabled. Both validations are automated and integrated into our CI/CD pipeline using GitHub Actions, ensuring continuous enforcement and early detection of potential issues before deployment. In addition, we’ve implemented a solution to track Service Level Objectives (SLOs) for our DAGs, enabling better insight into reliability and performance over time. These checks form a practical defense against operational blind spots, promoting workflow reliability and robust incident response. Join us as we uncover practical strategies to streamline workflow monitoring and enhance system resilience using Apache Airflow's robust capabilities.
talk-data.com
Topic
github actions
1
tagged
Activity Trend
1
peak/qtr
2020-Q1
2026-Q1
Top Events
DevOps Workshop: Get Started with CI/CD for AWS using Pulumi & GitHub Actions
1
Predicting Financial Time-Series
1
DevOps Workshop: Get started with CI/CD for AWS using Pulumi & GitHub Actions
1
DevOps Workshop: Get started with CI/CD for AWS using Pulumi & GitHub Actions
1
Améliorer les performances et réduire la consommation de la CI/CD
1
Berlin Apache Airflow Meetup at GetYourGuide!
1
Accelerating Infrastructure Automation with Microsoft Fabric and Terraform
1
Accelerating Infrastructure Automation with Microsoft Fabric and Terraform
1
Accelerating Infrastructure Automation with Microsoft Fabric and Terraform
1
BLN DevOps February edition #45
1
BLN DevOps Sept edition #47
1
Filtering by:
Robert Bemmann
×