talk-data.com
YouTube
2022-07-19 at 16:48
Agile Data Engineering: Reliability and Continuous Delivery at Scale
Description
With businesses competing to deliver value while growing rapidly and adapting to changing markets, it is more important than ever for data teams to support faster and reliable insights. We need to fail fast, learn, adapt, release and repeat. For us, Trusted and unified data infrastructure with standardized practices is at the crux of it all
In this talk: we'll go over Atlassian's data engineering team organization, infrastructure and development practices
- Team organization and roles
- Overview of our data engineering technical stack
- Code repositories and CICD setup
- Testing framework
- Development walkthrough
- Production data quality & integrity
- Alerting & Monitoring
- Tracking operational metrics (SLI/SLO, Cost)
Connect with us: Website: https://databricks.com Facebook: https://www.facebook.com/databricksinc Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/data... Instagram: https://www.instagram.com/databricksinc/