talk-data.com talk-data.com

YouTube 2022-07-19 at 16:48

Agile Data Engineering: Reliability and Continuous Delivery at Scale

Description

With businesses competing to deliver value while growing rapidly and adapting to changing markets, it is more important than ever for data teams to support faster and reliable insights. We need to fail fast, learn, adapt, release and repeat. For us, Trusted and unified data infrastructure with standardized practices is at the crux of it all

In this talk: we'll go over Atlassian's data engineering team organization, infrastructure and development practices

  • Team organization and roles
  • Overview of our data engineering technical stack
  • Code repositories and CICD setup
  • Testing framework
  • Development walkthrough
  • Production data quality & integrity
  • Alerting & Monitoring
  • Tracking operational metrics (SLI/SLO, Cost)

Connect with us: Website: https://databricks.com Facebook: https://www.facebook.com/databricksinc Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/data... Instagram: https://www.instagram.com/databricksinc/