At Rivian, we have automated more than 95% of our Databricks resource provisioning workflows using an in-house Terraform module, affording us a lean admin team to manage over 750 users. In this session, we will cover the following elements of our approach and how others can benefit from improved team efficiency.
- User and service principal management
- Our permission model on Unity Catalog for data governance
- Workspace and secrets resource management
- Managing internal package dependencies using init scripts
- Facilitating dashboards, SQL queries and their associated permissions
- Scaling source of truth Petabyte scale Delta Lake table ingestion jobs and workflows
Talk by: Jason Shiverick and Vadivel Selvaraj
Connect with us: Website: https://databricks.com Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/databricks Instagram: https://www.instagram.com/databricksinc Facebook: https://www.facebook.com/databricksinc