At Rivian, we have automated more than 95% of our Databricks resource provisioning workflows using an in-house Terraform module, affording us a lean admin team to manage over 750 users. In this session, we will cover the following elements of our approach and how others can benefit from improved team efficiency.
– User and service principal management
– Our permission model on Unity Catalog for data governance
– Workspace and secrets resource management
– Managing internal package dependencies using init scripts
– Facilitating dashboards, SQL queries and their associated permissions
– Scaling source of truth Petabyte scale Delta Lake table ingestion jobs and workflows
Talk by: Jason Shiverick and Vadivel Selvaraj
Connect with us: Website: https://databricks.com
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc
Facebook: https://www.facebook.com/databricksinc
Add comment