How databricks-academy/workspace-setup works
This repository provides scripts and Databricks notebooks for preparing training workspaces, including Universal, CloudLabs, DAIS, and Vocareum variants. The main workflow configures workspace resources and permissions, then installs courseware or datasets; CloudLabs additionally provisions a workspace and launches a setup job. The shared REST client handles authenticated Databricks API calls. README and excerpts support these capabilities, but unsampled notebook sections leave some implementation details unverified.
Main entry points: universal-workspace-setup.py Universal Setup · cloudlabs-setup-script.py CloudLabs Provisioner · cloudlabs-job-script.py Job Deploy Runner · simplified_rest_client.py REST Client
Components 16
Workspace Setup
- Universal Setup
universal-workspace-setup.py - DAIS Setup
CloudLabs/DAIS-2023-Workspace-Setup.py - Vocareum Setup
Vocareum/Workspace-Setup-LLM-MOOC.py - Workspace Resources
universal-workspace-setup.py - Courseware Install
CloudLabs/DAIS-2023-Workspace-Setup.py - Dataset Install
universal-workspace-setup.py
CloudLabs Provisioning
- CloudLabs Provisioner
CloudLabs/cloudlabs-setup-script.py - Job Deploy Runner
CloudLabs/cloudlabs-job-script.py - Cluster Policy Deploy
CloudLabs/cluster-policies.py - Workspace Inspector
CloudLabs/cloudlabs-check-config-script.py - DAIS Job Validator
src/workspace_setup/cloudlabs/validate-dais-workspace-setup.py
API Client
- REST Client
CloudLabs/simplified_rest_client.py
Other components
- Workspace Operator
- Databricks Workspace
- Job Configuration
CloudLabs/cloudlabs-job-config.json - DAIS Job Configuration
CloudLabs/dais-job-config.json
Connections 23
- Workspace Operator → Universal Setup: runs setup
universal-workspace-setup.py - Workspace Operator → DAIS Setup: runs setup
CloudLabs/DAIS-2023-Workspace-Setup.py - Workspace Operator → Vocareum Setup: runs setup
Vocareum/Workspace-Setup-LLM-MOOC.py - Workspace Operator → CloudLabs Provisioner: starts provisioning
CloudLabs/cloudlabs-setup-script.py - Universal Setup → Workspace Resources: configures
universal-workspace-setup.py - Universal Setup → Dataset Install: installs
universal-workspace-setup.py - Universal Setup → Courseware Install: installs
- DAIS Setup → Workspace Resources: configures
CloudLabs/DAIS-2023-Workspace-Setup.py - DAIS Setup → Courseware Install: installs
CloudLabs/DAIS-2023-Workspace-Setup.py - Vocareum Setup → Workspace Resources: configures
Vocareum/Workspace-Setup-LLM-MOOC.py - Vocareum Setup → Courseware Install: preinstalls
Vocareum/Workspace-Setup-LLM-MOOC.py - CloudLabs Provisioner → REST Client: calls
CloudLabs/cloudlabs-setup-script.py - CloudLabs Provisioner → Databricks Workspace: provisions via API
CloudLabs/cloudlabs-setup-script.py - CloudLabs Provisioner → Job Deploy Runner: creates and runs job
CloudLabs/cloudlabs-setup-script.py - Job Deploy Runner → REST Client: calls
CloudLabs/cloudlabs-job-script.py - Job Deploy Runner → Job Configuration: downloads and parses
CloudLabs/cloudlabs-job-script.py - Job Deploy Runner → Databricks Workspace: creates and monitors job
CloudLabs/cloudlabs-job-script.py - Cluster Policy Deploy → REST Client: calls
CloudLabs/cluster-policies.py - Cluster Policy Deploy → Databricks Workspace: creates cluster
CloudLabs/cluster-policies.py - Workspace Inspector → REST Client: calls
CloudLabs/cloudlabs-check-config-script.py - Workspace Inspector → Databricks Workspace: reads configuration
CloudLabs/cloudlabs-check-config-script.py - DAIS Job Validator → DAIS Job Configuration: downloads and transforms
src/workspace_setup/cloudlabs/validate-dais-workspace-setup.py - DAIS Job Validator → Databricks Workspace: creates job
src/workspace_setup/cloudlabs/validate-dais-workspace-setup.py