How databricks-academy/spark-ui-simulator works
This repository is an educational Spark UI simulator: learners open an experiment, explore a limited interactive representation of a recorded Spark application, and review its source and cluster/job configuration. Experiments are distinct scenarios with versioned Python or Scala implementations and UI configuration for stages, jobs, SQL, streams, and storage. The supplied tree omits the HTML interfaces and README-mentioned screenshots, so their internal wiring and exact entrypoint paths cannot be verified; the graph shows only the documented workflow and paths present in the tree.
Main entry points: v002-S Recorded experiment · common-ui Interactive Spark UI · source-code.scala Spark job source · stages-config.js Stage configuration
Components 11
Learning experience
- Experiment menu
- Interactive Spark UI
common-ui
Experiment scenarios
- Recorded experiment
experiment-6732/v002-S
Scenario materials
- Spark job source
experiment-6732/v002-S/source-code.scala - Stage configuration
experiment-6732/v002-S/_config/stages-config.js - Job configuration
experiment-6732/v002-S/_config/jobs-config.js - SQL configuration
experiment-6732/v002-S/_config/sql-config.js - Stream configuration
experiment-6732/v002-S/_config/stream-config.js - Storage configuration
experiment-6732/v002-S/_config/storage-config.js - Cluster settings
experiment-6732/v002-S/_config/experiment.js
Other components
- Learner
Connections 10
- Learner → Experiment menu: opens
- Experiment menu → Recorded experiment: selects scenario
- Recorded experiment → Interactive Spark UI: presents UI
- Recorded experiment → Spark job source: includes source
- Recorded experiment → Stage configuration: configures stages
- Recorded experiment → Job configuration: configures jobs
- Recorded experiment → SQL configuration: configures SQL
- Recorded experiment → Stream configuration: configures streams
- Recorded experiment → Storage configuration: configures storage
- Recorded experiment → Cluster settings: specifies cluster