How tiagodemay/vagrantcluster works
Project Type and Purpose
• This is an automated HPC cluster provisioning system using Vagrant and VirtualBox.
• Purpose: bootstrap a System Management Server (SMS) VM via Vagrant, generate OVA images, import and launch two compute-node VMs, and configure cluster services (Nagios, Ganglia, ClusterShell, NHC, xCAT sync).
Main Architectural Components
a. Host Machine (Ubuntu Desktop 22.04 LTS)
• Virtualization layer: VirtualBox
• Orchestration tool: Vagrant CLI + Vagrantfile
b. Provisioning Scripts (in project root)
• recipe.sh – orchestrates OS prep and software installs
• script01.sh – script04.sh – sequential setup of SMS
• add_your_user_slurm.sh, setenv.c – user/group and environment configuration
c. System Management Server (SMS) VM
• Base OS: CentOS 7.7 (downloaded by Vagrant)
• Installed services: Nagios, Ganglia, ClusterShell, NHC, xCAT sync
• Builds compute-node image via chroot → exports OVA files (openhpc-demo-client00.ova, …01.ova)
d. Compute-Node VMs
• Two clones imported from the generated OVA (compute00, compute01)
• Joined to cluster and managed by SMS
e. External Interfaces
• Vagrant SSH → user access to SMS VM
• vboxmanage CLI → import/start compute nodes
Component Relationships and Data Flows
1. On the Host, user runs “vagrant up”
↓
2. Vagrantfile invokes VirtualBox to spin up the SMS VM
↓
3. Provisioning scripts (recipe.sh, script0X.sh) run inside SMS VM via Vagrant’s provisioner
• Installs cluster management software
• Chroots into a fresh CentOS filesystem to assemble compute-node image
↓
4. SMS VM exports compute-node images as OVA files to Host filesystem
↓
5. Host runs “vboxmanage import openhpc-demo-client*.ova”
↓
6. Host starts compute-node VMs; they register back with SMS for job submission/monitoring
Architectural Patterns and Design Principles
• Infrastructure as Code: Vagrantfile + shell scripts for repeatable provisioning
• Immutable Infrastructure: compute-node images built by chroot and shipped as OVAs
• Separation of Concerns: one SMS VM handles management & image building; compute nodes remain lightweight
• Automation & Orchestration: Vagrant orchestrates VirtualBox and provisioning scripts
Technologies, Frameworks, Libraries
• Host OS: Ubuntu 22.04 LTS
• Virtualization: Oracle VirtualBox 7.x + Extension Pack
• Provisioner: Vagrant (HashiCorp)
• Guest OS: CentOS 7.7
• Cluster Tools: Nagios, Ganglia, ClusterShell, Node Health Check (NHC), xCAT file sync
• Shell / C: Bash scripts, setenv.c for environment setup
Essential Elements
• Host OS & virtualization stack
• Provisioning workflow (scripts + Vagrantfile)
• SMS VM: OS, cluster services, chroot image builder
• OVA artifacts (openhpc-demo-client00.ova, …01.ova)
• Compute nodes: two instances
• Data flows and orchestration commands