How freim32/vllmops works
vllmops is a local control plane for bare-metal vLLM servers. Users declare models and profiles in YAML, then use the CLI or TUI to create and manage model processes, inspect health/logs/metrics, and optionally expose running models through a LiteLLM gateway. The graph highlights the shared service layer that backs both interfaces, plus diagnostics and TUI views. Some source was not sampled; edges are limited to README statements, shown calls, and SOURCE INDEX references.
Main entry points: app.py Live TUI · service.py Shared service · proxy.py Gateway management · cli.py CLI commands
Components 23
User interfaces
- CLI commands
src/vllmops/cli.py - Live TUI
src/vllmops/tui/app.py - GPU panel
src/vllmops/tui/widgets/gpu_panel.py - Metrics panel
src/vllmops/tui/widgets/metrics_panel.py - Log viewer
src/vllmops/tui/widgets/log_viewer.py - Log highlighter
src/vllmops/tui/widgets/highlighter.py - Models tree
src/vllmops/tui/widgets/models_tree.py - Metric formatting
src/vllmops/tui/widgets/_format.py - Errors panel
src/vllmops/tui/widgets/errors_panel.py - Progress bar
src/vllmops/tui/widgets/progress_bar.py
Project and catalog
- Project discovery
src/vllmops/project.py - Profiles and proxy settings
src/vllmops/project.py - Model YAML schema
src/vllmops/config.py - Config error summaries
src/vllmops/config_errors.py
Model runtime
- Shared service
src/vllmops/service.py - Process lifecycle
src/vllmops/lifecycle.py
Monitoring and diagnostics
- GPU stats reader
src/vllmops/gpu.py - Metrics scraper and history
src/vllmops/metrics.py - Environment doctor
src/vllmops/doctor.py
Proxy gateway
- Gateway management
src/vllmops/proxy.py
Other components
- Operator
- vLLM server
- LiteLLM gateway
Connections 38
- Operator → CLI commands: runs commands
README.md - Operator → Live TUI: opens dashboard
README.md - CLI commands → Shared service: invokes actions
src/vllmops/cli.py - CLI commands → Live TUI: launches
src/vllmops/cli.py - CLI commands → Environment doctor: runs checks
src/vllmops/cli.py - CLI commands → Gateway management: manages gateway
src/vllmops/cli.py - Live TUI → Shared service: reads and acts
src/vllmops/tui/app.py - Live TUI → GPU stats reader: queries stats
src/vllmops/tui/app.py - Live TUI → Metrics scraper and history: scrapes metrics
src/vllmops/tui/app.py - Live TUI → Gateway management: checks gateway
src/vllmops/tui/app.py - Project discovery → Profiles and proxy settings: loads
src/vllmops/project.py - Project discovery → Config error summaries: formats failures
src/vllmops/project.py - Model YAML schema → Project discovery: uses project names
src/vllmops/config.py - Shared service → Project discovery: uses project paths
src/vllmops/service.py - Shared service → Model YAML schema: loads model definitions
src/vllmops/service.py - Shared service → Process lifecycle: manages processes
src/vllmops/service.py - Shared service → vLLM server: spawns servers
README.md - vLLM server → Metrics scraper and history: serves metrics
README.md - Environment doctor → Shared service: checks catalog
src/vllmops/doctor.py - Environment doctor → GPU stats reader: checks GPU
src/vllmops/doctor.py - Environment doctor → Gateway management: checks executable
src/vllmops/doctor.py - Gateway management → Shared service: reads model catalog
src/vllmops/proxy.py - Gateway management → Project discovery: reads settings
src/vllmops/proxy.py - Gateway management → Process lifecycle: manages gateway process
src/vllmops/proxy.py - Profiles and proxy settings → Gateway management: configures gateway
README.md - Gateway management → LiteLLM gateway: starts gateway
README.md - LiteLLM gateway → vLLM server: routes requests
README.md - Live TUI → GPU panel: renders
- Live TUI → Metrics panel: renders
- Live TUI → Log viewer: renders
- Live TUI → Models tree: renders
- Live TUI → Errors panel: renders
- GPU panel → GPU stats reader: displays snapshots
src/vllmops/tui/widgets/gpu_panel.py - GPU panel → Metric formatting: formats values
src/vllmops/tui/widgets/gpu_panel.py - Metrics panel → Metrics scraper and history: renders history
src/vllmops/tui/widgets/metrics_panel.py - Metrics panel → Metric formatting: formats values
src/vllmops/tui/widgets/metrics_panel.py - Log viewer → Log highlighter: highlights output
src/vllmops/tui/widgets/log_viewer.py - Models tree → Shared service: uses catalog views
src/vllmops/tui/widgets/models_tree.py