How isaac-art/cvec_web works
Web Server Layer
• Main entry point (main.py) should be highlighted
• Static file serving for HTML files (static/*.html)
Core Processing Components
• Repeng Library Integration (repeng folder)
• Control module (control.py)
• Extraction module (extract.py)
• SAES module (saes.py)
• Testing component (tests.py)
Worker System
• Separate worker process (run_worker.py)
• Training queue management
• Vector processing pipeline
Data Storage
• SQLite database (app.db)
• Model cache (HF_HOME reference)
External Dependencies
• Vector storage system
Use a layered architecture approach
• [Client Layer (Browser)]
• ↕
• [Web Server Layer (FastAPI)]
• ↕
• [Application Core]
• Vector Processing
• Control Logic
• Extraction System
• ↕
• [Worker Process]
• ↕
• [Storage Layer]
Component Relationships
• How the web interface communicates with the core processing
• Queue system between main server and worker
• Demonstrate data persistence flows
Repeng library integration
• Modular structure of the repeng package
• It to both the main server and worker process
Worker pipeline
• Queue intake
• Training process
• Vector storage
Database Interactions
• Connections to app.db
• Vector storage locations
• Cache management for HF models
Remember to:
• Use consistent symbols throughout
• Version information
• Document any important configuration dependencies (like HF_HOME)