How cyj407/diss works
Project type and purpose
• This is a deep‑learning research codebase implementing “DiSS,” a diffusion‑based image‑generation framework with both training/fine‑tuning pipelines and a user‑facing web interface.
• The core use cases are:
• Training diffusion models on stroke/sketch datasets
• Generating images from stroke/sketch (via CLI scripts or a Flask web UI)
• Multi‑condition editing and multimodal sampling
File structure
• Top‑level:
• app.py + static/ → Flask web server + front‑end
• train.py, finetune.py, sample.py, guided editing scripts → CLI entrypoints for training/sampling
• guided_diffusion/ → core diffusion model library (OpenAI guided‑diffusion fork)
• optimization/, utils/, img_process.py, resizer.py → data‑preprocessing, loss definitions, augmentation, helper modules
• diss_env.yaml → environment spec
• fig/, test‑examples/ → documentation assets & sample inputs
• Patterns:
• Layered: Web UI → CLI services → core model → GPU
• Modular: guided_diffusion as a packaged dependency, separate optimization and utils
Key insights from README
• Python 3.6+, PyTorch 1.4+
• Single Flask endpoint serving a canvas and invoking the model
• Training pipelines using standardized MODEL_FLAGS, DIFFUSION_FLAGS, TRAIN_FLAGS
• Checkpoints stored under ./checkpoints/
• Dependencies on external repos (guided‑diffusion, ResizeRight, etc.)