How hitachinsk/fgt works
This repository implements flow-guided video inpainting, with object removal, watermark removal, and video extrapolation modes. The user supplies video frames and masks; the inference tool prepares flows, completes corrupted flows with LAFC, then uses FGT to fill missing video content and saves results. Training is a separate documented two-stage workflow: train LAFC, then FGT. The graph preserves the documented flow-completion and transformer stages; source excerpts are partial, so some runtime links rely on README statements rather than inspected call sites.
Main entry points: video_inpainting.py Inpainting CLI · model.py FGT Transformer · LAFC/trainer.py LAFC Trainer · FGT/trainer.py FGT Trainer
Components 20
Inference Workflow
- Inpainting CLI
tool/video_inpainting.py - Frames and Masks
FGT/inputs.py - Completed Video
tool/video_inpainting.py
Flow Completion
- LAFC Completion
LAFC/models/lafc.py - Flow Dataset
LAFC/data/train_dataset_edge.py - Flow Losses
LAFC/models/utils/flow_losses.py - Flow Region Fill
FGT/data/util/flow_utils/region_fill.py
FGT Inpainting
- FGT Transformer
FGT/models/model.py - Flow-Guided Attention
FGT/models/transformer_base/attention_flow.py - Temporal Attention
FGT/models/transformer_base/attention_base.py - Transformer Feedforward
FGT/models/transformer_base/ffn_base.py
Training and Evaluation
- Video Training Data
FGT/data/train_dataset.py - FGT Trainer
FGT/trainer.py - FGT Training Network
FGT/networks/network.py - LAFC Trainer
LAFC/trainer.py - LAFC Training Network
LAFC/networks/network.py - Image Metrics
FGT/metrics/ssim.py
Optical Flow
- RAFT Estimator
RAFT/raft.py - Flow Extraction Tool
tool/flow_extract.py
Other components
- Video User
Connections 18
- Video User → Inpainting CLI: invokes
README.md - Inpainting CLI → Frames and Masks: loads inputs
README.md - Inpainting CLI → RAFT Estimator: estimates flow
- Flow Extraction Tool → RAFT Estimator: runs estimator
- Inpainting CLI → LAFC Completion: completes flow
README.md - Inpainting CLI → FGT Transformer: inpaints video
README.md - LAFC Completion → Flow Region Fill: fills flow regions
- FGT Transformer → Flow-Guided Attention: uses flow attention
FGT/models/model.py - FGT Transformer → Temporal Attention: uses temporal attention
FGT/models/model.py - FGT Transformer → Transformer Feedforward: uses feedforward
FGT/models/model.py - Inpainting CLI → Completed Video: saves results
README.md - LAFC Trainer → Flow Dataset: trains from
README.md - LAFC Training Network → LAFC Trainer: extends trainer
LAFC/networks/network.py - FGT Trainer → Video Training Data: loads batches
FGT/trainer.py - FGT Training Network → FGT Trainer: extends trainer
FGT/networks/network.py - FGT Training Network → Image Metrics: evaluates with
FGT/networks/network.py - Video User → Flow Extraction Tool: prepares training flow
README.md - LAFC Trainer → FGT Trainer: precedes stage
README.md