How uoguelph-mlrg/massid45 works
MassID45 combines insect imagery and DNA data with annotation, image preprocessing, and model training/inference. The principal image workflow downloads bulk images and annotation tiles, assembles annotations into full-image COCO data, crops excess areas, slices images for training, and postprocesses sliced annotations. The README documents this stage order; source excerpts show processing details for the core scripts. Model and annotation submodules are represented at their tree paths because their internals were not sampled.
Main entry points: postprocess_dataset.py Annotation postprocessing · pipeline.sh Preprocessing runner · download_data.py Image download · assemble_annotations.py Annotation assembly
Components 19
Data acquisition
- Image download
image_preprocessing/download_data.py - ENA download scripts
image_preprocessing/ENA_sequence_scripts
Image preparation
- Annotation tiles
image_preprocessing/assets/annots_20250307_coco.json - Annotation assembly
image_preprocessing/assemble_annotations.py - Bulk image cropping
image_preprocessing/crop_bulk_imgs.py - Image tiling
image_preprocessing/tile_imgs.py - Annotation postprocessing
image_preprocessing/postprocess_dataset.py - Polygon analysis
image_preprocessing/analyze_invalid_polygons.py - Preprocessing runner
image_preprocessing/pipeline.sh
Annotation utilities
- Annotation utilities
arth-imrec
Model workflows
- CutLER
CutLER - Mask R-CNN
Mask-RCNN - Mask2Former
Mask2Former - MaskDINO
MaskDINO - Grounded-SAM-2
Grounded-SAM-2
Other components
- Dataset users
- Bulk imagery
- ENA sequences
- Annotators
Connections 20
- Dataset users → Image download: request data
README.md - Bulk imagery → Image download: download imagery
image_preprocessing/download_data.py - Image download → Annotation assembly: provide images
README.md - Annotation tiles → Annotation assembly: supply annotations
README.md - Annotation assembly → Bulk image cropping: prepare COCO data
README.md - Bulk image cropping → Image tiling: provide cropped data
README.md - Image tiling → Annotation postprocessing: provide sliced annotations
README.md - Annotation postprocessing → Polygon analysis: validate polygons
- Preprocessing runner → Image download: run pipeline
- Preprocessing runner → Annotation assembly: run pipeline
- Preprocessing runner → Bulk image cropping: run pipeline
- Preprocessing runner → Image tiling: run pipeline
- Preprocessing runner → Annotation postprocessing: run pipeline
- ENA sequences → ENA download scripts: provide sequences
README.md - Annotators → Annotation utilities: use annotation tools
README.md - Annotation postprocessing → CutLER: supply dataset
- Annotation postprocessing → Mask R-CNN: supply dataset
- Annotation postprocessing → Mask2Former: supply dataset
- Annotation postprocessing → MaskDINO: supply dataset
- Annotation postprocessing → Grounded-SAM-2: supply dataset