How kburdge/gc-variables-pipeline works
This is a JWST/NIRCam time-series photometry pipeline for finding and characterizing variable stars, then rebuilding a vetted catalog. Its main workflow downloads MAST exposures, performs pinned JWST detector calibration, builds high-cadence group-difference cubes, detects variables and extracts light curves, corrects photometry, searches periods, and constructs the catalog from human REAL/FAKE labels. Gaia-tied astrometry supports calibrated coordinates; demo and Segment 1 reproduction are additional capabilities. Several edges follow explicit README documentation; source excerpts show key stage behavior, but not all script wiring.
Main entry points: detector1.py Detector calibration · 00_download_mast.py Exposure download · extract.py Extraction orchestration · astrometry.py Gaia astrometry
Components 22
Data acquisition
- Exposure download
scripts/00_download_mast.py - Pipeline configuration
pipeline/config.py
Image processing
- Detector calibration
pipeline/detector1.py - Calibrated exposures
- Gaia astrometry
pipeline/astrometry.py - Group-difference cubes
pipeline/groupdiff.py - Cube products
Variable analysis
- Autocorrelation detection
pipeline/detect.py - Extraction orchestration
pipeline/extract.py - Aperture photometry
pipeline/photometry.py - Extracted light curves
- Photometry corrections
pipeline/corrections.py - Period search
pipeline/periods.py
Catalog and reproduction
- Human REAL/FAKE vetting
scripts/export_vetting_labels.py - Vetting labels
- Catalog construction
pipeline/catalog.py - Published catalog
- Segment 1 extraction
unported/add_segment1_terzan5.py - Segment 1 stage figures
unported/paper_seg1_stages.py
Other components
- Researcher
- MAST archive
- Gaia DR3
Connections 24
- Researcher → Exposure download: starts run
README.md - MAST archive → Exposure download: provides exposures
README.md - Exposure download → Calibrated exposures: downloads raw
README.md - Pipeline configuration → Exposure download: configures paths
README.md - Pipeline configuration → Detector calibration: pins context
pipeline/config.py - Calibrated exposures → Detector calibration: calibrates
README.md - Detector calibration → Group-difference cubes: provides ramps
README.md - Detector calibration → Gaia astrometry: provides images
- Gaia DR3 → Gaia astrometry: provides reference
pipeline/astrometry.py - Gaia astrometry → Group-difference cubes: aligns WCS
pipeline/groupdiff.py - Group-difference cubes → Cube products: writes cubes
README.md - Cube products → Extraction orchestration: supplies frames
pipeline/extract.py - Extraction orchestration → Autocorrelation detection: detects sources
pipeline/extract.py - Extraction orchestration → Aperture photometry: calls photometry
pipeline/extract.py - Aperture photometry → Extracted light curves: produces curves
- Extracted light curves → Photometry corrections: corrects flux
README.md - Photometry corrections → Period search: enables search
- Extracted light curves → Period search: searches periods
- Researcher → Human REAL/FAKE vetting: classifies sources
scripts/export_vetting_labels.py - Human REAL/FAKE vetting → Vetting labels: exports labels
scripts/export_vetting_labels.py - Vetting labels → Catalog construction: builds from labels
pipeline/catalog.py - Catalog construction → Published catalog: writes tables
pipeline/catalog.py - Published catalog → Segment 1 extraction: extends catalog
unported/add_segment1_terzan5.py - Segment 1 extraction → Segment 1 stage figures: supplies stages
unported/paper_seg1_stages.py