How gowtham380/hydra-runner works
This repository is a Google Drive–to–Hugging Face movie migration worker, with optional Modal execution. Its principal workflow authenticates to Drive, scans for video files, checks destination chunks, transfers missing data, and registers movie metadata in Supabase. The two top-level scripts are parallel copies of the worker, not separate pipeline stages. The excerpts show scanning, chunk checks, and upload/registration behavior, but omit enough orchestration code that several connections remain unverified.
Main entry points: ingester/modal_drive_migrator.py Cloud worker entry · modal_drive_migrator.py Local worker entry
Components 15
Worker runtime
- Local worker entry
modal_drive_migrator.py - Cloud worker entry
ingester/modal_drive_migrator.py
Drive access
- Service account auth
ingester/modal_drive_migrator.py - Google Drive
- Folder video scan
ingester/modal_drive_migrator.py - Range download
ingester/modal_drive_migrator.py
Chunk migration
- Title and quality mapping
ingester/modal_drive_migrator.py - Dataset repo mesh
ingester/modal_drive_migrator.py - Existing chunk check
ingester/modal_drive_migrator.py - Chunked commit upload
ingester/modal_drive_migrator.py - Hugging Face datasets
Catalog registration
- Movie metadata registration
ingester/modal_drive_migrator.py - Supabase catalog
Other components
- Local invocation
- Modal runtime
Connections 16
- Local invocation → Local worker entry: invokes
modal_drive_migrator.py - Local worker entry → Folder video scan: runs migration
modal_drive_migrator.py - Modal runtime → Cloud worker entry: dispatches
ingester/modal_drive_migrator.py - Cloud worker entry → Folder video scan: runs migration
ingester/modal_drive_migrator.py - Folder video scan → Google Drive: lists files
ingester/modal_drive_migrator.py - Cloud worker entry → Service account auth: acquires token
ingester/modal_drive_migrator.py - Service account auth → Google Drive: authorizes access
- Cloud worker entry → Title and quality mapping: parses names
ingester/modal_drive_migrator.py - Cloud worker entry → Dataset repo mesh: selects destination
ingester/modal_drive_migrator.py - Cloud worker entry → Existing chunk check: checks parts
ingester/modal_drive_migrator.py - Existing chunk check → Hugging Face datasets: reads chunk listing
ingester/modal_drive_migrator.py - Cloud worker entry → Range download: downloads missing data
ingester/modal_drive_migrator.py - Cloud worker entry → Chunked commit upload: uploads missing parts
ingester/modal_drive_migrator.py - Chunked commit upload → Hugging Face datasets: commits chunks
ingester/modal_drive_migrator.py - Cloud worker entry → Movie metadata registration: registers movie
ingester/modal_drive_migrator.py - Movie metadata registration → Supabase catalog: writes record
ingester/modal_drive_migrator.py