How allienna/le-veilleur works
Le Veilleur is a scheduled editorial pipeline that turns newsletter links into a published daily tech-watch article, illustration, and LinkedIn draft. The Minion orchestrates discrete ingestion, generation, and publishing stages; the commit is the publication record, while the Astro site presents committed content. Fiches and podcast production are additional pipeline capabilities. The README documents the end-to-end workflow; source excerpts and the index expose selected implementation relationships, so unverified internal calls are omitted.
Main entry points: orchestrator.py Run orchestrator · generation.py Article generation · scraper.py Link scraping · ingestion.py Source validation
Components 22
Scheduling and control
- Run orchestrator
minion/src/minion/orchestrator.py - Run and lock state
minion/src/minion/store/memory.py - Structured logging
minion/src/minion/logging.py - Budget kill-switch
functions/budget-killswitch/main.py
Editorial pipeline
- Newsletter ingestion
minion/src/minion/steps/ingestion.py - Link scraping
minion/src/minion/ingest/scraper.py - Source validation
minion/src/minion/steps/ingestion.py - Context assembly
minion/src/minion/generate/assemble.py - Article generation
minion/src/minion/steps/generation.py - Article validation
minion/src/minion/generate/validate.py - Source fiches
minion/src/minion/fiches/runner.py
Publishing and media
- Article and draft commit
minion/src/minion/steps/publish.py - Illustration generation
minion/src/minion/publish/imagen.py - Repository publishing
minion/src/minion/publish/github.py - Podcast production
minion/src/minion/podcast/script.py - Audio object storage
minion/src/minion/podcast/gcs.py
Reader experience
- Committed site content
site/src/content/config.ts - Astro site
site - RSS and podcast feed
site/src/pages/rss.xml.ts
Other components
- Daily scheduler
- Claude CLI
- Billing budget events
Connections 27
- Daily scheduler → Run orchestrator: starts daily
README.md - Run orchestrator → Run and lock state: records run
minion/src/minion/orchestrator.py - Run orchestrator → Structured logging: emits events
minion/src/minion/orchestrator.py - Run orchestrator → Newsletter ingestion: dispatches steps
minion/src/minion/orchestrator.py - Run orchestrator → Link scraping: dispatches steps
- Run orchestrator → Source validation: dispatches steps
- Run orchestrator → Context assembly: dispatches steps
- Run orchestrator → Article generation: dispatches steps
- Run orchestrator → Article validation: dispatches steps
- Run orchestrator → Article and draft commit: dispatches steps
- Run orchestrator → Source fiches: dispatches steps
- Run orchestrator → Podcast production: dispatches steps
- Newsletter ingestion → Link scraping: passes URLs
minion/src/minion/steps/ingestion.py - Link scraping → Source validation: provides sources
minion/src/minion/steps/ingestion.py - Source validation → Context assembly: passes accepted sources
README.md - Context assembly → Article generation: builds context
minion/src/minion/steps/generation.py - Article generation → Claude CLI: invokes generation
minion/src/minion/steps/generation.py - Article generation → Article validation: validates article
minion/src/minion/steps/generation.py - Run orchestrator → Illustration generation: generates illustration
README.md - Run orchestrator → Repository publishing: commits outputs
README.md - Article and draft commit → Committed site content: writes article
README.md - Repository publishing → Committed site content: commits content
README.md - Committed site content → Astro site: renders content
README.md - Podcast production → Audio object storage: stores audio
- Audio object storage → RSS and podcast feed: serves episode links
- Billing budget events → Budget kill-switch: sends budget event
functions/budget-killswitch/main.py - Budget kill-switch → Daily scheduler: pauses job
functions/budget-killswitch/main.py