How chirag-mukhija/shortspipeline works
ClipForge is a local-first topic-to-short-video production system. Users create a project in the studio or CLI; the server runs research/script and critique stages, pauses for human review, then builds storyboard, voice, assets, synced timeline, render, metadata and publish/export outputs. SQLite stores project state and step artifacts, while the studio exposes progress, review, previews and per-scene recording. The README documents the full workflow and optional palette, gameplay-background and voice-recording capabilities; several pipeline implementations were not excerpted, so those documented stages are represented without speculative internal call edges.
Main entry points: runner.ts Job runner · api.ts Project API · repo.ts Project repository · app.ts HTTP server
Components 31
Studio
- Studio UI
apps/studio/src/App.tsx - Projects and review
apps/studio/src/pages - Video preview
apps/studio/src/components/Preview.tsx - Scene recording
apps/studio/src/components/SceneRecorder.tsx - Studio API client
apps/studio/src/api.ts
Pipeline orchestration
- HTTP server
apps/server/src/app.ts - Project API
apps/server/src/routes/api.ts - Recording routes
apps/server/src/routes/recordings.ts - Job runner
apps/server/src/pipeline/runner.ts - Autopilot
apps/server/src/pipeline/autopilot.ts - Pipeline controls
apps/server/src/pipeline/control.ts - Step context
apps/server/src/pipeline/context.ts - Live events
apps/server/src/pipeline/events.ts
Content production
- Angle and critique
apps/server/src/agents - Structured LLM
apps/server/src/llm/index.ts - Writing stages
apps/server/src/pipeline/steps/writing.ts - Voice synthesis
apps/server/src/tts/index.ts
Media and delivery
- Asset sourcing
apps/server/src/pipeline/steps/media.ts - Timeline sync
apps/server/src/pipeline/timeline.ts - Video rendering
apps/server/src/render/remotion.ts - Short composition
packages/video/src/ShortVideo.tsx - Scene templates
packages/video/src/templates - Metadata and export
apps/server/src/pipeline/steps/output.ts - YouTube publishing
apps/server/src/publish/youtube.ts
State and contracts
- Project repository
apps/server/src/db/repo.ts - SQLite database
apps/server/src/db/schema.ts - Shared schemas
packages/schema/src
Other components
- Creator
- LLM provider
- Speech provider
- YouTube
Connections 40
- Creator → Studio UI: uses
README.md - Studio UI → Projects and review: routes to
apps/studio/src/App.tsx - Projects and review → Studio API client: requests
apps/studio/src/pages/Home.tsx - Projects and review → Video preview: renders
apps/studio/src/pages/ProjectPage.tsx - Projects and review → Scene recording: renders
- Studio API client → Project API: calls
apps/studio/src/api.ts - HTTP server → Project API: routes
apps/server/src/app.ts - HTTP server → Recording routes: routes
apps/server/src/app.ts - HTTP server → Job runner: starts
apps/server/src/app.ts - HTTP server → Autopilot: starts
apps/server/src/app.ts - Project API → Pipeline controls: controls
apps/server/src/routes/api.ts - Project API → Project repository: reads and writes
apps/server/src/routes/api.ts - Project API → Live events: streams
apps/server/src/routes/api.ts - Project API → YouTube publishing: authorizes
apps/server/src/routes/api.ts - Pipeline controls → Project repository: queues jobs
- Autopilot → Pipeline controls: starts jobs
apps/server/src/pipeline/autopilot.ts - Job runner → Step context: builds context
- Step context → Project repository: loads artifacts
apps/server/src/pipeline/context.ts - Step context → Live events: emits progress
apps/server/src/pipeline/context.ts - Job runner → Writing stages: runs steps
- Writing stages → Angle and critique: uses
- Angle and critique → Structured LLM: generates critique
- Structured LLM → LLM provider: calls provider
apps/server/src/llm/index.ts - Job runner → Voice synthesis: runs voice step
- Voice synthesis → Speech provider: synthesizes speech
apps/server/src/tts/index.ts - Job runner → Asset sourcing: runs asset step
- Job runner → Timeline sync: runs sync step
- Job runner → Video rendering: runs render step
- Video rendering → Short composition: renders composition
- Short composition → Scene templates: uses templates
- Job runner → Metadata and export: runs output step
- Metadata and export → YouTube publishing: prepares publishing
- YouTube publishing → YouTube: uploads video
- Recording routes → Project repository: stores recordings
- Scene recording → Studio API client: uploads audio
apps/studio/src/components/SceneRecorder.tsx - Video preview → Short composition: previews timeline
apps/studio/src/components/Preview.tsx - Project repository → SQLite database: queries
apps/server/src/db/repo.ts - Studio API client → Shared schemas: uses contracts
apps/studio/src/api.ts - Step context → Shared schemas: types artifacts
apps/server/src/pipeline/context.ts - Short composition → Shared schemas: consumes timeline