How anubhabmondal496-coder/sketchforge works
SketchForge turns a user sketch or reference photo and description into an inspectable 3D model. The main workflow runs from the workbench UI through API submission and an asynchronous job: image preparation, Gemma scene understanding, optional asset search/import, and TripoSR reconstruction. Users can inspect and export the resulting GLB, or refine the scene and generate another version. The graph includes the documented asset-search and photo paths; unsampled route and UI internals are represented only where README or source-index evidence supports them.
Main entry points: Home.tsx Workbench · job_service.py Job orchestrator · api.ts API client · asset_search_service.py Asset search and ranking
Components 23
Workbench client
- Workbench
frontend/src/pages/Home.tsx - Sketch canvas
frontend/src/components/SketchCanvas.tsx - Photo input
frontend/src/components/PhotoUpload.tsx - Refinement input
frontend/src/components/RefinementInput.tsx - API client
frontend/src/services/api.ts - 3D viewer
frontend/src/components/ModelViewer.tsx - Scene and asset panels
frontend/src/components/SceneSpecPanel.tsx
API and jobs
- FastAPI app
backend/app/main.py - Generation route
backend/app/api/generate.py - Refinement route
backend/app/api/refine.py - Analysis route
backend/app/api/analyze.py - Asset routes
backend/app/api/assets.py - Job orchestrator
backend/app/services/job_service.py
Image understanding
- Image preparation
backend/app/services/image_service.py - Image processing
backend/app/utils/image_processing.py - Gemma reasoning
backend/app/services/gemma_service.py - SceneSpec schema
backend/app/models/scene_spec.py
Geometry and assets
- TripoSR reconstruction
backend/app/services/tripo_service.py - Asset search and ranking
backend/app/services/asset_search_service.py - Search providers
backend/app/services/providers/base_provider.py - Asset download and cache
backend/app/services/asset_download_service.py - External asset catalogs
Other components
- User
Connections 33
- User → Workbench: uses
- Workbench → Sketch canvas: captures sketch
frontend/src/pages/Home.tsx - Workbench → Photo input: accepts photo
frontend/src/pages/Home.tsx - Workbench → Refinement input: requests refinement
frontend/src/pages/Home.tsx - Workbench → API client: submits and polls
frontend/src/pages/Home.tsx - Workbench → 3D viewer: presents model
frontend/src/pages/Home.tsx - Workbench → Scene and asset panels: shows scene details
frontend/src/pages/Home.tsx - API client → Generation route: submits generation
- API client → Refinement route: submits refinement
- API client → Analysis route: requests analysis
- FastAPI app → Generation route: registers route
backend/app/main.py - FastAPI app → Refinement route: registers route
backend/app/main.py - FastAPI app → Analysis route: registers route
backend/app/main.py - FastAPI app → Asset routes: registers route
backend/app/main.py - Generation route → Job orchestrator: starts job
backend/app/api/generate.py - Refinement route → Job orchestrator: starts job
backend/app/api/refine.py - Analysis route → Image preparation: prepares input
backend/app/api/analyze.py - Analysis route → Gemma reasoning: requests analysis
backend/app/api/analyze.py - Asset routes → Asset search and ranking: searches assets
backend/app/api/assets.py - Asset routes → Asset download and cache: imports asset
backend/app/api/assets.py - Job orchestrator → Image preparation: prepares input
backend/app/services/job_service.py - Image preparation → Image processing: preprocesses image
backend/app/services/image_service.py - Job orchestrator → Gemma reasoning: analyzes input
backend/app/services/job_service.py - Gemma reasoning → SceneSpec schema: produces scene spec
backend/app/services/gemma_service.py - Job orchestrator → Asset search and ranking: searches candidates
backend/app/services/job_service.py - Asset search and ranking → Search providers: queries providers
backend/app/services/asset_search_service.py - Search providers → External asset catalogs: searches catalogs
- Asset search and ranking → Asset search and ranking: ranks results
backend/app/services/asset_search_service.py - Job orchestrator → Asset download and cache: downloads match
backend/app/services/job_service.py - Job orchestrator → TripoSR reconstruction: generates mesh
backend/app/services/job_service.py - 3D viewer → API client: loads model
- 3D viewer → User: exports GLB
- Refinement input → API client: sends refinement