How momonokiki/datacore-oss works
DataCore is a personal-file data platform: authenticated uploads retain originals in content-addressed L1 storage, then background processing creates L2 extraction artifacts and optional L3 domain data for search and analysis. The README describes receipt and financial-data capabilities; the tree confirms corresponding API routes and add-ons, though their runtime wiring was not sampled. Edges reflect shown calls or documented behavior; unsampled route/add-on connections are omitted rather than inferred.
Main entry points: main.py FastAPI app · service.py Image embedding · ingest.py File ingest · models.py Extracted artifacts
Components 25
API and access
- FastAPI app
app/main.py - Authentication
app/api/routes/auth.py - File ingest
app/api/routes/ingest.py - Search API
app/api/routes/search.py - Finance API
app/api/routes/finance.py - Receipt API
app/api/routes/receipts.py - Search UI
app/webui/webui/pages/search.py
Raw file layer
- L1 ingestion
app/layers/l1_raw/service.py - CAS storage
app/infrastructure/storage/adapter.py - Raw file records
app/layers/l1_raw/models.py
Extraction and search
- Task dispatch
app/tasks.py - Extraction tasks
app/layers/l2_extracted/tasks.py - Media extraction
app/layers/l2_extracted/media_info/service.py - OCR extraction
app/layers/l2_extracted/ocr/service.py - Image embedding
app/layers/l2_extracted/embedding_img/service.py - Text embedding
app/layers/l2_extracted/embedding_text/service.py - Search service
app/layers/l2_extracted/search/service.py
Structured data
- Receipt add-on
app/layers/l3_structured/addons/receipt/service.py - Finance parser
app/layers/l3_structured/addons/finunce_parser/service.py - YomiToku layout
app/layers/l3_structured/addons/yomitoku_layout/service.py - Receipt classifier
app/layers/l3_structured/addons/receipt_classify_exp/service.py
Persistence
- Extracted artifacts
app/layers/l2_extracted/models.py - Tool registry
app/infrastructure/db/models/l2_tools.py - DB sessions
app/infrastructure/db/session.py
Other components
- User
Connections 27
- FastAPI app → File ingest: registers route
app/main.py - FastAPI app → Authentication: registers route
app/main.py - FastAPI app → Search API: registers route
app/main.py - FastAPI app → Finance API: registers route
app/main.py - FastAPI app → Receipt API: registers route
app/main.py - User → File ingest: uploads files
README.md - File ingest → Authentication: checks identity
app/api/routes/ingest.py - File ingest → L1 ingestion: ingests files
app/api/routes/ingest.py - File ingest → Task dispatch: dispatches chain
app/api/routes/ingest.py - L1 ingestion → CAS storage: stores binaries
app/layers/l1_raw/service.py - L1 ingestion → Raw file records: records uploads
app/layers/l1_raw/service.py - Search API → Search service: queries
app/api/routes/search.py - Search service → Text embedding: uses embeddings
app/layers/l2_extracted/search/service.py - Extraction tasks → Media extraction: runs extraction
app/layers/l2_extracted/tasks.py - Extraction tasks → OCR extraction: runs OCR
app/layers/l2_extracted/tasks.py - Extraction tasks → Image embedding: runs embedding
app/layers/l2_extracted/tasks.py - Extraction tasks → Text embedding: runs embedding
app/layers/l2_extracted/tasks.py - Media extraction → Extracted artifacts: writes metadata
app/layers/l2_extracted/media_info/service.py - OCR extraction → Extracted artifacts: writes artifacts
app/layers/l2_extracted/ocr/service.py - Image embedding → Extracted artifacts: writes vectors
app/layers/l2_extracted/embedding_img/service.py - Image embedding → CAS storage: loads original
app/layers/l2_extracted/embedding_img/service.py - Image embedding → Raw file records: reads file record
app/layers/l2_extracted/embedding_img/service.py - Image embedding → Tool registry: registers tool
app/layers/l2_extracted/embedding_img/service.py - Text embedding → Extracted artifacts: reads and writes
app/layers/l2_extracted/embedding_text/service.py - Text embedding → Tool registry: registers tool
app/layers/l2_extracted/embedding_text/service.py - Search service → Extracted artifacts: searches artifacts
app/layers/l2_extracted/search/service.py - Search UI → Search API: uses API