How karasowl/biblioperson works
Project type and purpose
• This is a full-stack personal knowledge management system (“Biblioteca de Conocimiento Personal”) with:
• A data ingestion/processing pipeline in Python
• A Flask-based REST API backend (Python + SQLite)
• A modern JavaScript frontend (Vite) for exploration and analysis
File structure
• Top-level:
– backend/ : Flask app, DB schema, Python scripts for import and DB maintenance
– dataset/ : standalone data-processing modules (cleaning, converters, processors)
– frontend/ : Vite-based UI (HTML, CSS, JS)
– scripts/ : convenience Python scripts (duplicate of backend scripts for ad-hoc runs)
– requirements.txt & package.json at root for bootstrapping both sides in dev
• Patterns:
– “dataset” directory handles raw data extraction and transformation
– “backend” directory exposes REST endpoints and interacts with the SQLite DB
– “frontend” directory serves the client app that consumes the API
• Config & build files:
– backend/requirements.txt, nodemon.json
– frontend/package.json, vite.config.js
README for additional insights
• Data sources include Facebook, Twitter, Telegram, documents
• Features: import → index → explore → generate new content
• Dev mode runs Flask on :5000 and Vite on :5173