How xcaim04/la-ceiba-data works
La Ceiba is a synthetic-data analytics product for reconciling a wholesaler’s multi-currency sales and revealing true product margins. Its main workflow is raw sales, inventory, purchase, and exchange-rate files → bronze/silver/gold transformations → quality checks and reconciliation → BI and a private admin/panel. It also provides a BigQuery/Dataform equivalent. The README documents the domain stages; sampled code confirms local orchestration, transactional admin updates, and web dispatch. Some SQL/Dataform internals and BI wiring were not sampled, so those links follow documented architecture only.
Main entry points: pipeline.py Local pipeline · main.py FastAPI site · gold Gold reporting · silver Silver modeling
Components 21
Data inputs
- Raw business files
- Synthetic data generator
generar/generar_datos.py - BigQuery loader
cargar_bigquery.py
Local analytics
- Local pipeline
pipeline.py - Bronze ingestion
sql/bronze - Silver modeling
sql/silver - Gold reporting
sql/gold - Quality checks
sql/calidad - DuckDB database
app/datos.py
BigQuery analytics
- Bronze declarations
dataform/definitions/bronze/fuentes.js - Silver models
dataform/definitions/silver - Gold models
dataform/definitions/gold - Dataform assertions
dataform/definitions/calidad - BigQuery
Private site
- FastAPI site
app/main.py - Session security
app/seguridad.py - Data and catalog admin
app/datos.py - Private dashboard
dashboard.py
BI reporting
- Evidence BI
bi
Other components
- Business operator
- Administrator
Connections 26
- Synthetic data generator → Raw business files: generates
README.md - Raw business files → Local pipeline: feeds
README.md - Local pipeline → Bronze ingestion: executes
pipeline.py - Local pipeline → Silver modeling: executes
pipeline.py - Local pipeline → Gold reporting: executes
pipeline.py - Local pipeline → Quality checks: runs checks
pipeline.py - Bronze ingestion → Silver modeling: classifies rows
README.md - Silver modeling → Gold reporting: produces summaries
README.md - Gold reporting → Quality checks: validates outputs
README.md - Local pipeline → DuckDB database: builds tables
pipeline.py - BigQuery loader → BigQuery: loads bronze
cargar_bigquery.py - BigQuery loader → Raw business files: prepares files
cargar_bigquery.py - Bronze declarations → BigQuery: declares sources
dataform/definitions/bronze/fuentes.js - Bronze declarations → Silver models: feeds models
README.md - Silver models → Gold models: feeds models
README.md - Gold models → Dataform assertions: checked by
README.md - Dataform assertions → BigQuery: asserts tables
README.md - Business operator → FastAPI site: uses site
app/main.py - FastAPI site → Session security: checks access
app/main.py - FastAPI site → Data and catalog admin: handles admin data
app/main.py - Data and catalog admin → Local pipeline: recalculates
app/datos.py - FastAPI site → Private dashboard: renders panel
app/main.py - FastAPI site → DuckDB database: reads data
app/main.py - Business operator → Evidence BI: views analytics
README.md - Gold reporting → Evidence BI: exports Parquet
- BigQuery → Evidence BI: serves gold tables
README.md