How afjaramillo97/sobreplano works
Sobreplano is a Colombian off-plan housing catalog: it collects daily project prices, exposes searchable listings and price histories, and offers a conversational advisor over that catalog. The main collection workflow is scheduled or manually initiated scraping, followed by page parsing, structured extraction, validation, and append-only price recording. API routes serve catalog queries and advisor conversations; the advisor uses tools for search, comparison, and financial simulations. Evaluation modules measure advisor and extraction quality. Some subsystem links are based on README descriptions because their implementation files were not sampled.
Main entry points: scrape_developer.py Scrape workflow · models.py Postgres database · projects.py Project endpoints · tools.py Advisor tools
Components 23
Price collection
- Scrape workflow
src/sobreplano/application/scrape_developer.py - Site parsers
src/sobreplano/infrastructure/scraping/constructora_capital.py - Polite fetching
src/sobreplano/infrastructure/scraping/http_fetcher.py - LLM extraction
src/sobreplano/infrastructure/scraping/openai_compatible_extractor.py - LLM providers
src/sobreplano/infrastructure/llm/providers.py - Price recording
src/sobreplano/application/record_price_observation.py - Raw page storage
src/sobreplano/infrastructure/scraping/raw_store.py
Catalog and API
- Catalog rules
src/sobreplano/domain/catalog.py - Price history rules
src/sobreplano/domain/pricing.py - Listing queries
src/sobreplano/infrastructure/db/project_listing_query.py - Catalog repository
src/sobreplano/infrastructure/db/catalog_repository.py - Price repository
src/sobreplano/infrastructure/db/price_observation_repository.py - Postgres database
src/sobreplano/infrastructure/db/models.py - FastAPI application
src/sobreplano/interface/api/main.py - Project endpoints
src/sobreplano/interface/api/routes/projects.py
AI advisor
- Advisor endpoint
src/sobreplano/interface/api/routes/advisor.py - LangGraph advisor
src/sobreplano/infrastructure/advisor/langgraph_advisor.py - Advisor tools
src/sobreplano/infrastructure/advisor/tools.py - Financial simulations
src/sobreplano/domain/finance.py
Quality evaluation
- Quality evaluations
src/sobreplano/evals
Other components
- Scrape initiator
- Developer websites
- Home buyer
Connections 27
- Scrape initiator → Scrape workflow: starts run
README.md - Scrape workflow → Polite fetching: fetches pages
README.md - Polite fetching → Developer websites: requests pages
README.md - Scrape workflow → Site parsers: parses pages
README.md - Scrape workflow → LLM extraction: extracts data
README.md - LLM providers → LLM extraction: builds extractor
src/sobreplano/infrastructure/llm/providers.py - Scrape workflow → Raw page storage: stores raw pages
README.md - Scrape workflow → Price recording: records prices
src/sobreplano/application/scrape_developer.py - Scrape workflow → Catalog rules: uses entities
src/sobreplano/application/scrape_developer.py - Scrape workflow → Price history rules: uses price rules
src/sobreplano/application/scrape_developer.py - Price recording → Price history rules: validates observations
src/sobreplano/application/record_price_observation.py - Scrape workflow → Postgres database: persists history
README.md - Catalog repository → Postgres database: reads and writes
src/sobreplano/infrastructure/db/catalog_repository.py - Price repository → Postgres database: reads and writes
src/sobreplano/infrastructure/db/price_observation_repository.py - FastAPI application → Project endpoints: registers routes
src/sobreplano/interface/api/main.py - FastAPI application → Advisor endpoint: registers routes
src/sobreplano/interface/api/main.py - Project endpoints → Listing queries: serves listings
README.md - Listing queries → Postgres database: queries catalog
src/sobreplano/infrastructure/db/project_listing_query.py - Project endpoints → Catalog rules: uses catalog types
src/sobreplano/interface/api/routes/projects.py - Home buyer → FastAPI application: searches homes
README.md - Home buyer → Advisor endpoint: asks advisor
README.md - Advisor endpoint → LangGraph advisor: runs conversation
README.md - LangGraph advisor → Advisor tools: dispatches tools
src/sobreplano/infrastructure/advisor/langgraph_advisor.py - Advisor tools → Financial simulations: simulates returns
src/sobreplano/infrastructure/advisor/tools.py - Advisor tools → Listing queries: searches catalog
README.md - Quality evaluations → LangGraph advisor: evaluates answers
README.md - Quality evaluations → LLM extraction: evaluates extraction
README.md