How uhero/udaman works
UDAMAN is a data-management and analysis application for UHERO time-series data, with separate data-portal ingestion and a Hawaii Housing Database. Users work through the Next.js interface to discover, manage, analyze, and export data; background crawlers and workers handle external data collection and scheduled processing. The README documents QPub’s scrape–parse–load workflow. Sampled source supports the MCP and OAuth flows and parts of the MLS and DCCA pipelines; other connections are limited to documented capabilities and the visible module structure.
Main entry points: series-collection.ts Catalog collections · dcca/pipeline.ts DCCA crawler · route.ts OAuth authorization · mls/pipeline.ts MLS crawler
Components 27
Time-Series Catalog
- UDAMAN interface
src/app/udaman/[universe]/page.tsx - Series management
src/app/udaman/[universe]/series/[id]/page.tsx - Catalog actions
src/actions/series-actions.ts - Catalog collections
src/core/catalog/collections/series-collection.ts - UDAMAN database
- Analyze and compare
src/app/udaman/[universe]/analyze/page.tsx - Downloads and exports
src/actions/exports.ts
Data Ingestion
- Data portals
src/app/data/dbedt/components/dbedt-data-portal.tsx - Portal uploads
src/actions/dbedt-upload.ts - Data loaders
src/app/udaman/[universe]/data-loaders/new/page.tsx - DCCA crawler
src/core/crawlers/dcca/pipeline.ts - MLS crawler
src/core/crawlers/mls/pipeline.ts
Housing Database
- Housing data tools
src/app/hhdb/page.tsx - Housing database
src/core/catalog/collections/hhdb-property-collection.ts - QPub processing
src/core/workers/processors/qpub-pipeline.ts - QPub scraper
plugins/qpub-scraper/background/service-worker.js
Operations and Review
- Publication review
src/app/comms/page.tsx - Admin operations
src/app/admin/page.tsx
API and Access
- MCP endpoint
src/app/api/mcp/route.ts - OAuth authorization
src/app/api/oauth/authorize/route.ts
Other components
- Data user
- External data sites
- MCP client
- OAuth client
- QPub websites
- NAS files
- Housing MariaDB
Connections 31
- Data user → UDAMAN interface: uses
- UDAMAN interface → Series management: opens
- Series management → Catalog actions: invokes
- Catalog actions → Catalog collections: queries
- Catalog collections → UDAMAN database: reads and writes
- Data user → Analyze and compare: analyzes
- Analyze and compare → Catalog collections: uses series data
- Data user → Downloads and exports: requests export
- Downloads and exports → Catalog collections: reads export data
- Data user → Data portals: selects data
- Data portals → Portal uploads: submits files
- Portal uploads → Catalog collections: records imported data
- Data user → Data loaders: configures loader
- DCCA crawler → External data sites: fetches profiles
- DCCA crawler → NAS files: caches and reads files
- DCCA crawler → Housing database: loads projects
- MLS crawler → External data sites: fetches listings
- MLS crawler → NAS files: uses cached files
- Data user → Housing data tools: explores housing data
- Housing data tools → Housing database: queries
- QPub websites → QPub scraper: serves pages
- QPub scraper → NAS files: saves HTML
- QPub processing → NAS files: reads parsed files
- QPub processing → Housing MariaDB: updates status
- Data user → Publication review: reviews releases
- Data user → Admin operations: administers
- MCP client → MCP endpoint: sends requests
- MCP endpoint → MCP client: returns responses
- OAuth client → OAuth authorization: requests authorization
- OAuth authorization → Data user: requests consent
- OAuth authorization → OAuth client: redirects with result