How xingclover/beekeeper_monitor works
Beekeeper Monitor ingests simulated hive-sensor readings and external weather and wildfire observations into PostgreSQL, then evaluates sensor, weather, and wildfire rules to create alarm events and notifications. FastAPI serves monitoring and rule-management endpoints; the Streamlit dashboard consumes that API for live and historical views, filtering, and alert inspection. The README also describes dbt analytics and Superset, but those components are absent from the supplied tree, so they are shown as documented external capabilities. Some subsystem links are limited to README statements or source-index references.
Main entry points: main.py Pipeline runner · weather/pipeline.py Weather ingestion · wildfire/pipeline.py Wildfire ingestion · pages Dashboard pages
Components 26
Data ingestion
- Sensor simulator
ingestion/sensors/hive_sensor_simulator.py - Weather ingestion
ingestion/weather/pipeline.py - Wildfire ingestion
ingestion/wildfire/pipeline.py - Location lookup
ingestion/common/location_repository.py - Job tracking
ingestion/common/jobs.py
Alerts and notifications
- Pipeline runner
core/main.py - Sensor rule pipeline
rule_engine/pipeline/sensor_pipeline.py - Weather rule pipeline
rule_engine/pipeline/weather_pipeline.py - Wildfire rule pipeline
rule_engine/pipeline/wildfire_pipeline.py - Rule evaluator
rule_engine/evaluator.py - Rule repository
rule_engine/repository.py - Notification processing
notification/pipeline.py - Notification repository
notification/repository.py
API serving
- FastAPI application
api/main.py - Monitoring and rules API
api/routers
Monitoring dashboard
- Streamlit dashboard
dashboard/app.py - Dashboard pages
dashboard/pages - Dashboard services
dashboard/services - API client
dashboard/utils/api_client.py - Filter helpers
dashboard/utils/filter_utils.py
Analytics
- dbt transformations
- Analytics marts
- Superset exploration
Other components
- Operators
- Data sources
- PostgreSQL
Connections 32
- Operators → Streamlit dashboard: views
- Data sources → Weather ingestion: provides forecasts
- Data sources → Wildfire ingestion: provides detections
- Sensor simulator → PostgreSQL: stores readings
- Weather ingestion → PostgreSQL: stores observations
- Wildfire ingestion → PostgreSQL: stores observations
- Weather ingestion → Location lookup: fetches locations
ingestion/weather/pipeline.py - Weather ingestion → Job tracking: tracks jobs
ingestion/weather/pipeline.py - Wildfire ingestion → Location lookup: fetches locations
ingestion/wildfire/pipeline.py - Wildfire ingestion → Job tracking: tracks jobs
ingestion/wildfire/pipeline.py - Pipeline runner → Sensor rule pipeline: runs
core/main.py - Pipeline runner → Weather rule pipeline: runs
core/main.py - Pipeline runner → Wildfire rule pipeline: runs
core/main.py - Pipeline runner → Notification processing: runs
core/main.py - Sensor rule pipeline → Rule repository: reads and writes
rule_engine/pipeline/sensor_pipeline.py - Weather rule pipeline → Rule repository: reads and writes
rule_engine/pipeline/weather_pipeline.py - Wildfire rule pipeline → Rule repository: reads and writes
rule_engine/pipeline/wildfire_pipeline.py - Sensor rule pipeline → Rule evaluator: tests rules
rule_engine/pipeline/sensor_pipeline.py - Weather rule pipeline → Rule evaluator: tests rules
rule_engine/pipeline/weather_pipeline.py - Wildfire rule pipeline → Rule evaluator: tests rules
rule_engine/pipeline/wildfire_pipeline.py - Notification processing → Notification repository: creates records
notification/pipeline.py - FastAPI application → Monitoring and rules API: registers routes
api/main.py - PostgreSQL → FastAPI application: serves data through
- FastAPI application → Streamlit dashboard: serves dashboard
- Streamlit dashboard → API client: uses
dashboard/app.py - Dashboard pages → API client: requests data
dashboard/pages/4_Alarm&Notifications.py - Dashboard services → API client: fetches API data
dashboard/services/overview_service.py - Dashboard pages → Dashboard services: uses services
- Dashboard pages → Filter helpers: builds filters
- PostgreSQL → dbt transformations: transforms OLTP
- dbt transformations → Analytics marts: builds marts
- Analytics marts → Superset exploration: feeds exploration