How mahmoudessam820/pulsar_estate works
Pulsar Estate is a UAE real-estate intelligence backend: users request market insights, which are searched, crawled, analyzed by a configured AI provider, trust-scored, and stored. The README describes an asynchronous Celery/RabbitMQ worker path, semantic-cache fast path, usage/quota enforcement, and completion events; sampled code also shows a direct API pipeline route and provider assembly. Other documented product branches include authentication, billing, integrations, and scheduled queries. Some routes and worker wiring were not sampled, so their connections are shown only where the README or source index supports them.
Main entry points: pipeline_service.py Pipeline Service · factory.py Pipeline Factory · pipeline.py Pipeline API · tasks.py Celery Workers
Components 24
API and Access
- FastAPI Routes
app/api/routes - Auth Services
app/auth - Integrations API
app/api/routes/integrations.py - Pipeline API
app/api/routes/pipeline.py - Insights API
app/api/routes/insights.py
Insight Pipeline
- Pipeline Factory
app/core/pipeline/factory.py - Pipeline Service
app/core/pipeline/pipeline_service.py - Search Provider
app/providers/search - Crawler Provider
app/providers/crawler/crawl4ai.py - AI Providers
app/providers/ai - Embedding Providers
app/providers/embedding - Celery Workers
app/core/pipeline/tasks.py - RabbitMQ Queue
Trust and Storage
- Trust Engine
app/trust - Insight Repository
app/data/repositories/insight_repo.py - PostgreSQL / pgvector
app/data - Semantic Cache
app/data
Usage and Scheduling
- Events / Notifications
app/events - Entitlements and Usage
app/monetization/entitlements.py - Scheduled Queries
app/core/scheduler/scheduled_query_service.py - APScheduler
app/scheduler/apscheduler_impl.py
Accounts and Billing
- Subscriptions and Payments
app/billing/subscriptions.py - Stripe
app/payments/stripe.py
Other components
- User / Frontend
Connections 30
- User / Frontend → FastAPI Routes: requests
- FastAPI Routes → Auth Services: authenticates
app/api/routes/auth.py - User / Frontend → Pipeline API: submits query
- Pipeline API → Entitlements and Usage: checks access
app/api/routes/pipeline.py - Pipeline API → Pipeline Factory: builds pipeline
app/api/routes/pipeline.py - Pipeline Factory → Pipeline Service: assembles
app/core/pipeline/factory.py - Pipeline Factory → Search Provider: configures
app/core/pipeline/factory.py - Pipeline Factory → Crawler Provider: configures
app/core/pipeline/factory.py - Pipeline Factory → AI Providers: selects provider
app/core/pipeline/factory.py - Pipeline Factory → Insight Repository: configures
app/core/pipeline/factory.py - Pipeline Service → Search Provider: searches
app/core/pipeline/pipeline_service.py - Pipeline Service → Crawler Provider: crawls results
app/core/pipeline/pipeline_service.py - Pipeline Service → AI Providers: analyzes documents
app/core/pipeline/pipeline_service.py - Pipeline Service → Trust Engine: scores insight
app/core/pipeline/pipeline_service.py - Pipeline Service → Insight Repository: saves insight
app/core/pipeline/pipeline_service.py - Insight Repository → PostgreSQL / pgvector: persists insight
app/core/pipeline/factory.py - Insights API → Semantic Cache: checks cache
- Semantic Cache → User / Frontend: returns cached insight
- Pipeline API → RabbitMQ Queue: dispatches task
- RabbitMQ Queue → Celery Workers: delivers task
- Celery Workers → Pipeline Factory: runs pipeline
app/core/pipeline/tasks.py - Celery Workers → Entitlements and Usage: rechecks quota
app/core/pipeline/tasks.py - Celery Workers → Events / Notifications: publishes completion
app/core/pipeline/tasks.py - Pipeline Service → Embedding Providers: creates embeddings
- User / Frontend → Scheduled Queries: schedules query
- Scheduled Queries → APScheduler: runs recurring queries
- Scheduled Queries → PostgreSQL / pgvector: stores schedule
app/core/scheduler/scheduled_query_service.py - User / Frontend → Subscriptions and Payments: manages subscription
- Subscriptions and Payments → Stripe: uses gateway
app/billing/subscriptions.py - Integrations API → AI Providers: configures integrations