How perennial-asian-boiz/perennialbackend works
PerennialBackend’s landed product workflow is a scheduled consensus-watchlist pipeline: collect congressional trades and ARK holdings, enrich candidate tickers with insider and short-interest signals, then aggregate and rank them. The backend also contains separate news-feed and Bing web-search ingestion scripts. The README marks those ingestion capabilities as not yet landed; their sampled source shows standalone functionality, not integration into the watchlist pipeline. Edges are limited to calls and data relationships evidenced by excerpts or documentation; unsampled wiring is omitted.
Main entry points: cron.py Pipeline scheduler · local_data Local JSON data · insider.py Insider activity · short_interest.py Short interest
Components 19
Watchlist pipeline
- Pipeline scheduler
development/backend/src/services/consensus_watchlist/scheduler/cron.py - Signal aggregation
development/backend/src/services/consensus_watchlist/consensus.py - Local JSON data
development/database/local_data
Signal collection
- Congress trades
development/backend/src/services/consensus_watchlist/fetchers/fmp.py - ARK holdings
development/backend/src/services/consensus_watchlist/fetchers/ark.py - Insider activity
development/backend/src/services/consensus_watchlist/fetchers/insider.py - Short interest
development/backend/src/services/consensus_watchlist/fetchers/short_interest.py
Content ingestion
- News ingestion
development/backend/src/services/news/news_fetcher.py - Web search ingestion
development/backend/src/services/search_engine/search_engine.py
Shared runtime
- Path resolution
development/backend/src/services/consensus_watchlist/paths.py - Logging utility
development/backend/src/utils/logger.py
Other components
- Operator
- Financial Modeling Prep
- ARK holdings service
- SecuritiesDB
- Nasdaq API
- News RSS feeds
- Bing search
- Article websites
Connections 28
- Operator → Pipeline scheduler: starts
README.md - Pipeline scheduler → Congress trades: runs
development/backend/src/services/consensus_watchlist/scheduler/cron.py - Pipeline scheduler → ARK holdings: runs
development/backend/src/services/consensus_watchlist/scheduler/cron.py - Pipeline scheduler → Insider activity: runs
development/backend/src/services/consensus_watchlist/scheduler/cron.py - Pipeline scheduler → Short interest: runs
development/backend/src/services/consensus_watchlist/scheduler/cron.py - Pipeline scheduler → Signal aggregation: runs
development/backend/src/services/consensus_watchlist/scheduler/cron.py - Congress trades → Financial Modeling Prep: fetches trades
development/backend/src/services/consensus_watchlist/fetchers/fmp.py - ARK holdings → ARK holdings service: fetches holdings
development/backend/src/services/consensus_watchlist/fetchers/ark.py - Insider activity → SecuritiesDB: requests activity
development/backend/src/services/consensus_watchlist/fetchers/insider.py - Short interest → Nasdaq API: fetches data
development/backend/src/services/consensus_watchlist/fetchers/short_interest.py - Congress trades → Local JSON data: writes trades
- ARK holdings → Local JSON data: writes holdings
development/backend/src/services/consensus_watchlist/fetchers/ark.py - Insider activity → Local JSON data: writes results
- Short interest → Local JSON data: writes results
- Signal aggregation → Local JSON data: reads signals
development/backend/src/services/consensus_watchlist/consensus.py - Insider activity → Local JSON data: reads candidate tickers
development/backend/src/services/consensus_watchlist/fetchers/insider.py - Short interest → Local JSON data: reads candidates
development/backend/src/services/consensus_watchlist/fetchers/short_interest.py - Congress trades → Path resolution: uses paths
development/backend/src/services/consensus_watchlist/fetchers/fmp.py - ARK holdings → Path resolution: uses paths
development/backend/src/services/consensus_watchlist/fetchers/ark.py - Insider activity → Path resolution: uses paths
development/backend/src/services/consensus_watchlist/fetchers/insider.py - Short interest → Path resolution: uses paths
development/backend/src/services/consensus_watchlist/fetchers/short_interest.py - Signal aggregation → Path resolution: uses paths
development/backend/src/services/consensus_watchlist/consensus.py - News RSS feeds → News ingestion: provides RSS
development/backend/src/services/news/news_fetcher.py - News ingestion → Article websites: fetches articles
development/backend/src/services/news/news_fetcher.py - Bing search → Web search ingestion: returns results
development/backend/src/services/search_engine/search_engine.py - Web search ingestion → Article websites: fetches pages
development/backend/src/services/search_engine/search_engine.py - News ingestion → Logging utility: uses logger
development/backend/src/services/news/news_fetcher.py - Web search ingestion → Logging utility: uses logger
development/backend/src/services/search_engine/search_engine.py