How sayantan0008/newsbite works
NewsBite fetches news, cleans article text, summarizes and categorizes it, then optimizes and stores the processed articles for an interactive Streamlit dashboard. The dashboard reads saved data and offers browsing features including search, filters, bookmarks, and trending topics. The README documents these capabilities; the source excerpts show the batch runner’s calls and key utility behavior. Dashboard internals are only partially excerpted, so its feature links rely on the dashboard’s indexed references or README documentation. Compatibility patches are included as a supporting runtime layer, not as part of the article-processing sequence.
Main entry points: main.py Pipeline Runner · dashboard.py News Dashboard · news_fetcher.py News Fetcher · bookmark_manager.py Bookmarks
Components 18
News Pipeline
- Pipeline Runner
main.py - News Fetcher
services/news_fetcher.py - Text Preprocessing
utils/preprocessing.py - Content Optimization
utils/data_storage.py
Analysis Models
- Article Summarizer
model/summarizer.py - Article Categorizer
model/categorizer.py
Dashboard Features
- News Dashboard
app/dashboard.py - Search and Filters
app/dashboard.py - Bookmarks
utils/bookmark_manager.py - Trending Topics
utils/trending_topics.py
Storage and Compatibility
- Processed News
data - Bookmark File
data/bookmarks.json - Trending Data
data/trending_topics.json - Torch-Streamlit Patch
utils/torch_streamlit_patch.py - Streamlit Patch
streamlit_patch.py
Other components
- Pipeline Operator
- NewsAPI
- Dashboard User
Connections 17
- Pipeline Operator → Pipeline Runner: runs
main.py - Pipeline Runner → News Fetcher: fetches articles
main.py - News Fetcher → NewsAPI: requests news
services/news_fetcher.py - Pipeline Runner → Text Preprocessing: cleans articles
main.py - Pipeline Runner → Article Summarizer: summarizes articles
main.py - Pipeline Runner → Article Categorizer: categorizes articles
main.py - Pipeline Runner → Content Optimization: optimizes content
main.py - Pipeline Runner → Processed News: saves results
main.py - Dashboard User → News Dashboard: browses news
README.md - News Dashboard → Processed News: loads articles
app/dashboard.py - News Dashboard → Search and Filters: provides
README.md - News Dashboard → Bookmarks: uses
app/dashboard.py - Bookmarks → Bookmark File: reads and writes
utils/bookmark_manager.py - News Dashboard → Trending Topics: loads topics
app/dashboard.py - Trending Topics → Trending Data: reads and writes
utils/trending_topics.py - Pipeline Runner → Torch-Streamlit Patch: applies patches
main.py - News Dashboard → Streamlit Patch: uses compatibility patch
README.md