How svetoslavseo/google-trends-automation works
Main Components
a. Data Source
• Google Trends RSS feed (UK region).
b. Processing Pipeline (Notebook/Script)
• Fetch & parse RSS via feedparser.
• Transform into Pandas DataFrame.
• Time-zone conversion (pytz).
• Optional categorization step (placeholder for external Knowledge Panel or DataForSEO API calls, e.g. via requests or OpenAI).
c. Storage Backend
• Google Sheets (via gspread + oauth2client).
d. Users/Operators
• Principal interacts via Google Colab or local Jupyter environment.
Architectural Patterns & Principles
• Pipeline pattern: sequential fetch → transform → load (ETL).
• Idempotent appends: checks to avoid duplicate rows in sheet.
• Modular placeholders: categorize_with_knowledge_graph() can be replaced/extended.
• Separation of concerns:
• Data retrieval (feedparser)
• Business logic/transformation (pandas, pytz)
• Persistence (gspread/oauth2client)
• External API integration (requests, openai)
Technologies & Frameworks
• feedparser, pandas, pytz
• requests (for external APIs)
• openai or DataForSEO placeholder
• gspread + oauth2client for Google Sheets
• Hosted/edited in Google Colab