How r0b0tt/covid19-scraper works
Web Scraping Layer
• 'spiders' directory which contains the web crawlers
• Currently shows who.py, likely scraping WHO (World Health Organization) data
API Service Layer
• Flask application (app.py)
• Services directory structure
• FAQs service module
• Use a hexagon or rectangle to represent the API endpoints
Infrastructure Components
• Docker container environment
• Gunicorn WSGI server (from bin/gunicorn.sh)
• Environment configuration (.env)
External Systems (Top Layer)
• Use cloud symbols or external system rectangles
Scraping Layer (Middle-Top Layer)
• Who.py spider module
Application Layer (Middle Layer)
• Services module structure
• FAQs service
Infrastructure Layer (Bottom Layer)
• Gunicorn WSGI server
• Configuration components
• External Systems: Light gray
• Scraping Components: Green
• API Services: Blue
• Infrastructure: Orange
Specific Elements to Include:
Environment configuration influence
Important Relationships to Highlight:
Infrastructure support for the application
• Data flow direction indicators
• Component type symbols
• Infrastructure boundaries
• External system indicators
Level of Detail:
• Keep the main components visible but don't drill down into individual code files
• Service architecture and data flow
• Separation between scraping and API serving
• Containerization boundary
Additional Notes:
• A note about the Python 3.7+ requirement
• HTTP port exposure (5000)
• REST API nature of the service