How eckarthik/hideme works
Project type and purpose
• HideMe is an open-source Python library whose sole purpose is to fetch and return a list of free proxy servers by scraping public proxy-listing websites. There is no frontend UI or persistent data store—this is a standalone utility package.
File structure
• Top level:
• .gitignore, .travis.yml, LICENSE, README.md (repo metadata & CI)
• tests.py (unit/integration tests)
• hideme/ (package directory)
• hideme/ contains:
• __init__.py (package entry point)
• proxy_collector.py (main scraper and filter logic)
• user_agents.txt (static list of User-Agent strings used when making HTTP requests)
Pulling in README insights
• Core class: ProxiesList
• API: ProxiesList(...filters...) → get(count=N) → returns a list of dicts with proxy attributes
• No external dependencies beyond Python HTTP and parsing libraries (requests, BeautifulSoup, etc., implied)
Main components
a) Client / Consumer Code
• Your application or script that does:
from hideme.proxy_collector import ProxiesList
proxies = ProxiesList(...).get()
b) HideMe Library
• ProxyCollector Module:
• HTTP Request Layer
• HTML Parser
• Filter Engine (applies country, https, port, google_support)
• Data Model (proxy entry dict)
• user_agents.txt (resource file)
c) External Services
• Free proxy websites (one or multiple URLs) that ProxyCollector scrapes
d) Test Runner (tests.py) and CI (Travis) – optional side notes
Relationships and interactions
• Client → invokes ProxyCollector API
• ProxyCollector → reads user_agents.txt → selects a User-Agent header
• ProxyCollector → issues HTTP GETs to external proxy websites
• Response → parsed by HTML Parser → raw proxy data extracted
• Filter Engine → applies user-provided filters (country, https, port, google_support)
• Returns → list of standardized proxy dicts to Client
Architectural patterns / design principles
• Single-responsibility modules: HTTP layer, parsing, filtering
• Resource-based architecture: static user agents file separated from code
• Open-source tool emphasis on simplicity and modularity