How frankoslaw/longscrape works
Longscrape is a small Python scraping library. A caller supplies a URL to the HTTP fetcher, which requests the page and returns a Document. The package also defines Fetcher and Extractor protocols; Extractor describes turning documents into records, but no extractor implementation or end-to-end orchestration is present in the sampled source. The README provides no further product capabilities, so the graph reflects only these supported behaviors.
Main entry points: httpx_fetcher.py HTTP fetcher · protocols.py Extractor protocol · models.py Fetched document
Components 8
Other components
- Library caller
- HTTP fetcher
packages/longscrape/src/longscrape/fetchers/httpx_fetcher.py - Fetcher protocol
packages/longscrape/src/longscrape/protocols.py - Extractor protocol
packages/longscrape/src/longscrape/protocols.py - URL input
packages/longscrape/src/longscrape/models.py - Fetched document
packages/longscrape/src/longscrape/models.py - Extracted record
packages/longscrape/src/longscrape/models.py - HTTP server
Connections 8
- Library caller → HTTP fetcher: calls fetch
- Library caller → URL input: supplies URL
- HTTP fetcher → Fetcher protocol: implements
- HTTP fetcher → HTTP server: requests page
- HTTP server → HTTP fetcher: returns response
- HTTP fetcher → Fetched document: returns document
- Extractor protocol → Fetched document: accepts document
- Extractor protocol → Extracted record: yields records