How hhursev/recipe-scrapers works
recipe-scrapers is a Python library that turns recipe-page HTML into a consistent recipe API. The main workflow accepts HTML and its source URL (or optionally fetches a page), selects a site-specific scraper, parses recipe fields, and exposes structured results such as JSON. Schema.org and OpenGraph parsing, ingredient grouping, normalization helpers, configurable plugins, and image selection support that workflow. The graph combines README-documented behavior with SOURCE INDEX references; unsampled site implementations and plugin wiring are represented only where documented or indexed.
Main entry points: _abstract.py Scraper base · recipe_scrapers Site-specific scrapers · __init__.py Public API · _interface.py Plugin interface
Components 19
Entry and dispatch
- Public API
recipe_scrapers/__init__.py - Scraper factory
recipe_scrapers/_factory.py - Supported-site registry
recipe_scrapers/__init__.py
Site scrapers
- Site-specific scrapers
recipe_scrapers
Parsing and fields
- Scraper base
recipe_scrapers/_abstract.py - Schema.org parser
recipe_scrapers/_schemaorg.py - OpenGraph parser
recipe_scrapers/_opengraph.py - Parsing utilities
recipe_scrapers/_utils.py - Ingredient grouping
recipe_scrapers/_grouping_utils.py - WPRM support
recipe_scrapers/_wprm.py - Domain exceptions
recipe_scrapers/_exceptions.py - Package version
recipe_scrapers/__version__.py
Plugins and settings
- Plugin interface
recipe_scrapers/plugins/_interface.py - Best-image selection
recipe_scrapers/plugins/best_image.py - HTML tag stripping
recipe_scrapers/plugins/html_tags_stripper.py - Static-value handling
recipe_scrapers/plugins/static_values.py - Runtime settings
recipe_scrapers/settings/__init__.py
Other components
- Library caller
- Recipe websites
Connections 23
- Library caller → Public API: provides HTML
README.rst - Library caller → Public API: requests scrape
README.rst - Public API → Scraper factory: selects scraper
recipe_scrapers/__init__.py - Public API → Supported-site registry: looks up host
recipe_scrapers/__init__.py - Supported-site registry → Site-specific scrapers: dispatches host
recipe_scrapers/__init__.py - Site-specific scrapers → Scraper base: extends base
recipe_scrapers/aberlehome.py - Scraper base → Schema.org parser: parses schema
recipe_scrapers/_abstract.py - Scraper base → OpenGraph parser: parses metadata
recipe_scrapers/_abstract.py - Scraper base → Runtime settings: reads settings
recipe_scrapers/_abstract.py - Schema.org parser → Parsing utilities: uses helpers
recipe_scrapers/_schemaorg.py - Site-specific scrapers → Parsing utilities: uses helpers
recipe_scrapers/aberlehome.py - Site-specific scrapers → Ingredient grouping: groups ingredients
recipe_scrapers/acouplecooks.py - Site-specific scrapers → WPRM support: uses WPRM
recipe_scrapers/abeautifulmess.py - Scraper base → Domain exceptions: raises errors
recipe_scrapers/_abstract.py - Domain exceptions → Package version: formats version
recipe_scrapers/_exceptions.py - Scraper base → Plugin interface: checks and applies
recipe_scrapers/_abstract.py - Plugin interface → Best-image selection: plugin contract
recipe_scrapers/plugins/best_image.py - Plugin interface → HTML tag stripping: plugin contract
recipe_scrapers/plugins/html_tags_stripper.py - Plugin interface → Static-value handling: plugin contract
recipe_scrapers/plugins/static_values.py - Best-image selection → Runtime settings: reads settings
recipe_scrapers/plugins/best_image.py - HTML tag stripping → Runtime settings: reads settings
recipe_scrapers/plugins/html_tags_stripper.py - Static-value handling → Domain exceptions: handles exceptions
recipe_scrapers/plugins/static_values.py - Public API → Recipe websites: may fetch HTML
README.rst