How gabih1/uk-vat-identifier-discovery works
This is a research proof of concept for discovering UK company VAT candidates from public sources, then checking candidates with HMRC and reviewing whether the returned legal entity matches. The principal workflow uses a Companies House sample, tries guessed or supplied domains, scans pages, extracts candidates, and records evidence; search, Common Crawl, marketplace, and procurement experiments are distinct discovery routes. Source excerpts show shared extraction and search calls, but do not show a production pipeline linking discovery to HMRC, so that documented handoff is dashed.
Main entry points: esantion_1000_companii.csv Company sample · domain_guessing.py Live-site scan · vat_utils.py VAT extraction · search_utils.py Search scan runner
Components 16
Company sample
- Company sample
esantion_1000_companii.csv - Sample preparation
pregatire.py
Web discovery
- Live-site scan
domain_guessing.py
Alternative sources
- DuckDuckGo search
experiments/duckduckgo_search_attempt.py - Google search
experiments/google_search_attempt.py - Search scan runner
experiments/search_utils.py - Common Crawl scan
common_crawl_check.py - Amazon seller scan
experiments/amazon_vat_pipeline.py - Contracts Finder
experiments/contracts_finder_check.py
Candidate analysis
- Discovery results
results/openweb.csv - VAT extraction
vat_utils.py - Discovery helpers
discovery_utils.py
Verification
- HMRC VAT checker
hmrc_validate.py - HMRC API
- Entity match review
Other components
- Companies House
Connections 23
- Companies House → Sample preparation: provides records
readme.md - Sample preparation → Company sample: writes sample
pregatire.py - Company sample → Live-site scan: supplies companies
domain_guessing.py - Live-site scan → Discovery helpers: uses helpers
domain_guessing.py - Live-site scan → VAT extraction: extracts candidates
domain_guessing.py - Live-site scan → Discovery results: writes results
domain_guessing.py - Company sample → DuckDuckGo search: supplies companies
experiments/duckduckgo_search_attempt.py - DuckDuckGo search → Search scan runner: runs search
experiments/duckduckgo_search_attempt.py - Company sample → Google search: supplies companies
experiments/google_search_attempt.py - Google search → Search scan runner: runs search
experiments/google_search_attempt.py - Search scan runner → Live-site scan: scans results
experiments/search_utils.py - Search scan runner → Discovery helpers: uses helpers
experiments/search_utils.py - Company sample → Common Crawl scan: supplies companies
common_crawl_check.py - Common Crawl scan → Discovery helpers: uses helpers
common_crawl_check.py - Common Crawl scan → VAT extraction: extracts candidates
common_crawl_check.py - Company sample → Amazon seller scan: research context
readme.md - Amazon seller scan → Discovery helpers: uses helpers
experiments/amazon_vat_pipeline.py - Amazon seller scan → VAT extraction: extracts candidates
experiments/amazon_vat_pipeline.py - Contracts Finder → VAT extraction: validates format
experiments/contracts_finder_check.py - VAT extraction → Entity match review: provides candidate evidence
- Discovery results → HMRC VAT checker: candidate for checking
readme.md - HMRC VAT checker → HMRC API: checks VAT
hmrc_validate.py - HMRC VAT checker → Entity match review: returns entity details
hmrc_validate.py