How badarulnisa/reverse-engine works
This repository is a collection of registry-specific extraction pipelines, with a secondary HAR/API-analysis and generic collection toolkit. The main user workflow is to choose a registry, enumerate or paginate its records using that registry’s access strategy, fetch details where available, preserve progress, and export a workbook. The README documents seven registry targets and their differing techniques. The sampled source confirms selected request, parsing, token, and traversal behavior; unsampled registry internals are represented only where the tree or README supports them.
Main entry points: run_adgm.py ADGM Crawl · run_enrich.py JAFZA Enrichment · api_client.py RPC Replay Client · places_client.py Places Client
Components 21
Registry Crawls
- DMCC Scraper
main.py - DIFC Scraper
difc_scraper.py - ADGM Crawl
adgm_scraper/run_adgm.py - DFSA Registers
dfsa_scraper/dfsa_common.py - JAFZA Enrichment
jafza_scrapper/run_enrich.py - Invest Dubai Crawl
investindubai/visitdubai_bruteforce.py - Qatar Chamber
qatrcid/qatarcid_scraper.py - Sharjah Crawl
sharjah-scrapper/sharjah_scrape.py
Collection Support
- RPC Replay Client
generated_collectors/api_client.py - Token Extraction
generated_collectors/token_manager.py - Prefix Fanout
generated_collectors/fanout_engine.py - Record Parsing
app/collectors/parser.py - Checkpoint and Export
adgm_scraper/run_adgm.py
HAR Analysis
- HAR Capture
- HAR Parser
app/core/har_parser.py - Audit and Findings
main.py
Data Enrichment
- Places Client
jafza_scrapper/places_client.py
Other components
- Operator
- Public Registries
- Google Places
- Excel Workbook
Connections 27
- Operator → DMCC Scraper: runs
- Operator → DIFC Scraper: runs
- Operator → ADGM Crawl: runs
- Operator → DFSA Registers: runs
- Operator → JAFZA Enrichment: runs
- Operator → Invest Dubai Crawl: runs
- Operator → Qatar Chamber: runs
- Operator → Sharjah Crawl: runs
- DMCC Scraper → RPC Replay Client: replays calls
- Token Extraction → RPC Replay Client: provides tokens
- RPC Replay Client → Public Registries: requests
- Prefix Fanout → RPC Replay Client: queries prefixes
- DIFC Scraper → Public Registries: sweeps queries
- ADGM Crawl → Public Registries: partitions listings
- ADGM Crawl → Checkpoint and Export: saves progress
- DFSA Registers → Public Registries: fetches listings
- JAFZA Enrichment → Public Registries: collects records
- Invest Dubai Crawl → Public Registries: enumerates records
- Qatar Chamber → Public Registries: fetches pages
- Sharjah Crawl → Public Registries: paginates results
- JAFZA Enrichment → Places Client: enriches matches
- Places Client → Google Places: searches places
- Places Client → JAFZA Enrichment: returns candidates
- HAR Capture → HAR Parser: provides capture
- HAR Parser → Audit and Findings: normalizes traffic
- Audit and Findings → Excel Workbook: writes report
- ADGM Crawl → Excel Workbook: exports records