How josh0xa/darkdump works
Darkdump is an OSINT search and investigation tool with CLI and local-web entry points. The main workflow submits a query to one of six search engines, checks results against Ahmia’s abuse blacklist, optionally scrapes result sites, and returns or exports findings. A separate breach-intelligence mode generates related searches and classifies/extracts artefacts from results. Tor proxying, deduplication, image collection, and live web streaming are supporting capabilities. The map combines README-documented features with sampled code; several internal relationships and the CLI’s detailed control flow are not shown in the excerpts.
Main entry points: app.py Web interface · darkdump.py CLI · index.html Browser UI · agents.py User-agent pool
Components 14
User interfaces
- CLI
darkdump.py - Web interface
darkdump-web/app.py - Browser UI
darkdump-web/templates/index.html
Search and safeguards
- Search engines
darkdump.py - Abuse blacklist
darkdump.py
Investigation
- Site scraping
darkdump.py - Breach intelligence
darkdump.py - Result deduplication
darkdump.py
Transport and output
- Result export
darkdump.py - Live event stream
darkdump-web/app.py - User-agent pool
headers/agents.py
Other components
- Researcher
- Ahmia blacklist
- Tor service
Connections 21
- Researcher → CLI: runs search
README.md - Researcher → Browser UI: enters query
README.md - Browser UI → Web interface: submits options
darkdump-web/app.py - CLI → Search engines: searches engines
README.md - Web interface → Search engines: calls fetchers
darkdump-web/app.py - Search engines → Abuse blacklist: filters results
README.md - Abuse blacklist → Ahmia blacklist: checks blacklist
README.md - CLI → Site scraping: optionally scrapes
README.md - Web interface → Site scraping: optionally scrapes
darkdump-web/app.py - CLI → Breach intelligence: runs scan
README.md - Web interface → Breach intelligence: runs scan
darkdump-web/app.py - Web interface → Result deduplication: deduplicates results
darkdump-web/app.py - CLI → Result deduplication: deduplicates results
README.md - CLI → Result export: saves results
README.md - Web interface → Result export: exports results
README.md - Web interface → Live event stream: streams events
darkdump-web/app.py - Live event stream → Browser UI: updates display
README.md - CLI → Tor service: proxies requests
README.md - Web interface → Tor service: checks and proxies
darkdump-web/app.py - Web interface → User-agent pool: selects user agent
darkdump-web/app.py - CLI → User-agent pool: uses user agents
darkdump.py