# flabbergastedbd/thedumpster architecture

> Architecture diagram of the GitHub repository flabbergastedbd/thedumpster, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-19). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/flabbergastedbd/thedumpster
- Repository: https://github.com/flabbergastedbd/thedumpster

## Overview

thedumpster is a command-line passive-recon tool that searches Google for a domain using selected dorks, then reports discovered URLs. The workflow supports GHDB and admin-panel dorks, extra and excluded terms, robots.txt and Pastebin searches, and either Google API or direct web search; proxies are optional. The graph separates CLI orchestration, search/parsing, and dork data. Some CLI code is excerpted only in part, so links for features documented by the README are limited to relationships visible in the excerpts.

Main entry points: [`thedumpster.py`](https://github.com/flabbergastedbd/thedumpster/blob/master/thedumpster.py) (Recon CLI), [`lib/googlesearch.py`](https://github.com/flabbergastedbd/thedumpster/blob/master/lib/googlesearch.py) (Google search), [`config`](https://github.com/flabbergastedbd/thedumpster/blob/master/config) (Proxy config), [`lib/parser.py`](https://github.com/flabbergastedbd/thedumpster/blob/master/lib/parser.py) (Result parsers)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_cli["CLI workflow"]
  node_cli["Recon CLI<br/>[thedumpster.py]"]
  node_proxy_config["Proxy config"]
end

subgraph group_search["Search and parsing"]
  node_search_engine["Google search<br/>[googlesearch.py]"]
  node_parser["Result parsers<br/>[parser.py]"]
end

subgraph group_dorks["Dork data"]
  node_ghdb[("GHDB dorks<br/>[ghdb.db]")]
  node_admin_db[("Admin dorks<br/>[adminpage.db]")]
end

subgraph group_results["Recon queries"]
  node_pastebin["Pastebin queries<br/>[thedumpster.py]"]
  node_robots["Robots discovery<br/>[thedumpster.py]"]
  node_dork_search["Dork searches<br/>[thedumpster.py]"]
  node_console["URL output<br/>[thedumpster.py]"]
end

node_user(("Operator"))
node_google{{"Google Search"}}
node_custom_search{{"Google Custom Search"}}

node_user -->|"runs"| node_cli
node_cli -->|"reads"| node_proxy_config
node_cli -->|"loads dorks"| node_ghdb
node_cli -->|"loads dorks"| node_admin_db
node_cli -.->|"runs"| node_pastebin
node_cli -->|"runs"| node_robots
node_cli -->|"runs"| node_dork_search
node_dork_search -->|"queries"| node_search_engine
node_robots -->|"queries"| node_search_engine
node_pastebin -.->|"queries"| node_search_engine
node_search_engine -->|"requests results"| node_google
node_search_engine -->|"requests results"| node_custom_search
node_search_engine -->|"parses with"| node_parser
node_cli -->|"prints URLs"| node_console

click node_cli "https://github.com/flabbergastedbd/thedumpster/blob/master/thedumpster.py"
click node_proxy_config "https://github.com/flabbergastedbd/thedumpster/blob/master/config"
click node_ghdb "https://github.com/flabbergastedbd/thedumpster/blob/master/database/ghdb.db"
click node_admin_db "https://github.com/flabbergastedbd/thedumpster/blob/master/database/adminpage.db"
click node_search_engine "https://github.com/flabbergastedbd/thedumpster/blob/master/lib/googlesearch.py"
click node_parser "https://github.com/flabbergastedbd/thedumpster/blob/master/lib/parser.py"
click node_pastebin "https://github.com/flabbergastedbd/thedumpster/blob/master/thedumpster.py"
click node_robots "https://github.com/flabbergastedbd/thedumpster/blob/master/thedumpster.py"
click node_dork_search "https://github.com/flabbergastedbd/thedumpster/blob/master/thedumpster.py"
click node_console "https://github.com/flabbergastedbd/thedumpster/blob/master/thedumpster.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_cli,node_proxy_config toneBlue
class node_search_engine,node_parser toneAmber
class node_ghdb,node_admin_db toneMint
class node_pastebin,node_robots,node_dork_search,node_console toneRose
class node_user,node_google,node_custom_search toneIndigo
```

## Components

### CLI workflow

- [Recon CLI](https://github.com/flabbergastedbd/thedumpster/blob/master/thedumpster.py): `thedumpster.py`
- [Proxy config](https://github.com/flabbergastedbd/thedumpster/blob/master/config): `config`

### Search and parsing

- [Google search](https://github.com/flabbergastedbd/thedumpster/blob/master/lib/googlesearch.py): `lib/googlesearch.py`
- [Result parsers](https://github.com/flabbergastedbd/thedumpster/blob/master/lib/parser.py): `lib/parser.py`

### Dork data

- [GHDB dorks](https://github.com/flabbergastedbd/thedumpster/blob/master/database/ghdb.db): `database/ghdb.db`
- [Admin dorks](https://github.com/flabbergastedbd/thedumpster/blob/master/database/adminpage.db): `database/adminpage.db`

### Recon queries

- [Pastebin queries](https://github.com/flabbergastedbd/thedumpster/blob/master/thedumpster.py): `thedumpster.py`
- [Robots discovery](https://github.com/flabbergastedbd/thedumpster/blob/master/thedumpster.py): `thedumpster.py`
- [Dork searches](https://github.com/flabbergastedbd/thedumpster/blob/master/thedumpster.py): `thedumpster.py`
- [URL output](https://github.com/flabbergastedbd/thedumpster/blob/master/thedumpster.py): `thedumpster.py`

### Other components

- **Operator**
- **Google Search**
- **Google Custom Search**

## Connections

- Operator → Recon CLI: runs (evidence: `README.md`)
- Recon CLI → Proxy config: reads (evidence: `thedumpster.py`)
- Recon CLI → GHDB dorks: loads dorks (evidence: `thedumpster.py`)
- Recon CLI → Admin dorks: loads dorks (evidence: `thedumpster.py`)
- Recon CLI → Pastebin queries: runs (evidence: `thedumpster.py`)
- Recon CLI → Robots discovery: runs (evidence: `thedumpster.py`)
- Recon CLI → Dork searches: runs (evidence: `thedumpster.py`)
- Dork searches → Google search: queries (evidence: `thedumpster.py`)
- Robots discovery → Google search: queries (evidence: `thedumpster.py`)
- Pastebin queries → Google search: queries (evidence: `thedumpster.py`)
- Google search → Google Search: requests results (evidence: `lib/googlesearch.py`)
- Google search → Google Custom Search: requests results (evidence: `lib/googlesearch.py`)
- Google search → Result parsers: parses with (evidence: `lib/googlesearch.py`)
- Recon CLI → URL output: prints URLs (evidence: `thedumpster.py`)
