# naibowang/easyspider architecture

> Architecture diagram of the GitHub repository naibowang/easyspider, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-09). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/naibowang/easyspider
- Repository: https://github.com/naibowang/easyspider

## Overview

EasySpider is a visual, code-free browser automation and web data collection product, with a separate command-line execution mode. Its documented user workflow is to select page elements, configure a task, run it in a browser, and collect results; the README also describes matching repeated elements, selecting children, and looping through links to detail pages. The repository contains desktop and browser-extension interfaces plus Python execution components. Some subsystem connections are documented only at product level because their source was not sampled.

Main entry points: [`ExecuteStage/easyspider_executestage.py`](https://github.com/naibowang/easyspider/blob/master/ExecuteStage/easyspider_executestage.py) (Task runner), [`ExecuteStage/easyspider_executestage_single.py`](https://github.com/naibowang/easyspider/blob/master/ExecuteStage/easyspider_executestage_single.py) (Single-task runner), [`ExecuteStage/myChrome.py`](https://github.com/naibowang/easyspider/blob/master/ExecuteStage/myChrome.py) (Chrome driver), [`Extension/manifest_v3/src/content-scripts/main.js`](https://github.com/naibowang/easyspider/blob/master/Extension/manifest_v3/src/content-scripts/main.js) (Extension interaction)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_authoring["Task authoring"]
  node_designer["Visual designer"]
  node_element_picker["Element selection<br/>[global.js]"]
  node_toolkit["Selection toolkit<br/>[toolkit.vue]"]
  node_extension_entry["Extension interaction<br/>[main.js]"]
end

subgraph group_desktop["Desktop application"]
  node_electron_shell["Desktop shell<br/>[main.js]"]
  node_desktop_ui["Desktop interface<br/>[index.js]"]
  node_server["Task server<br/>[server.js]"]
end

subgraph group_runtime["Task execution"]
  node_task_runner["Task runner"]
  node_single_runner["Single-task runner"]
end

subgraph group_browser["Browser automation"]
  node_browser_driver["Chrome driver<br/>[myChrome.py]"]
  node_driver_core["Driver core<br/>[__init__.py]"]
  node_driver_patcher["Driver patcher<br/>[patcher.py]"]
end

node_user(("User"))
node_page(("Target webpage"))
node_cli_user(("CLI caller"))
node_collected_data["Collected data"]

node_user -->|"designs tasks"| node_designer
node_user -->|"selects elements"| node_page
node_designer -.->|"configures selection"| node_element_picker
node_extension_entry -->|"uses selection"| node_element_picker
node_extension_entry -->|"mounts toolkit"| node_toolkit
node_user -->|"runs tasks"| node_task_runner
node_cli_user -->|"runs tasks"| node_single_runner
node_task_runner -.->|"automates browser"| node_browser_driver
node_single_runner -.->|"automates browser"| node_browser_driver
node_browser_driver -->|"delegates driver control"| node_driver_core
node_driver_core -->|"uses patcher"| node_driver_patcher
node_task_runner -->|"produces results"| node_collected_data
node_single_runner -.->|"produces results"| node_collected_data
node_electron_shell -.->|"opens interface"| node_desktop_ui

click node_designer "https://github.com/naibowang/easyspider/tree/master/ElectronJS/src/taskGrid"
click node_element_picker "https://github.com/naibowang/easyspider/blob/master/Extension/manifest_v3/src/content-scripts/global.js"
click node_toolkit "https://github.com/naibowang/easyspider/blob/master/Extension/manifest_v3/src/content-scripts/toolkit.vue"
click node_extension_entry "https://github.com/naibowang/easyspider/blob/master/Extension/manifest_v3/src/content-scripts/main.js"
click node_electron_shell "https://github.com/naibowang/easyspider/blob/master/ElectronJS/main.js"
click node_desktop_ui "https://github.com/naibowang/easyspider/blob/master/ElectronJS/src/index.js"
click node_server "https://github.com/naibowang/easyspider/blob/master/ElectronJS/server.js"
click node_task_runner "https://github.com/naibowang/easyspider/blob/master/ExecuteStage/easyspider_executestage.py"
click node_single_runner "https://github.com/naibowang/easyspider/blob/master/ExecuteStage/easyspider_executestage_single.py"
click node_browser_driver "https://github.com/naibowang/easyspider/blob/master/ExecuteStage/myChrome.py"
click node_driver_core "https://github.com/naibowang/easyspider/blob/master/ExecuteStage/undetected_chromedriver_ES/__init__.py"
click node_driver_patcher "https://github.com/naibowang/easyspider/blob/master/ExecuteStage/undetected_chromedriver_ES/patcher.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_designer,node_element_picker,node_toolkit,node_extension_entry,node_user toneBlue
class node_electron_shell,node_desktop_ui,node_server toneAmber
class node_task_runner,node_single_runner toneMint
class node_browser_driver,node_driver_core,node_driver_patcher toneRose
class node_page,node_cli_user,node_collected_data toneIndigo
```

## Components

### Task authoring

- [Visual designer](https://github.com/naibowang/easyspider/tree/master/ElectronJS/src/taskGrid): `ElectronJS/src/taskGrid`
- [Element selection](https://github.com/naibowang/easyspider/blob/master/Extension/manifest_v3/src/content-scripts/global.js): `Extension/manifest_v3/src/content-scripts/global.js`
- [Selection toolkit](https://github.com/naibowang/easyspider/blob/master/Extension/manifest_v3/src/content-scripts/toolkit.vue): `Extension/manifest_v3/src/content-scripts/toolkit.vue`
- [Extension interaction](https://github.com/naibowang/easyspider/blob/master/Extension/manifest_v3/src/content-scripts/main.js): `Extension/manifest_v3/src/content-scripts/main.js`

### Desktop application

- [Desktop shell](https://github.com/naibowang/easyspider/blob/master/ElectronJS/main.js): `ElectronJS/main.js`
- [Desktop interface](https://github.com/naibowang/easyspider/blob/master/ElectronJS/src/index.js): `ElectronJS/src/index.js`
- [Task server](https://github.com/naibowang/easyspider/blob/master/ElectronJS/server.js): `ElectronJS/server.js`

### Task execution

- [Task runner](https://github.com/naibowang/easyspider/blob/master/ExecuteStage/easyspider_executestage.py): `ExecuteStage/easyspider_executestage.py`
- [Single-task runner](https://github.com/naibowang/easyspider/blob/master/ExecuteStage/easyspider_executestage_single.py): `ExecuteStage/easyspider_executestage_single.py`

### Browser automation

- [Chrome driver](https://github.com/naibowang/easyspider/blob/master/ExecuteStage/myChrome.py): `ExecuteStage/myChrome.py`
- [Driver core](https://github.com/naibowang/easyspider/blob/master/ExecuteStage/undetected_chromedriver_ES/__init__.py): `ExecuteStage/undetected_chromedriver_ES/__init__.py`
- [Driver patcher](https://github.com/naibowang/easyspider/blob/master/ExecuteStage/undetected_chromedriver_ES/patcher.py): `ExecuteStage/undetected_chromedriver_ES/patcher.py`

### Other components

- **User**
- **Target webpage**
- **CLI caller**
- **Collected data**

## Connections

- User → Visual designer: designs tasks
- User → Target webpage: selects elements
- Visual designer → Element selection: configures selection
- Extension interaction → Element selection: uses selection (evidence: `Extension/manifest_v3/src/content-scripts/main.js`)
- Extension interaction → Selection toolkit: mounts toolkit (evidence: `Extension/manifest_v3/src/content-scripts/main.js`)
- User → Task runner: runs tasks
- CLI caller → Single-task runner: runs tasks
- Task runner → Chrome driver: automates browser (evidence: `ExecuteStage/easyspider_executestage.py`)
- Single-task runner → Chrome driver: automates browser
- Chrome driver → Driver core: delegates driver control (evidence: `ExecuteStage/myChrome.py`)
- Driver core → Driver patcher: uses patcher (evidence: `ExecuteStage/undetected_chromedriver_ES/__init__.py`)
- Task runner → Collected data: produces results
- Single-task runner → Collected data: produces results
- Desktop shell → Desktop interface: opens interface
