# cv-cat/douyin_spider architecture

> Architecture diagram of the GitHub repository cv-cat/douyin_spider, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-09-30). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/cv-cat/douyin_spider
- Repository: https://github.com/cv-cat/douyin_spider

## Overview

DouYin_Spider is a Douyin data-collection and interaction client. Its main workflow is a user invoking the crawler, which calls API wrappers and formats collected data; separate entry points support login, live-room monitoring, messaging, and creator publishing. The graph includes the shared authentication, request, and signing layer. Some capabilities come from the README and source index rather than sampled implementation, so those links are documented relationships, not claims of source-level inspection.

Main entry points: [`dy_apis/douyin_api.py`](https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_api.py) (Douyin API), [`dy_apis/douyin_creator_api.py`](https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_creator_api.py) (Creator publishing), [`builder/auth.py`](https://github.com/cv-cat/douyin_spider/blob/master/builder/auth.py) (Shared authentication), [`dy_live/server.py`](https://github.com/cv-cat/douyin_spider/blob/master/dy_live/server.py) (Live listener)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_entry["Entrypoints and output"]
  node_crawler["Crawler entry<br/>[main.py]"]
  node_formatting["Data formatting<br/>[data_util.py]"]
end

subgraph group_collection["Collection and interaction"]
  node_douyin_api["Douyin API<br/>[douyin_api.py]"]
  node_collection_features["Collection features<br/>[douyin_api.py]"]
  node_interaction_features["Interaction features<br/>[douyin_api.py]"]
end

subgraph group_live_msg["Live and messaging"]
  node_live_server["Live listener<br/>[server.py]"]
  node_pk_parser["PK event parser<br/>[pk.py]"]
  node_message_receiver["DM receiver<br/>[douyin_recv_msg.py]"]
end

subgraph group_creator_login["Login and creator"]
  node_creator_publish["Creator publishing"]
  node_media_upload["Media upload<br/>[douyin_im_media.py]"]
  node_quick_publish["Publish entry<br/>[quick_publish.py]"]
  node_login["Login flows<br/>[login_api.py]"]
end

subgraph group_shared["Shared request layer"]
  node_auth["Shared authentication<br/>[auth.py]"]
  node_headers["Request headers<br/>[header.py]"]
  node_params["Request parameters<br/>[params.py]"]
  node_signing["Signing utilities<br/>[dy_util.py]"]
  node_fingerprint["Browser fingerprint<br/>[fingerprint.py]"]
  node_http["HTTP client<br/>[http_client.py]"]
end

node_user(("Operator"))
node_douyin{{"Douyin platform"}}
node_output["JSON / Excel / media"]

node_user -->|"runs"| node_crawler
node_crawler -->|"calls"| node_douyin_api
node_crawler -->|"uses"| node_formatting
node_formatting -->|"formats"| node_output
node_douyin_api -->|"provides"| node_collection_features
node_douyin_api -->|"provides"| node_interaction_features
node_douyin_api -->|"requests"| node_douyin
node_live_server -->|"calls"| node_douyin_api
node_live_server -->|"dispatches"| node_pk_parser
node_live_server -->|"listens"| node_douyin
node_message_receiver -->|"uses"| node_douyin_api
node_message_receiver -->|"receives messages"| node_douyin
node_quick_publish -->|"calls"| node_creator_publish
node_creator_publish -->|"uses"| node_media_upload
node_creator_publish -->|"publishes to"| node_douyin
node_user -->|"starts"| node_login
node_login -->|"creates session"| node_auth
node_douyin_api -->|"uses"| node_auth
node_creator_publish -->|"uses"| node_auth
node_live_server -->|"uses"| node_auth
node_douyin_api -->|"builds requests"| node_headers
node_douyin_api -->|"builds requests"| node_params
node_headers -->|"uses"| node_signing
node_params -->|"uses"| node_signing
node_signing -->|"uses"| node_fingerprint
node_headers -->|"uses"| node_fingerprint
node_params -->|"uses"| node_fingerprint
node_douyin_api -->|"sends requests"| node_http
node_creator_publish -->|"sends requests"| node_http
node_login -->|"sends requests"| node_http
node_auth -->|"maintains session"| node_http

click node_crawler "https://github.com/cv-cat/douyin_spider/blob/master/main.py"
click node_formatting "https://github.com/cv-cat/douyin_spider/blob/master/utils/data_util.py"
click node_douyin_api "https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_api.py"
click node_collection_features "https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_api.py"
click node_interaction_features "https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_api.py"
click node_live_server "https://github.com/cv-cat/douyin_spider/blob/master/dy_live/server.py"
click node_pk_parser "https://github.com/cv-cat/douyin_spider/blob/master/dy_live/pk.py"
click node_message_receiver "https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_recv_msg.py"
click node_creator_publish "https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_creator_api.py"
click node_media_upload "https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_im_media.py"
click node_quick_publish "https://github.com/cv-cat/douyin_spider/blob/master/quick_publish.py"
click node_login "https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/login_api.py"
click node_auth "https://github.com/cv-cat/douyin_spider/blob/master/builder/auth.py"
click node_headers "https://github.com/cv-cat/douyin_spider/blob/master/builder/header.py"
click node_params "https://github.com/cv-cat/douyin_spider/blob/master/builder/params.py"
click node_signing "https://github.com/cv-cat/douyin_spider/blob/master/utils/dy_util.py"
click node_fingerprint "https://github.com/cv-cat/douyin_spider/blob/master/utils/fingerprint.py"
click node_http "https://github.com/cv-cat/douyin_spider/blob/master/utils/http_client.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_crawler,node_formatting toneBlue
class node_douyin_api,node_collection_features,node_interaction_features toneAmber
class node_live_server,node_pk_parser,node_message_receiver toneMint
class node_creator_publish,node_media_upload,node_quick_publish,node_login toneRose
class node_auth,node_headers,node_params,node_signing,node_fingerprint,node_http,node_user,node_douyin,node_output toneIndigo
```

## Components

### Entrypoints and output

- [Crawler entry](https://github.com/cv-cat/douyin_spider/blob/master/main.py): `main.py`
- [Data formatting](https://github.com/cv-cat/douyin_spider/blob/master/utils/data_util.py): `utils/data_util.py`

### Collection and interaction

- [Douyin API](https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_api.py): `dy_apis/douyin_api.py`
- [Collection features](https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_api.py): `dy_apis/douyin_api.py`
- [Interaction features](https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_api.py): `dy_apis/douyin_api.py`

### Live and messaging

- [Live listener](https://github.com/cv-cat/douyin_spider/blob/master/dy_live/server.py): `dy_live/server.py`
- [PK event parser](https://github.com/cv-cat/douyin_spider/blob/master/dy_live/pk.py): `dy_live/pk.py`
- [DM receiver](https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_recv_msg.py): `dy_apis/douyin_recv_msg.py`

### Login and creator

- [Creator publishing](https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_creator_api.py): `dy_apis/douyin_creator_api.py`
- [Media upload](https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/douyin_im_media.py): `dy_apis/douyin_im_media.py`
- [Publish entry](https://github.com/cv-cat/douyin_spider/blob/master/quick_publish.py): `quick_publish.py`
- [Login flows](https://github.com/cv-cat/douyin_spider/blob/master/dy_apis/login_api.py): `dy_apis/login_api.py`

### Shared request layer

- [Shared authentication](https://github.com/cv-cat/douyin_spider/blob/master/builder/auth.py): `builder/auth.py`
- [Request headers](https://github.com/cv-cat/douyin_spider/blob/master/builder/header.py): `builder/header.py`
- [Request parameters](https://github.com/cv-cat/douyin_spider/blob/master/builder/params.py): `builder/params.py`
- [Signing utilities](https://github.com/cv-cat/douyin_spider/blob/master/utils/dy_util.py): `utils/dy_util.py`
- [Browser fingerprint](https://github.com/cv-cat/douyin_spider/blob/master/utils/fingerprint.py): `utils/fingerprint.py`
- [HTTP client](https://github.com/cv-cat/douyin_spider/blob/master/utils/http_client.py): `utils/http_client.py`

### Other components

- **Operator**
- **Douyin platform**
- **JSON / Excel / media**

## Connections

- Operator → Crawler entry: runs
- Crawler entry → Douyin API: calls (evidence: `main.py`)
- Crawler entry → Data formatting: uses (evidence: `main.py`)
- Data formatting → JSON / Excel / media: formats
- Douyin API → Collection features: provides (evidence: `dy_apis/douyin_api.py`)
- Douyin API → Interaction features: provides (evidence: `dy_apis/douyin_api.py`)
- Douyin API → Douyin platform: requests (evidence: `dy_apis/douyin_api.py`)
- Live listener → Douyin API: calls (evidence: `dy_live/server.py`)
- Live listener → PK event parser: dispatches (evidence: `dy_live/server.py`)
- Live listener → Douyin platform: listens (evidence: `dy_live/server.py`)
- DM receiver → Douyin API: uses (evidence: `dy_apis/douyin_recv_msg.py`)
- DM receiver → Douyin platform: receives messages
- Publish entry → Creator publishing: calls (evidence: `quick_publish.py`)
- Creator publishing → Media upload: uses (evidence: `dy_apis/douyin_creator_api.py`)
- Creator publishing → Douyin platform: publishes to
- Operator → Login flows: starts
- Login flows → Shared authentication: creates session (evidence: `builder/auth.py`)
- Douyin API → Shared authentication: uses (evidence: `dy_apis/douyin_api.py`)
- Creator publishing → Shared authentication: uses (evidence: `dy_apis/douyin_creator_api.py`)
- Live listener → Shared authentication: uses (evidence: `dy_live/server.py`)
- Douyin API → Request headers: builds requests (evidence: `dy_apis/douyin_api.py`)
- Douyin API → Request parameters: builds requests (evidence: `dy_apis/douyin_api.py`)
- Request headers → Signing utilities: uses (evidence: `builder/header.py`)
- Request parameters → Signing utilities: uses (evidence: `builder/params.py`)
- Signing utilities → Browser fingerprint: uses (evidence: `utils/dy_util.py`)
- Request headers → Browser fingerprint: uses (evidence: `builder/header.py`)
- Request parameters → Browser fingerprint: uses (evidence: `builder/params.py`)
- Douyin API → HTTP client: sends requests (evidence: `dy_apis/douyin_api.py`)
- Creator publishing → HTTP client: sends requests (evidence: `dy_apis/douyin_creator_api.py`)
- Login flows → HTTP client: sends requests (evidence: `dy_apis/login_api.py`)
- Shared authentication → HTTP client: maintains session (evidence: `builder/auth.py`)
