# digitalcriminal/archivedultimascraper architecture

> Architecture diagram of the GitHub repository digitalcriminal/archivedultimascraper, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/digitalcriminal/archivedultimascraper
- Repository: https://github.com/digitalcriminal/archivedultimascraper

## Overview

UltimaScraper is a command-line account and content archiver for OnlyFans and Fansly. Its main workflow loads configuration, selects a site, authenticates accounts, chooses profiles and subscriptions, prepares scrape/download jobs, and processes them; it also restores saved profiles and reports progress. The core orchestration is visible, but several domain managers come from separately installed packages, and the README provides little additional product detail. External package behavior is therefore represented only where the sampled code calls it.

Main entry points: [`ultima_scraper/ultima_scraper.py`](https://github.com/digitalcriminal/archivedultimascraper/blob/master/ultima_scraper/ultima_scraper.py) (Scraper orchestrator), [`start_us.py`](https://github.com/digitalcriminal/archivedultimascraper/blob/master/start_us.py) (CLI and loop), [`ultima_scraper/managers/dashboard_controller_api.py`](https://github.com/digitalcriminal/archivedultimascraper/blob/master/ultima_scraper/managers/dashboard_controller_api.py) (Dashboard controller), [`ultima_scraper/managers/ui_manager.py`](https://github.com/digitalcriminal/archivedultimascraper/blob/master/ultima_scraper/managers/ui_manager.py) (UI manager)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_entry["Startup and orchestration"]
  node_cli["CLI and loop<br/>[start_us.py]"]
  node_config["Configuration"]
  node_scraper["Scraper orchestrator<br/>[ultima_scraper.py]"]
end

subgraph group_accounts["Accounts and selection"]
  node_site_api["Site API"]
  node_profile_restore["Profile restore<br/>[ultima_scraper.py]"]
  node_account_setup["Account setup"]
  node_option_manager["Option selection"]
end

subgraph group_archive["Archive processing"]
  node_scraper_manager["Scraper manager"]
  node_filesystem["Filesystem manager"]
  node_metadata["Metadata manager"]
  node_job_manager["Job manager"]
  node_scrape_jobs["Scrape and download"]
  node_webhooks["Webhook processing"]
end

subgraph group_interface["Progress interface"]
  node_ui_manager["UI manager<br/>[ui_manager.py]"]
  node_dashboard["Dashboard controller"]
end

node_operator(("Operator"))
node_dashboard_client(("Dashboard client"))

node_operator -->|"starts"| node_cli
node_cli -->|"loads settings"| node_config
node_cli -->|"starts scrape"| node_scraper
node_scraper -->|"selects API"| node_site_api
node_scraper -->|"selects scraper"| node_scraper_manager
node_scraper -->|"restores profiles"| node_profile_restore
node_profile_restore -->|"logs in"| node_site_api
node_scraper -->|"sets up accounts"| node_account_setup
node_scraper -->|"selects profiles"| node_option_manager
node_scraper -->|"selects subscriptions"| node_option_manager
node_scraper -->|"creates directories"| node_filesystem
node_scraper -->|"configures jobs"| node_scraper_manager
node_scraper -->|"processes metadata"| node_metadata
node_scraper -->|"creates and queues"| node_job_manager
node_scraper -->|"processes jobs"| node_job_manager
node_job_manager -->|"dispatches jobs"| node_scrape_jobs
node_scraper -->|"processes webhooks"| node_webhooks
node_scraper -->|"reports progress"| node_ui_manager
node_ui_manager -->|"monitors data"| node_dashboard
node_dashboard_client -->|"sends prompts"| node_dashboard
node_dashboard -->|"broadcasts updates"| node_dashboard_client

click node_cli "https://github.com/digitalcriminal/archivedultimascraper/blob/master/start_us.py"
click node_scraper "https://github.com/digitalcriminal/archivedultimascraper/blob/master/ultima_scraper/ultima_scraper.py"
click node_profile_restore "https://github.com/digitalcriminal/archivedultimascraper/blob/master/ultima_scraper/ultima_scraper.py"
click node_ui_manager "https://github.com/digitalcriminal/archivedultimascraper/blob/master/ultima_scraper/managers/ui_manager.py"
click node_dashboard "https://github.com/digitalcriminal/archivedultimascraper/blob/master/ultima_scraper/managers/dashboard_controller_api.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_cli,node_config,node_scraper,node_dashboard_client toneBlue
class node_site_api,node_profile_restore,node_account_setup,node_option_manager toneAmber
class node_scraper_manager,node_filesystem,node_metadata,node_job_manager,node_scrape_jobs,node_webhooks toneMint
class node_ui_manager,node_dashboard toneRose
class node_operator toneIndigo
```

## Components

### Startup and orchestration

- [CLI and loop](https://github.com/digitalcriminal/archivedultimascraper/blob/master/start_us.py): `start_us.py`
- **Configuration**
- [Scraper orchestrator](https://github.com/digitalcriminal/archivedultimascraper/blob/master/ultima_scraper/ultima_scraper.py): `ultima_scraper/ultima_scraper.py`

### Accounts and selection

- **Site API**
- [Profile restore](https://github.com/digitalcriminal/archivedultimascraper/blob/master/ultima_scraper/ultima_scraper.py): `ultima_scraper/ultima_scraper.py`
- **Account setup**
- **Option selection**

### Archive processing

- **Scraper manager**
- **Filesystem manager**
- **Metadata manager**
- **Job manager**
- **Scrape and download**
- **Webhook processing**

### Progress interface

- [UI manager](https://github.com/digitalcriminal/archivedultimascraper/blob/master/ultima_scraper/managers/ui_manager.py): `ultima_scraper/managers/ui_manager.py`
- [Dashboard controller](https://github.com/digitalcriminal/archivedultimascraper/blob/master/ultima_scraper/managers/dashboard_controller_api.py): `ultima_scraper/managers/dashboard_controller_api.py`

### Other components

- **Operator**
- **Dashboard client**

## Connections

- Operator → CLI and loop: starts (evidence: `start_us.py`)
- CLI and loop → Configuration: loads settings (evidence: `start_us.py`)
- CLI and loop → Scraper orchestrator: starts scrape (evidence: `start_us.py`)
- Scraper orchestrator → Site API: selects API (evidence: `ultima_scraper/ultima_scraper.py`)
- Scraper orchestrator → Scraper manager: selects scraper (evidence: `ultima_scraper/ultima_scraper.py`)
- Scraper orchestrator → Profile restore: restores profiles (evidence: `ultima_scraper/ultima_scraper.py`)
- Profile restore → Site API: logs in (evidence: `ultima_scraper/ultima_scraper.py`)
- Scraper orchestrator → Account setup: sets up accounts (evidence: `ultima_scraper/ultima_scraper.py`)
- Scraper orchestrator → Option selection: selects profiles (evidence: `ultima_scraper/ultima_scraper.py`)
- Scraper orchestrator → Option selection: selects subscriptions (evidence: `ultima_scraper/ultima_scraper.py`)
- Scraper orchestrator → Filesystem manager: creates directories (evidence: `ultima_scraper/ultima_scraper.py`)
- Scraper orchestrator → Scraper manager: configures jobs (evidence: `ultima_scraper/ultima_scraper.py`)
- Scraper orchestrator → Metadata manager: processes metadata (evidence: `ultima_scraper/ultima_scraper.py`)
- Scraper orchestrator → Job manager: creates and queues (evidence: `ultima_scraper/ultima_scraper.py`)
- Scraper orchestrator → Job manager: processes jobs (evidence: `ultima_scraper/ultima_scraper.py`)
- Job manager → Scrape and download: dispatches jobs
- Scraper orchestrator → Webhook processing: processes webhooks (evidence: `ultima_scraper/ultima_scraper.py`)
- Scraper orchestrator → UI manager: reports progress (evidence: `ultima_scraper/ultima_scraper.py`)
- UI manager → Dashboard controller: monitors data (evidence: `ultima_scraper/managers/ui_manager.py`)
- Dashboard client → Dashboard controller: sends prompts (evidence: `ultima_scraper/managers/dashboard_controller_api.py`)
- Dashboard controller → Dashboard client: broadcasts updates (evidence: `ultima_scraper/managers/dashboard_controller_api.py`)
