# thefpiasta/study-cultural-analytics-code architecture

> Architecture diagram of the GitHub repository thefpiasta/study-cultural-analytics-code, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-21). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/thefpiasta/study-cultural-analytics-code
- Repository: https://github.com/thefpiasta/study-cultural-analytics-code

## Overview

This is a course-project repository combining a Django cultural-analytics application with standalone hashtag-clustering scripts, a SQLite browser, and a Tesseract HTTP service. In the main workflow, scraper endpoints collect and persist social-media data; analyzer endpoints process images and save OCR and visual/sentiment features; visualizer endpoints expose visual analyses, while a separate chat endpoint calls an LLM. The graph also preserves the documented standalone tools. Some paths are unsampled, so only evidenced relationships are drawn; the SQLite viewer’s internal wiring is not established by the excerpts.

Main entry points: [`django-app/analyzer/services/image_processor.py`](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/services/image_processor.py) (Image processing), [`django-app/analyzer/views.py`](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/views.py) (Analyzer endpoints), [`django-app/visualizer/views.py`](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/visualizer/views.py) (Visualizations), [`llm/tesseract/tesseract-server-master/src/providers/http/index.ts`](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/providers/http/index.ts) (HTTP endpoints)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_django["Django analytics"]
  node_scraper_api["Scraper API<br/>[apis.py]"]
  node_scraper_data[("Scrape records<br/>[models.py]")]
  node_analyzer_api["Analyzer endpoints<br/>[views.py]"]
  node_image_processor["Image processing<br/>[image_processor.py]"]
  node_ocr["OCR extraction<br/>[easyocr.py]"]
  node_color["Image color<br/>[color_analysis.py]"]
  node_text_colors["Text colors<br/>[text_colors.py]"]
  node_sentiment_vader["VADER sentiment<br/>[vaderSentiment.py]"]
  node_sentiment_text["Text sentiment<br/>[text_sentiments.py]"]
  node_sentiment_llm["LLM sentiment<br/>[llm_sentiment.py]"]
  node_font_size["Font estimation<br/>[font_size.py]"]
  node_analysis_data[("Analysis results<br/>[models.py]")]
  node_visualizer["Visualizations<br/>[views.py]"]
  node_chat["Chat endpoint<br/>[views.py]"]
end

subgraph group_cluster["Hashtag clustering"]
  node_mapping["Mapping generator<br/>[create_mapping.py]"]
  node_cluster_map["Cluster categories"]
  node_cluster_keys["Cluster key extraction"]
  node_group_generation["Group generation<br/>[generate_groups.py]"]
end

subgraph group_tess["Tesseract service"]
  node_tess_http["HTTP endpoints<br/>[index.ts]"]
  node_tess_processor["OCR processor<br/>[index.ts]"]
  node_tess_argv["CLI options<br/>[yargs.ts]"]
  node_worker_pool["Worker pool"]
  node_worker["Worker interface<br/>[index.ts]"]
  node_tess_process["Tesseract process<br/>[index.ts]"]
  node_output_buffer["Output buffering<br/>[buffer.ts]"]
end

subgraph group_sqlite["SQLite viewer"]
  node_sqlite_viewer["SQLite browser UI<br/>[main.js]"]
  node_sqlite_engine["SQLite WASM<br/>[sql-wasm.js]"]
end

node_user(("API user"))
node_lm_studio{{"LM Studio"}}
node_tesseract_bin{{"Tesseract executable"}}

node_user -->|"requests data"| node_scraper_api
node_scraper_api -->|"persists records"| node_scraper_data
node_user -->|"requests analysis"| node_analyzer_api
node_analyzer_api -->|"invokes processing"| node_image_processor
node_analyzer_api -->|"reads and writes"| node_analysis_data
node_image_processor -->|"extracts text"| node_ocr
node_image_processor -->|"gets image color"| node_color
node_image_processor -->|"extracts text colors"| node_text_colors
node_image_processor -->|"analyzes sentiment"| node_sentiment_vader
node_image_processor -->|"analyzes text"| node_sentiment_text
node_image_processor -->|"requests sentiment"| node_sentiment_llm
node_image_processor -->|"estimates fonts"| node_font_size
node_image_processor -->|"saves results"| node_analysis_data
node_image_processor -->|"uses scrape records"| node_scraper_data
node_user -->|"requests charts"| node_visualizer
node_visualizer -->|"reads scrape data"| node_scraper_data
node_visualizer -->|"reads analysis"| node_analysis_data
node_user -->|"sends message"| node_chat
node_chat -->|"sends chat request"| node_lm_studio
node_mapping -->|"uses mapping"| node_cluster_map
node_user -->|"uploads OCR job"| node_tess_http
node_tess_http -->|"submits OCR"| node_tess_processor
node_tess_http -->|"uses endpoint options"| node_tess_argv
node_tess_processor -->|"acquires worker pool"| node_worker_pool
node_worker_pool -->|"creates workers"| node_worker
node_worker -->|"delegates execution"| node_tess_process
node_tess_process -->|"spawns executable"| node_tesseract_bin
node_tess_process -->|"buffers output"| node_output_buffer

click node_scraper_api "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/scraper/apis.py"
click node_scraper_data "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/scraper/models.py"
click node_analyzer_api "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/views.py"
click node_image_processor "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/services/image_processor.py"
click node_ocr "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/easyocr.py"
click node_color "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/color_analysis.py"
click node_text_colors "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/text_colors.py"
click node_sentiment_vader "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/vaderSentiment.py"
click node_sentiment_text "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/text_sentiments.py"
click node_sentiment_llm "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/llm_sentiment.py"
click node_font_size "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/font_size.py"
click node_analysis_data "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/models.py"
click node_visualizer "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/visualizer/views.py"
click node_chat "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/chat_bot/views.py"
click node_mapping "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/mapping_hashtag_cluster_group/create_mapping.py"
click node_cluster_map "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/mapping_hashtag_cluster_group/AI_group_cluster.py"
click node_cluster_keys "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/mapping_hashtag_cluster_group/extract_cluster_keys.py"
click node_group_generation "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/mapping_hashtag_cluster_group/generate_groups.py"
click node_tess_http "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/providers/http/index.ts"
click node_tess_processor "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/processor/index.ts"
click node_tess_argv "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/argv/yargs.ts"
click node_worker_pool "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/processor/createWorkerPool.ts"
click node_worker "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/processor/worker/index.ts"
click node_tess_process "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/processor/worker/process/index.ts"
click node_output_buffer "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/processor/worker/process/buffer.ts"
click node_sqlite_viewer "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/database/sqlite/sqlite-viewer-gh-pages/js/main.js"
click node_sqlite_engine "https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/database/sqlite/sqlite-viewer-gh-pages/js/sql-wasm.js"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_scraper_api,node_scraper_data,node_analyzer_api,node_image_processor,node_ocr,node_color,node_text_colors,node_sentiment_vader,node_sentiment_text,node_sentiment_llm,node_font_size,node_analysis_data,node_visualizer,node_chat,node_user toneBlue
class node_mapping,node_cluster_map,node_cluster_keys,node_group_generation toneAmber
class node_tess_http,node_tess_processor,node_tess_argv,node_worker_pool,node_worker,node_tess_process,node_output_buffer toneMint
class node_sqlite_viewer,node_sqlite_engine toneRose
class node_lm_studio,node_tesseract_bin toneIndigo
```

## Components

### Django analytics

- [Scraper API](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/scraper/apis.py): `django-app/scraper/apis.py`
- [Scrape records](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/scraper/models.py): `django-app/scraper/models.py`
- [Analyzer endpoints](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/views.py): `django-app/analyzer/views.py`
- [Image processing](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/services/image_processor.py): `django-app/analyzer/services/image_processor.py`
- [OCR extraction](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/easyocr.py): `django-app/analyzer/utils/easyocr.py`
- [Image color](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/color_analysis.py): `django-app/analyzer/utils/color_analysis.py`
- [Text colors](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/text_colors.py): `django-app/analyzer/utils/text_colors.py`
- [VADER sentiment](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/vaderSentiment.py): `django-app/analyzer/utils/vaderSentiment.py`
- [Text sentiment](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/text_sentiments.py): `django-app/analyzer/utils/text_sentiments.py`
- [LLM sentiment](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/llm_sentiment.py): `django-app/analyzer/utils/llm_sentiment.py`
- [Font estimation](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/utils/font_size.py): `django-app/analyzer/utils/font_size.py`
- [Analysis results](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/analyzer/models.py): `django-app/analyzer/models.py`
- [Visualizations](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/visualizer/views.py): `django-app/visualizer/views.py`
- [Chat endpoint](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/django-app/chat_bot/views.py): `django-app/chat_bot/views.py`

### Hashtag clustering

- [Mapping generator](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/mapping_hashtag_cluster_group/create_mapping.py): `data/mapping_hashtag_cluster_group/create_mapping.py`
- [Cluster categories](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/mapping_hashtag_cluster_group/AI_group_cluster.py): `data/mapping_hashtag_cluster_group/AI_group_cluster.py`
- [Cluster key extraction](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/mapping_hashtag_cluster_group/extract_cluster_keys.py): `data/mapping_hashtag_cluster_group/extract_cluster_keys.py`
- [Group generation](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/mapping_hashtag_cluster_group/generate_groups.py): `data/mapping_hashtag_cluster_group/generate_groups.py`

### Tesseract service

- [HTTP endpoints](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/providers/http/index.ts): `llm/tesseract/tesseract-server-master/src/providers/http/index.ts`
- [OCR processor](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/processor/index.ts): `llm/tesseract/tesseract-server-master/src/processor/index.ts`
- [CLI options](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/argv/yargs.ts): `llm/tesseract/tesseract-server-master/src/argv/yargs.ts`
- [Worker pool](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/processor/createWorkerPool.ts): `llm/tesseract/tesseract-server-master/src/processor/createWorkerPool.ts`
- [Worker interface](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/processor/worker/index.ts): `llm/tesseract/tesseract-server-master/src/processor/worker/index.ts`
- [Tesseract process](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/processor/worker/process/index.ts): `llm/tesseract/tesseract-server-master/src/processor/worker/process/index.ts`
- [Output buffering](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/llm/tesseract/tesseract-server-master/src/processor/worker/process/buffer.ts): `llm/tesseract/tesseract-server-master/src/processor/worker/process/buffer.ts`

### SQLite viewer

- [SQLite browser UI](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/database/sqlite/sqlite-viewer-gh-pages/js/main.js): `data/database/sqlite/sqlite-viewer-gh-pages/js/main.js`
- [SQLite WASM](https://github.com/thefpiasta/study-cultural-analytics-code/blob/main/data/database/sqlite/sqlite-viewer-gh-pages/js/sql-wasm.js): `data/database/sqlite/sqlite-viewer-gh-pages/js/sql-wasm.js`

### Other components

- **API user**
- **LM Studio**
- **Tesseract executable**

## Connections

- API user → Scraper API: requests data (evidence: `README.md`)
- Scraper API → Scrape records: persists records (evidence: `django-app/scraper/apis.py`)
- API user → Analyzer endpoints: requests analysis (evidence: `README.md`)
- Analyzer endpoints → Image processing: invokes processing (evidence: `django-app/analyzer/views.py`)
- Analyzer endpoints → Analysis results: reads and writes (evidence: `django-app/analyzer/views.py`)
- Image processing → OCR extraction: extracts text (evidence: `django-app/analyzer/services/image_processor.py`)
- Image processing → Image color: gets image color (evidence: `django-app/analyzer/services/image_processor.py`)
- Image processing → Text colors: extracts text colors (evidence: `django-app/analyzer/services/image_processor.py`)
- Image processing → VADER sentiment: analyzes sentiment (evidence: `django-app/analyzer/services/image_processor.py`)
- Image processing → Text sentiment: analyzes text (evidence: `django-app/analyzer/services/image_processor.py`)
- Image processing → LLM sentiment: requests sentiment (evidence: `django-app/analyzer/services/image_processor.py`)
- Image processing → Font estimation: estimates fonts (evidence: `django-app/analyzer/services/image_processor.py`)
- Image processing → Analysis results: saves results (evidence: `django-app/analyzer/services/image_processor.py`)
- Image processing → Scrape records: uses scrape records (evidence: `django-app/analyzer/services/image_processor.py`)
- API user → Visualizations: requests charts (evidence: `README.md`)
- Visualizations → Scrape records: reads scrape data (evidence: `django-app/visualizer/views.py`)
- Visualizations → Analysis results: reads analysis (evidence: `django-app/visualizer/views.py`)
- API user → Chat endpoint: sends message (evidence: `django-app/chat_bot/views.py`)
- Chat endpoint → LM Studio: sends chat request (evidence: `django-app/chat_bot/views.py`)
- Mapping generator → Cluster categories: uses mapping (evidence: `data/mapping_hashtag_cluster_group/create_mapping.py`)
- API user → HTTP endpoints: uploads OCR job (evidence: `llm/tesseract/tesseract-server-master/src/providers/http/index.ts`)
- HTTP endpoints → OCR processor: submits OCR (evidence: `llm/tesseract/tesseract-server-master/src/providers/http/index.ts`)
- HTTP endpoints → CLI options: uses endpoint options (evidence: `llm/tesseract/tesseract-server-master/src/providers/http/index.ts`)
- OCR processor → Worker pool: acquires worker pool (evidence: `llm/tesseract/tesseract-server-master/src/processor/index.ts`)
- Worker pool → Worker interface: creates workers (evidence: `llm/tesseract/tesseract-server-master/src/processor/createWorkerPool.ts`)
- Worker interface → Tesseract process: delegates execution (evidence: `llm/tesseract/tesseract-server-master/src/processor/worker/index.ts`)
- Tesseract process → Tesseract executable: spawns executable (evidence: `llm/tesseract/tesseract-server-master/src/processor/worker/process/index.ts`)
- Tesseract process → Output buffering: buffers output (evidence: `llm/tesseract/tesseract-server-master/src/processor/worker/process/index.ts`)
