# shurik2533/hhrec architecture

> Architecture diagram of the GitHub repository shurik2533/hhrec, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-08). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/shurik2533/hhrec
- Repository: https://github.com/shurik2533/hhrec

## Overview

hhrec is a collection of Python scripts for preparing vacancy data and generating resume-to-vacancy recommendations. The main workflow fetches vacancies from the HeadHunter API, converts vacancy text and metadata into TF-IDF features, caches them in Redis, then compares them with processed resumes and stores ranked recommendations in MySQL. A separate loader moves recent vacancies from MySQL into Redis; another script archives active vacancies locally. The README provides no capability details, and the excerpts do not establish a single orchestrator connecting these scripts.

Main entry points: [`rec2.py`](https://github.com/shurik2533/hhrec/blob/master/rec2.py) (Alternate recommender), [`recommender_all.py`](https://github.com/shurik2533/hhrec/blob/master/recommender_all.py) (All-resume recommender), [`vacancy_downloader.py`](https://github.com/shurik2533/hhrec/blob/master/vacancy_downloader.py) (Vacancy downloader), [`recommender.py`](https://github.com/shurik2533/hhrec/blob/master/recommender.py) (Resume recommender)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_ingest["Vacancy ingestion"]
  node_downloader["Vacancy downloader"]
  node_vectorization["Vacancy vectorization"]
  node_db_loader["DB-to-cache loader"]
  node_archive["Vacancy archive scraper<br/>[vac.py]"]
end

subgraph group_matching["Recommendation"]
  node_rec2["Alternate recommender<br/>[rec2.py]"]
  node_recommender["Resume recommender<br/>[recommender.py]"]
  node_recommender_all["All-resume recommender<br/>[recommender_all.py]"]
end

subgraph group_storage["Data stores"]
  node_mysql[("MySQL")]
  node_redis[("Redis vacancy cache")]
  node_tinydb[("Local vacancy archive")]
end

node_hh(("HeadHunter API"))

node_downloader -->|"fetches listings"| node_hh
node_downloader -->|"fetches vacancy details"| node_hh
node_downloader -->|"builds features"| node_vectorization
node_vectorization -->|"caches vacancy data"| node_redis
node_db_loader -->|"reads vacancies"| node_mysql
node_db_loader -->|"writes vacancy data"| node_redis
node_archive -->|"fetches vacancies"| node_hh
node_archive -->|"stores active vacancies"| node_tinydb
node_recommender -->|"reads resumes"| node_mysql
node_recommender -->|"reads vacancies"| node_redis
node_recommender -->|"writes recommendations"| node_mysql
node_recommender_all -->|"reads resumes"| node_mysql
node_recommender_all -->|"reads vacancies"| node_redis
node_recommender_all -->|"writes recommendations"| node_mysql
node_recommender_all -->|"fetches vacancy titles"| node_hh
node_rec2 -->|"reads resumes"| node_mysql
node_rec2 -->|"reads vacancies"| node_redis
node_rec2 -->|"writes recommendations"| node_mysql
node_rec2 -->|"fetches vacancy details"| node_hh

click node_downloader "https://github.com/shurik2533/hhrec/blob/master/vacancy_downloader.py"
click node_vectorization "https://github.com/shurik2533/hhrec/blob/master/vacancy_downloader.py"
click node_db_loader "https://github.com/shurik2533/hhrec/blob/master/vac_from_db_to_redis.py"
click node_archive "https://github.com/shurik2533/hhrec/blob/master/vac.py"
click node_rec2 "https://github.com/shurik2533/hhrec/blob/master/rec2.py"
click node_recommender "https://github.com/shurik2533/hhrec/blob/master/recommender.py"
click node_recommender_all "https://github.com/shurik2533/hhrec/blob/master/recommender_all.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_downloader,node_vectorization,node_db_loader,node_archive toneBlue
class node_rec2,node_recommender,node_recommender_all toneAmber
class node_mysql,node_redis,node_tinydb,node_hh toneMint
```

## Components

### Vacancy ingestion

- [Vacancy downloader](https://github.com/shurik2533/hhrec/blob/master/vacancy_downloader.py): `vacancy_downloader.py`
- [Vacancy vectorization](https://github.com/shurik2533/hhrec/blob/master/vacancy_downloader.py): `vacancy_downloader.py`
- [DB-to-cache loader](https://github.com/shurik2533/hhrec/blob/master/vac_from_db_to_redis.py): `vac_from_db_to_redis.py`
- [Vacancy archive scraper](https://github.com/shurik2533/hhrec/blob/master/vac.py): `vac.py`

### Recommendation

- [Alternate recommender](https://github.com/shurik2533/hhrec/blob/master/rec2.py): `rec2.py`
- [Resume recommender](https://github.com/shurik2533/hhrec/blob/master/recommender.py): `recommender.py`
- [All-resume recommender](https://github.com/shurik2533/hhrec/blob/master/recommender_all.py): `recommender_all.py`

### Data stores

- **MySQL**
- **Redis vacancy cache**
- **Local vacancy archive**

### Other components

- **HeadHunter API**

## Connections

- Vacancy downloader → HeadHunter API: fetches listings (evidence: `vacancy_downloader.py`)
- Vacancy downloader → HeadHunter API: fetches vacancy details (evidence: `vacancy_downloader.py`)
- Vacancy downloader → Vacancy vectorization: builds features (evidence: `vacancy_downloader.py`)
- Vacancy vectorization → Redis vacancy cache: caches vacancy data (evidence: `vacancy_downloader.py`)
- DB-to-cache loader → MySQL: reads vacancies (evidence: `vac_from_db_to_redis.py`)
- DB-to-cache loader → Redis vacancy cache: writes vacancy data (evidence: `vac_from_db_to_redis.py`)
- Vacancy archive scraper → HeadHunter API: fetches vacancies (evidence: `vac.py`)
- Vacancy archive scraper → Local vacancy archive: stores active vacancies (evidence: `vac.py`)
- Resume recommender → MySQL: reads resumes (evidence: `recommender.py`)
- Resume recommender → Redis vacancy cache: reads vacancies (evidence: `recommender.py`)
- Resume recommender → MySQL: writes recommendations (evidence: `recommender.py`)
- All-resume recommender → MySQL: reads resumes (evidence: `recommender_all.py`)
- All-resume recommender → Redis vacancy cache: reads vacancies (evidence: `recommender_all.py`)
- All-resume recommender → MySQL: writes recommendations (evidence: `recommender_all.py`)
- All-resume recommender → HeadHunter API: fetches vacancy titles (evidence: `recommender_all.py`)
- Alternate recommender → MySQL: reads resumes (evidence: `rec2.py`)
- Alternate recommender → Redis vacancy cache: reads vacancies (evidence: `rec2.py`)
- Alternate recommender → MySQL: writes recommendations (evidence: `rec2.py`)
- Alternate recommender → HeadHunter API: fetches vacancy details (evidence: `rec2.py`)
