# dev-lu/osint_toolkit architecture

> Architecture diagram of the GitHub repository dev-lu/osint_toolkit, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-18). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/dev-lu/osint_toolkit
- Repository: https://github.com/dev-lu/osint_toolkit

## Overview

OSINT Toolkit is a self-hosted analyst workbench: users select an investigation or authoring tool, submit indicators or content, and review analysis or generated artifacts. The repository separates a React interface, FastAPI feature handlers and services, and shared configuration/state. News aggregation and IOC investigation are central workflows, alongside email and domain analysis, CVSS scoring, AI templates, and detection-rule authoring. README descriptions establish several capabilities whose implementation details were not sampled; those links are marked unverified rather than presented as observed calls.

Main entry points: [`frontend/src/core/config/routes.js`](https://github.com/dev-lu/osint_toolkit/blob/main/frontend/src/core/config/routes.js) (Application routes), [`backend/app/core/dependencies.py`](https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/core/dependencies.py) (Session dependencies), [`backend/app/features/newsfeed`](https://github.com/dev-lu/osint_toolkit/tree/main/backend/app/features/newsfeed) (Newsfeed API), [`backend/app/features/ioc_tools/ioc_lookup`](https://github.com/dev-lu/osint_toolkit/tree/main/backend/app/features/ioc_tools/ioc_lookup) (IOC lookup API)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_ui["Analyst interface"]
  node_app["Application routes<br/>[routes.js]"]
  node_newsui["Newsfeed UI"]
  node_iocui["IOC tools UI"]
  node_emailui["Email analyzer UI<br/>[EmailAnalyzer.jsx]"]
  node_domainui["Domain finder UI"]
  node_cvssui["CVSS calculator UI<br/>[CvssCalculator.jsx]"]
  node_templatesui["AI templates UI"]
  node_rulesui["Detection rules UI"]
end

subgraph group_intel["Intelligence workflows"]
  node_newsapi["Newsfeed API"]
  node_articlefetch["Article retrieval"]
  node_iocapi["IOC lookup API"]
  node_iocengine["Lookup engine"]
  node_iocextract["IOC extraction"]
  node_domainapi["Domain finder API"]
end

subgraph group_analysis["Analysis tools"]
  node_emailapi["Email analysis API<br/>[email_routes.py]"]
  node_cvssapi["CVSS API<br/>[cvss_routes.py]"]
  node_templatesapi["Template API"]
  node_llm["LLM integration<br/>[llm_service.py]"]
  node_rulesapi["Rule authoring"]
end

subgraph group_platform["API and platform"]
  node_database[("Application database<br/>[database.py]")]
  node_dependencies["Session dependencies<br/>[dependencies.py]"]
  node_settings["Runtime settings<br/>[settings.py]"]
end

node_analyst(("Security analyst"))
node_external{{"Threat intelligence services"}}

node_analyst -->|"uses"| node_app
node_app -->|"routes to"| node_newsui
node_app -->|"routes to"| node_iocui
node_app -->|"routes to"| node_emailui
node_app -->|"routes to"| node_cvssui
node_app -->|"routes to"| node_templatesui
node_app -->|"routes to"| node_rulesui
node_analyst -->|"searches domains"| node_domainui
node_analyst -->|"reviews articles"| node_newsui
node_newsapi -->|"retrieves articles"| node_articlefetch
node_analyst -->|"investigates indicators"| node_iocui
node_iocapi -->|"dispatches lookups"| node_iocengine
node_iocengine -.->|"queries services"| node_external
node_analyst -->|"submits email"| node_emailui
node_emailapi -.->|"analyzes with AI"| node_llm
node_analyst -->|"scores vulnerability"| node_cvssui
node_analyst -->|"manages prompts"| node_templatesui
node_templatesapi -.->|"executes prompts"| node_llm
node_analyst -->|"creates rules"| node_rulesui
node_analyst -->|"extracts indicators"| node_iocextract
node_analyst -->|"finds domains"| node_domainapi
node_newsapi -.->|"reads articles"| node_database
node_dependencies -->|"opens sessions"| node_database
node_dependencies -->|"loads settings"| node_settings
node_newsapi -.->|"uses sessions"| node_dependencies
node_iocapi -.->|"uses sessions"| node_dependencies
node_domainapi -->|"queries URLScan"| node_external

click node_app "https://github.com/dev-lu/osint_toolkit/blob/main/frontend/src/core/config/routes.js"
click node_newsui "https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/newsfeed"
click node_iocui "https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/ioc-tools"
click node_emailui "https://github.com/dev-lu/osint_toolkit/blob/main/frontend/src/features/email-analyzer/EmailAnalyzer.jsx"
click node_domainui "https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/ioc-tools/domain-finder"
click node_cvssui "https://github.com/dev-lu/osint_toolkit/blob/main/frontend/src/features/cvss-calculator/CvssCalculator.jsx"
click node_templatesui "https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/llm-templates"
click node_rulesui "https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/rule-creator"
click node_newsapi "https://github.com/dev-lu/osint_toolkit/tree/main/backend/app/features/newsfeed"
click node_articlefetch "https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/features/newsfeed/service/article_retrieval_service.py"
click node_iocapi "https://github.com/dev-lu/osint_toolkit/tree/main/backend/app/features/ioc_tools/ioc_lookup"
click node_iocengine "https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/features/ioc_tools/ioc_lookup/single_lookup/service/ioc_lookup_engine.py"
click node_iocextract "https://github.com/dev-lu/osint_toolkit/tree/main/backend/app/features/ioc_tools/ioc_extractor"
click node_domainapi "https://github.com/dev-lu/osint_toolkit/tree/main/backend/app/features/ioc_tools/domain_finder"
click node_emailapi "https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/features/email_analyzer/routers/email_routes.py"
click node_cvssapi "https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/features/cvss_calculator/routers/cvss_routes.py"
click node_templatesapi "https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/features/llm_templates/routers/llm_template_routes.py"
click node_llm "https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/utils/llm_service.py"
click node_rulesapi "https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/rule-creator"
click node_database "https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/core/database.py"
click node_dependencies "https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/core/dependencies.py"
click node_settings "https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/core/config/settings.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_app,node_newsui,node_iocui,node_emailui,node_domainui,node_cvssui,node_templatesui,node_rulesui toneBlue
class node_newsapi,node_articlefetch,node_iocapi,node_iocengine,node_iocextract,node_domainapi toneAmber
class node_emailapi,node_cvssapi,node_templatesapi,node_llm,node_rulesapi toneMint
class node_database,node_dependencies,node_settings toneRose
class node_analyst,node_external toneIndigo
```

## Components

### Analyst interface

- [Application routes](https://github.com/dev-lu/osint_toolkit/blob/main/frontend/src/core/config/routes.js): `frontend/src/core/config/routes.js`
- [Newsfeed UI](https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/newsfeed): `frontend/src/features/newsfeed`
- [IOC tools UI](https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/ioc-tools): `frontend/src/features/ioc-tools`
- [Email analyzer UI](https://github.com/dev-lu/osint_toolkit/blob/main/frontend/src/features/email-analyzer/EmailAnalyzer.jsx): `frontend/src/features/email-analyzer/EmailAnalyzer.jsx`
- [Domain finder UI](https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/ioc-tools/domain-finder): `frontend/src/features/ioc-tools/domain-finder`
- [CVSS calculator UI](https://github.com/dev-lu/osint_toolkit/blob/main/frontend/src/features/cvss-calculator/CvssCalculator.jsx): `frontend/src/features/cvss-calculator/CvssCalculator.jsx`
- [AI templates UI](https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/llm-templates): `frontend/src/features/llm-templates`
- [Detection rules UI](https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/rule-creator): `frontend/src/features/rule-creator`

### Intelligence workflows

- [Newsfeed API](https://github.com/dev-lu/osint_toolkit/tree/main/backend/app/features/newsfeed): `backend/app/features/newsfeed`
- [Article retrieval](https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/features/newsfeed/service/article_retrieval_service.py): `backend/app/features/newsfeed/service/article_retrieval_service.py`
- [IOC lookup API](https://github.com/dev-lu/osint_toolkit/tree/main/backend/app/features/ioc_tools/ioc_lookup): `backend/app/features/ioc_tools/ioc_lookup`
- [Lookup engine](https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/features/ioc_tools/ioc_lookup/single_lookup/service/ioc_lookup_engine.py): `backend/app/features/ioc_tools/ioc_lookup/single_lookup/service/ioc_lookup_engine.py`
- [IOC extraction](https://github.com/dev-lu/osint_toolkit/tree/main/backend/app/features/ioc_tools/ioc_extractor): `backend/app/features/ioc_tools/ioc_extractor`
- [Domain finder API](https://github.com/dev-lu/osint_toolkit/tree/main/backend/app/features/ioc_tools/domain_finder): `backend/app/features/ioc_tools/domain_finder`

### Analysis tools

- [Email analysis API](https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/features/email_analyzer/routers/email_routes.py): `backend/app/features/email_analyzer/routers/email_routes.py`
- [CVSS API](https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/features/cvss_calculator/routers/cvss_routes.py): `backend/app/features/cvss_calculator/routers/cvss_routes.py`
- [Template API](https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/features/llm_templates/routers/llm_template_routes.py): `backend/app/features/llm_templates/routers/llm_template_routes.py`
- [LLM integration](https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/utils/llm_service.py): `backend/app/utils/llm_service.py`
- [Rule authoring](https://github.com/dev-lu/osint_toolkit/tree/main/frontend/src/features/rule-creator): `frontend/src/features/rule-creator`

### API and platform

- [Application database](https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/core/database.py): `backend/app/core/database.py`
- [Session dependencies](https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/core/dependencies.py): `backend/app/core/dependencies.py`
- [Runtime settings](https://github.com/dev-lu/osint_toolkit/blob/main/backend/app/core/config/settings.py): `backend/app/core/config/settings.py`

### Other components

- **Security analyst**
- **Threat intelligence services**

## Connections

- Security analyst → Application routes: uses (evidence: `frontend/src/core/config/routes.js`)
- Application routes → Newsfeed UI: routes to (evidence: `frontend/src/core/config/routes.js`)
- Application routes → IOC tools UI: routes to (evidence: `frontend/src/core/config/routes.js`)
- Application routes → Email analyzer UI: routes to (evidence: `frontend/src/core/config/routes.js`)
- Application routes → CVSS calculator UI: routes to (evidence: `frontend/src/core/config/routes.js`)
- Application routes → AI templates UI: routes to (evidence: `frontend/src/core/config/routes.js`)
- Application routes → Detection rules UI: routes to (evidence: `frontend/src/core/config/routes.js`)
- Security analyst → Domain finder UI: searches domains
- Security analyst → Newsfeed UI: reviews articles
- Newsfeed API → Article retrieval: retrieves articles (evidence: `backend/app/features/newsfeed/service/article_retrieval_service.py`)
- Security analyst → IOC tools UI: investigates indicators
- IOC lookup API → Lookup engine: dispatches lookups (evidence: `backend/app/features/ioc_tools/ioc_lookup/single_lookup/service/ioc_lookup_engine.py`)
- Lookup engine → Threat intelligence services: queries services
- Security analyst → Email analyzer UI: submits email
- Email analysis API → LLM integration: analyzes with AI
- Security analyst → CVSS calculator UI: scores vulnerability
- Security analyst → AI templates UI: manages prompts
- Template API → LLM integration: executes prompts
- Security analyst → Detection rules UI: creates rules
- Security analyst → IOC extraction: extracts indicators
- Security analyst → Domain finder API: finds domains
- Newsfeed API → Application database: reads articles
- Session dependencies → Application database: opens sessions (evidence: `backend/app/core/dependencies.py`)
- Session dependencies → Runtime settings: loads settings (evidence: `backend/app/core/dependencies.py`)
- Newsfeed API → Session dependencies: uses sessions (evidence: `backend/app/features/newsfeed/routers/feed_management_routes.py`)
- IOC lookup API → Session dependencies: uses sessions
- Domain finder API → Threat intelligence services: queries URLScan
