How dev-lu/osint_toolkit works
OSINT Toolkit is a self-hosted analyst workbench: users select an investigation or authoring tool, submit indicators or content, and review analysis or generated artifacts. The repository separates a React interface, FastAPI feature handlers and services, and shared configuration/state. News aggregation and IOC investigation are central workflows, alongside email and domain analysis, CVSS scoring, AI templates, and detection-rule authoring. README descriptions establish several capabilities whose implementation details were not sampled; those links are marked unverified rather than presented as observed calls.
Main entry points: routes.js Application routes · dependencies.py Session dependencies · newsfeed Newsfeed API · ioc_lookup IOC lookup API
Components 24
Analyst interface
- Application routes
frontend/src/core/config/routes.js - Newsfeed UI
frontend/src/features/newsfeed - IOC tools UI
frontend/src/features/ioc-tools - Email analyzer UI
frontend/src/features/email-analyzer/EmailAnalyzer.jsx - Domain finder UI
frontend/src/features/ioc-tools/domain-finder - CVSS calculator UI
frontend/src/features/cvss-calculator/CvssCalculator.jsx - AI templates UI
frontend/src/features/llm-templates - Detection rules UI
frontend/src/features/rule-creator
Intelligence workflows
- Newsfeed API
backend/app/features/newsfeed - Article retrieval
backend/app/features/newsfeed/service/article_retrieval_service.py - IOC lookup API
backend/app/features/ioc_tools/ioc_lookup - Lookup engine
backend/app/features/ioc_tools/ioc_lookup/single_lookup/service/ioc_lookup_engine.py - IOC extraction
backend/app/features/ioc_tools/ioc_extractor - Domain finder API
backend/app/features/ioc_tools/domain_finder
Analysis tools
- Email analysis API
backend/app/features/email_analyzer/routers/email_routes.py - CVSS API
backend/app/features/cvss_calculator/routers/cvss_routes.py - Template API
backend/app/features/llm_templates/routers/llm_template_routes.py - LLM integration
backend/app/utils/llm_service.py - Rule authoring
frontend/src/features/rule-creator
API and platform
- Application database
backend/app/core/database.py - Session dependencies
backend/app/core/dependencies.py - Runtime settings
backend/app/core/config/settings.py
Other components
- Security analyst
- Threat intelligence services
Connections 27
- Security analyst → Application routes: uses
frontend/src/core/config/routes.js - Application routes → Newsfeed UI: routes to
frontend/src/core/config/routes.js - Application routes → IOC tools UI: routes to
frontend/src/core/config/routes.js - Application routes → Email analyzer UI: routes to
frontend/src/core/config/routes.js - Application routes → CVSS calculator UI: routes to
frontend/src/core/config/routes.js - Application routes → AI templates UI: routes to
frontend/src/core/config/routes.js - Application routes → Detection rules UI: routes to
frontend/src/core/config/routes.js - Security analyst → Domain finder UI: searches domains
- Security analyst → Newsfeed UI: reviews articles
- Newsfeed API → Article retrieval: retrieves articles
backend/app/features/newsfeed/service/article_retrieval_service.py - Security analyst → IOC tools UI: investigates indicators
- IOC lookup API → Lookup engine: dispatches lookups
backend/app/features/ioc_tools/ioc_lookup/single_lookup/service/ioc_lookup_engine.py - Lookup engine → Threat intelligence services: queries services
- Security analyst → Email analyzer UI: submits email
- Email analysis API → LLM integration: analyzes with AI
- Security analyst → CVSS calculator UI: scores vulnerability
- Security analyst → AI templates UI: manages prompts
- Template API → LLM integration: executes prompts
- Security analyst → Detection rules UI: creates rules
- Security analyst → IOC extraction: extracts indicators
- Security analyst → Domain finder API: finds domains
- Newsfeed API → Application database: reads articles
- Session dependencies → Application database: opens sessions
backend/app/core/dependencies.py - Session dependencies → Runtime settings: loads settings
backend/app/core/dependencies.py - Newsfeed API → Session dependencies: uses sessions
backend/app/features/newsfeed/routers/feed_management_routes.py - IOC lookup API → Session dependencies: uses sessions
- Domain finder API → Threat intelligence services: queries URLScan