How maxandrews/epstein-doc-explorer works
Epstein Document Network Explorer turns source documents into an AI-extracted relationship network, then serves it through an interactive graph, filters, timeline, and document viewer. The documented primary workflow is document extraction and analysis into SQLite, followed by API-backed exploration. The README also describes semantic tagging, tag clustering, entity deduplication, and incremental ingestion. Pipeline internals and server routes were not excerpted, so pipeline links follow documented capabilities; no unshown implementation details are inferred.
Main entry points: App.tsx Explorer App · api.ts API Client · analyze_documents.ts Document Analysis · community_schema.sql Analysis Database
Components 21
Ingestion and Analysis
- Text Extraction
analysis_pipeline/extract_data.py - Document Analysis
analysis_pipeline/analyze_documents.ts - Incremental Analysis
analysis_pipeline/identify_new_documents.ts
Network Enrichment
- Semantic Tagging
analysis_pipeline/analyze_tags.ts - Tag Clustering
analysis_pipeline/cluster_tags.ts - Cluster Naming
analysis_pipeline/name_clusters_with_claude.ts - New Tag Assignment
analysis_pipeline/assign_new_tags_to_clusters.ts - Entity Deduplication
analysis_pipeline/dedupe_with_llm.ts
Data and API
- Analysis Database
community_schema.sql - HTTP API
api_server.ts
Interactive Explorer
- Explorer App
network-ui/src/App.tsx - API Client
network-ui/src/api.ts - Filters and Search
network-ui/src/components/Sidebar.tsx - Network Graph
network-ui/src/components/NetworkGraph.tsx - Timeline Browser
network-ui/src/components/RightSidebar.tsx - Mobile Navigation
network-ui/src/components/MobileBottomNav.tsx - Document Viewer
network-ui/src/components/DocumentModal.tsx - Welcome Guide
network-ui/src/components/WelcomeModal.tsx
Other components
- Source Documents
- Claude AI
- Explorer User
Connections 28
- Source Documents → Text Extraction: provides text
README.md - Text Extraction → Document Analysis: supplies documents
README.md - Document Analysis → Claude AI: extracts with AI
README.md - Document Analysis → Analysis Database: stores results
README.md - Document Analysis → Semantic Tagging: adds contextual tags
README.md - Document Analysis → Incremental Analysis: supports new documents
- Analysis Database → Tag Clustering: provides tags
README.md - Tag Clustering → Cluster Naming: names clusters
README.md - Tag Clustering → New Tag Assignment: assigns new tags
- Analysis Database → Entity Deduplication: provides entities
README.md - Entity Deduplication → Claude AI: merges with LLM
README.md - Entity Deduplication → Analysis Database: records aliases
README.md - Explorer User → Explorer App: explores network
README.md - Explorer App → API Client: requests data
network-ui/src/App.tsx - API Client → HTTP API: calls endpoints
network-ui/src/api.ts - HTTP API → Analysis Database: queries records
- Explorer App → Filters and Search: renders filters
network-ui/src/App.tsx - Explorer App → Network Graph: renders network
network-ui/src/App.tsx - Explorer App → Timeline Browser: renders timeline
network-ui/src/App.tsx - Explorer App → Mobile Navigation: renders navigation
network-ui/src/App.tsx - Explorer App → Welcome Guide: renders guide
network-ui/src/App.tsx - Filters and Search → API Client: searches actors
network-ui/src/components/Sidebar.tsx - Mobile Navigation → API Client: searches actors
network-ui/src/components/MobileBottomNav.tsx - Timeline Browser → API Client: loads documents
network-ui/src/components/RightSidebar.tsx - Timeline Browser → Document Viewer: opens document
network-ui/src/components/RightSidebar.tsx - Mobile Navigation → Document Viewer: opens document
network-ui/src/components/MobileBottomNav.tsx - Document Viewer → API Client: loads document text
network-ui/src/components/DocumentModal.tsx - Network Graph → API Client: loads actor count
network-ui/src/components/NetworkGraph.tsx