How anonghosty/looking-glass works
Looking Glass turns daily Shadowserver reports into a replayable national threat picture and tools for CSIRT follow-up. Its principal workflow is report delivery, validation and loading into a shared MongoDB, followed by read-only web analysis and response by analysts and executives. The graph preserves the documented map, services, findings, intelligence, advisory, audit and privacy capabilities. Some subsystem links are documented in the README; sampled code and the source index support the more specific pipeline and services relationships. Unsampled implementations are represented only at paths present in the tree.
Main entry points: app.py Web application · shadowserver_pipeline.py Report pipeline · services_api.py Services API · db_connect.py Shared reports DB
Components 22
Report ingestion
- Report pipeline
database/shadowserver_pipeline.py - Sender verification
database/mail_auth.py - Report API
database/report_api.py - Pipeline settings
database/worker_settings.py - Shared reports DB
database/db_connect.py
Web platform
- Web application
platform/app.py - Services API
platform/services_api.py - Shared result cache
platform/respcache.py
Analysis and intelligence
- Services analysis
platform/services.py - Communications map
platform/attack_map.py - Combination analysis
platform/combos.py - Findings
platform/findings.py - Threat intelligence
platform/intel.py - Executive reports
platform/quarterly.py - Address analysis
platform/address_blocks.py
CSIRT response
- Advisories
platform/advisory.py - Audit trail
platform/audit_chain.py - Research notes
platform/notes.py
Trust and privacy
- Authentication
platform/auth.py - Server-side masking
platform/privacy.py
Other components
- Shadowserver reports
- CSIRT users
Connections 21
- Shadowserver reports → Report pipeline: sends reports
- Report pipeline → Sender verification: checks sender
database/shadowserver_pipeline.py - Report pipeline → Report API: fetches reports
database/shadowserver_pipeline.py - Report pipeline → Shared reports DB: loads reports
database/shadowserver_pipeline.py - Pipeline settings → Report pipeline: configures
database/worker_settings.py - CSIRT users → Web application: uses platform
- Web application → Shared reports DB: reads reports
platform/app.py - Web application → Services API: registers API
platform/services_api.py - Services API → Services analysis: queries services
platform/services_api.py - Services API → Server-side masking: masks output
platform/services_api.py - Web application → Communications map: serves replay map
platform/app.py - Web application → Combination analysis: supports analysis
platform/app.py - Web application → Findings: shows findings
platform/app.py - Web application → Threat intelligence: shows intelligence
platform/app.py - Web application → Executive reports: provides portal
- Web application → Advisories: supports advisories
platform/app.py - Web application → Audit trail: records activity
- Web application → Research notes: shares notes
platform/app.py - Web application → Authentication: authenticates users
platform/app.py - Web application → Shared result cache: caches results
platform/app.py - Web application → Address analysis: supports network analysis
platform/app.py