How schwarzschlyle/immune works
Immune is a runtime defense layer for LLM applications. An application initializes or protects SDK traffic; interception routes provider requests through codecs into the screening pipeline, which classifies conversation channels, finds reflex candidates, gathers sensor judgments, applies calibrated threat policy, and returns screened provider results with a verdict. Sessions preserve taint and provenance, while configuration and vaccines tune policy and detectors; telemetry reports outcomes. The README documents broad provider/framework compatibility and streaming. Several implementation paths are unsampled, so those capabilities are retained as subsystems without speculative call edges.
Main entry points: pipeline.py Screening Pipeline · intercept Provider Interception · api.py Immune API · cli CLI Management
Components 21
Setup and Interception
- Immune API
src/immune/api.py - Provider Interception
src/immune/intercept - Provider Codecs
src/immune/codecs
Call Screening
- Screening Pipeline
src/immune/core/pipeline.py - Conversation Channels
src/immune/core/conversation.py - Reflex Detection
src/immune/reflexes - Threat Candidates
src/immune/core/candidates.py - Jev Sensor
src/immune/sensing - Typed Signals
src/immune/sensing/signals.py - Threat Assessment
src/immune/core/assess.py - Calibrated Heads
src/immune/heads - Policy Decisions
src/immune/core/decide.py
Policy and Memory
- Vaccine Rules
src/immune/vaccines - Configuration
src/immune/config - Session Provenance
src/immune/sessions - State Backends
src/immune/state
Management and Observability
- Verdict API
src/immune/telemetry/verdicts.py - Telemetry
src/immune/telemetry - CLI Management
src/immune/cli
Other components
- LLM Application
- Model Providers
Connections 27
- LLM Application → Immune API: initializes
README.md - LLM Application → Provider Interception: sends model calls
README.md - Immune API → Provider Interception: installs hooks
src/immune/api.py - Provider Interception → Screening Pipeline: dispatches calls
- Provider Interception → Provider Codecs: routes formats
src/immune/intercept/router.py - Provider Codecs → Conversation Channels: decodes messages
src/immune/codecs/base.py - Screening Pipeline → Conversation Channels: screens representation
src/immune/core/pipeline.py - Screening Pipeline → Reflex Detection: finds findings
src/immune/core/pipeline.py - Screening Pipeline → Threat Candidates: builds candidates
src/immune/core/pipeline.py - Screening Pipeline → Jev Sensor: requests readings
src/immune/core/pipeline.py - Jev Sensor → Typed Signals: returns signals
src/immune/sensing/sensor.py - Screening Pipeline → Threat Assessment: assesses threats
src/immune/core/pipeline.py - Screening Pipeline → Calibrated Heads: scores threats
- Screening Pipeline → Policy Decisions: decides actions
src/immune/core/pipeline.py - Configuration → Screening Pipeline: configures screening
src/immune/core/pipeline.py - Vaccine Rules → Reflex Detection: supplies detectors
- Screening Pipeline → Session Provenance: updates provenance
src/immune/core/pipeline.py - Session Provenance → State Backends: persists state
- Policy Decisions → Screening Pipeline: returns action
src/immune/core/pipeline.py - Screening Pipeline → Provider Interception: returns screened result
- Provider Interception → Model Providers: forwards request
README.md - Model Providers → Provider Interception: returns reply
README.md - Immune API → Verdict API: exposes verdict
src/immune/api.py - Screening Pipeline → Telemetry: emits observations
src/immune/core/pipeline.py - LLM Application → Verdict API: reads outcome
README.md - CLI Management → Vaccine Rules: manages rules
src/immune/cli/commands/vaccines.py - CLI Management → Configuration: loads settings
src/immune/cli/commands/vaccines.py