How npc-worldwide/npcpy works
npcpy is a Python library for building model-backed personas, tool-using agents, and multimodal or knowledge-grounded AI applications. A typical user creates an NPC or agent, submits a request, and receives a model response; agents can also use tools and knowledge features. The repository additionally provides multimodal data handling and generation, knowledge-graph and retrieval capabilities, fine-tuning, SQL integration, and serving. Several connections below rely on the SOURCE INDEX’s import/name references or README descriptions; unsampled implementation details are not asserted.
Main entry points: npc_compiler.py NPC and agents · llm_funcs.py LLM functions · search.py Retrieval search · response.py Model responses
Components 24
Agent runtime
- NPC and agents
npcpy/npc_compiler.py - LLM functions
npcpy/llm_funcs.py - HTTP serving
npcpy/serve.py - Streaming
npcpy/streaming.py - Agent tools
npcpy/tools.py - Planning and triggers
npcpy/work/plan.py
Models and media
- Model responses
npcpy/gen/response.py - Image generation
npcpy/gen/image_gen.py - Audio generation
npcpy/gen/audio_gen.py - Video generation
npcpy/gen/video_gen.py - Media loading
npcpy/data/load.py - Audio processing
npcpy/data/audio.py
Knowledge and data
- Web search
npcpy/data/web.py - Retrieval search
npcpy/memory/search.py - Embeddings
npcpy/gen/embeddings.py - Knowledge graph
npcpy/memory/knowledge_graph.py - Graph population
npcpy/memory/kg_population.py - Knowledge store
npcpy/memory/knowledge_store.py - Knowledge index
npcpy/memory/knowledge_index.py
Application extensions
- Model fine-tuning
npcpy/ft/sft.py - Diffusion training
npcpy/ft/diff.py - AI SQL
npcpy/sql/npcsql.py
Other components
- User
- Model providers
Connections 26
- User → NPC and agents: creates and invokes
- NPC and agents → LLM functions: requests responses
npcpy/npc_compiler.py - LLM functions → Model responses: dispatches generation
npcpy/llm_funcs.py - Model responses → Model providers: queries models
- NPC and agents → Agent tools: uses tools
npcpy/npc_compiler.py - NPC and agents → HTTP serving: integrates serving
npcpy/npc_compiler.py - NPC and agents → Streaming: uses streaming
npcpy/npc_compiler.py - NPC and agents → Planning and triggers: plans tasks
- LLM functions → Image generation: calls generation
npcpy/llm_funcs.py - LLM functions → Video generation: calls generation
npcpy/llm_funcs.py - Model responses → Media loading: loads attachments
npcpy/gen/response.py - Model responses → Audio processing: processes audio
- Retrieval search → Web search: searches web
npcpy/memory/search.py - Retrieval search → Media loading: loads files
npcpy/memory/search.py - Retrieval search → Embeddings: embeds queries
npcpy/memory/search.py - Retrieval search → LLM functions: requests answers
npcpy/memory/search.py - Graph population → Knowledge graph: populates graph
npcpy/memory/kg_population.py - Graph population → LLM functions: extracts knowledge
npcpy/memory/kg_population.py - Knowledge store → Knowledge graph: uses graph
npcpy/memory/knowledge_store.py - Knowledge store → LLM functions: processes memories
npcpy/memory/knowledge_store.py - NPC and agents → Knowledge graph: uses knowledge graph
npcpy/npc_compiler.py - NPC and agents → Knowledge store: uses knowledge store
npcpy/npc_compiler.py - NPC and agents → Model fine-tuning: supports fine-tuning
- NPC and agents → Diffusion training: supports image training
- NPC and agents → AI SQL: integrates AI SQL
npcpy/sql/npcsql.py - Audio generation → Audio processing: uses audio data
npcpy/data/audio.py