How 2739673455/insight works
DataAgent is a data-analysis assistant with an administrative console. Users authenticate, manage conversations, and ask questions; the assistant’s execution layer supports analysis against Doris, with metadata search and query-experience recall as distinct capabilities. Administrators manage accounts and Doris permissions, import catalog metadata, and synchronize semantic/value indexes through background tasks. The README documents these capabilities and setup flows; the sampled sources expose selected service and task relationships, but not the complete chat-agent or query runtime, so those links are limited.
Main entry points: execution/service.py Query execution · tasks.py Metadata index tasks · index.tsx Admin console · conversations/service.py Conversation service
Components 22
User interaction
- Chat interface
web/src/features/chat/components/ChatComposer.tsx - Admin console
web/src/features/metadata/index.tsx - Chat API
app/assistant/api/chat/router.py - Attachment API
app/assistant/api/attachment/router.py
Assistant runtime
- Conversation service
app/assistant/conversations/service.py - Agent runtime
app/assistant/agents/runtime.py - Query execution
app/query/execution/service.py - Analysis sandbox
app/sandbox/manager.py - Assistant recall
app/assistant/recall/service.py - Query experiences
app/query/experiences/management.py
Metadata discovery
- Metadata API
app/metadata/api/router.py - Catalog import
app/metadata/catalog/service.py - Metadata search
app/metadata/search/service.py - Metadata index tasks
app/metadata/tasks.py
Identity and access
- Authentication API
app/identity/api/auth/router.py - Identity service
app/identity/service.py - Identity admin API
app/identity/api/router.py
Data and background services
- Doris data store
- PostgreSQL stores
- Task queue
app/shared/tasks/celery_app.py - Background workflows
app/workflows/tasks.py
Other components
- User
Connections 20
- User → Chat interface: asks questions
- User → Admin console: manages data
- Conversation service → Query execution: starts runs
app/assistant/conversations/service.py - Conversation service → Assistant recall: uses recall
- Agent runtime → Query execution: requests analysis
- Query execution → Doris data store: queries data
- Query execution → Analysis sandbox: uses sandbox
app/query/execution/service.py - Metadata API → Catalog import: imports catalog
app/metadata/api/router.py - Catalog import → Metadata index tasks: submits index work
app/metadata/catalog/service.py - Metadata index tasks → Doris data store: reads source
app/metadata/tasks.py - Metadata index tasks → PostgreSQL stores: persists catalog
app/metadata/tasks.py - Metadata search → PostgreSQL stores: reads catalog
app/metadata/search/service.py - Admin console → Metadata API: manages metadata
- Admin console → Identity admin API: manages access
- Authentication API → Identity service: authenticates users
- Identity service → PostgreSQL stores: reads identity
app/identity/service.py - Identity admin API → Doris data store: manages roles
app/identity/api/router.py - Query execution → Query experiences: records runs
app/query/execution/service.py - Task queue → Metadata index tasks: routes tasks
app/shared/tasks/celery_app.py - Task queue → Background workflows: routes tasks
app/shared/tasks/celery_app.py