How agentops-ai/agentops works
AgentOps is an observability and developer platform for AI agents. The main workflow starts when a developer initializes the Python client and instruments agent/framework or LLM activity; spans and metrics are exported to the service, then queried and inspected in the dashboard as traces, replays, and analytics. The repository also includes public APIs, account and billing operations, and deployment management. Source excerpts show only part of this system, so several documented product connections are shown at a high level rather than as detailed internal call chains.
Main entry points: app.py API Service · page.tsx Dashboard UI · client.py SDK Client · core.py Tracing Core
Components 25
Python SDK
- SDK Client
agentops/client/client.py - Tracing Core
agentops/sdk/core.py - Span Decorators
agentops/sdk/decorators/factory.py - Span Conventions
agentops/semconv/span_attributes.py
Instrumentation
- Agent Frameworks
agentops/instrumentation/agentic - LLM Providers
agentops/instrumentation/providers - Shared Instrumentation
agentops/instrumentation/common/attributes.py
Service Backend
- API Service
app/api/agentops/api/app.py - Public API
app/api/agentops/public/routes.py - Authentication
app/api/agentops/auth/views.py - Trace API
app/api/agentops/api/routes/v4/traces/views.py - Metrics API
app/api/agentops/api/routes/v4/metrics/views.py - Object Uploads
app/api/agentops/api/storage.py - ClickHouse Store
app/api/agentops/api/db/clickhouse_client.py - Supabase Store
app/api/agentops/api/db/supabase_client.py
Dashboard
- Dashboard UI
app/dashboard/app/(with-layout)/overview/page.tsx - Trace Viewer
app/dashboard/app/(with-layout)/traces/page.tsx - Dashboard API Routes
app/dashboard/app/(with-layout)/traces/api/route.ts - Billing Management
app/api/agentops/opsboard/views/billing.py - Deployment UI
app/dashboard/app/(with-layout)/deploy/page.tsx
Deployment
- Deployment API
app/api/agentops/deploy/routes.py - Deployment Worker
app/deploy/jockey/worker/worker.py - Job Queue
app/deploy/jockey/worker/queue.py
Other components
- Developer
- External Services
Connections 25
- Developer → SDK Client: initializes
README.md - SDK Client → Tracing Core: starts tracing
agentops/client/client.py - SDK Client → Agent Frameworks: enables instrumentation
agentops/client/client.py - Developer → Span Decorators: adds spans
README.md - Agent Frameworks → Shared Instrumentation: records activity
agentops/instrumentation/agentic/agno/attributes/storage.py - LLM Providers → Shared Instrumentation: records calls
agentops/instrumentation/providers/openai/wrappers/embeddings.py - Shared Instrumentation → Span Conventions: uses conventions
agentops/instrumentation/common/attributes.py - Tracing Core → Span Conventions: uses conventions
agentops/sdk/core.py - Tracing Core → API Service: exports telemetry
- API Service → Public API: mounts routes
- Public API → Authentication: routes authentication
app/api/agentops/public/routes.py - Public API → Trace API: routes trace queries
app/api/agentops/public/routes.py - API Service → ClickHouse Store: stores telemetry
- API Service → Supabase Store: uses persistence
- Dashboard UI → Dashboard API Routes: requests dashboard data
- Dashboard API Routes → API Service: queries telemetry
- Dashboard UI → Trace Viewer: opens trace detail
README.md - Dashboard UI → Metrics API: shows analytics
- Dashboard UI → Billing Management: manages billing
- Dashboard UI → Deployment UI: manages deployments
- Deployment UI → Deployment API: submits deployment
- Deployment API → Deployment Worker: dispatches jobs
- Deployment Worker → Job Queue: claims and stores
app/deploy/jockey/worker/worker.py - API Service → Object Uploads: offers uploads
- API Service → External Services: integrates services