How vercel/ai works
AI SDK is a provider-agnostic TypeScript toolkit for model calls, agents, and generative interfaces. The documented user workflow passes a prompt and model to generation APIs, optionally wraps the model in an agent or requests structured output, then streams results to a UI. The tree also shows broad modality APIs, provider implementations, shared provider utilities, and a DevTools viewer. Several subsystems are represented by their exact source directories because their implementation was not sampled; edges are limited to README statements and indexed references.
Main entry points: tool-loop-agent.ts Tool-loop agents · app.tsx Trace viewer · step-card.tsx Step cards · generate-text.ts Text generation
Components 34
Model APIs
- Text generation
packages/ai/src/generate-text/generate-text.ts - Structured output
packages/ai/src/generate-object/generate-object.ts - Embeddings
packages/ai/src/embed/embed.ts - Image generation
packages/ai/src/generate-image/generate-image.ts - Speech generation
packages/ai/src/generate-speech/generate-speech.ts - Transcription
packages/ai/src/transcribe/transcribe.ts - Translation
- Video generation
packages/ai/src/generate-video/generate-video.ts - Reranking
packages/ai/src/rerank/rerank.ts - Realtime sessions
packages/ai/src/realtime/realtime-session.ts
Agents and UI
- Tool-loop agents
packages/ai/src/agent/tool-loop-agent.ts - Agent UI stream
packages/ai/src/agent/create-agent-ui-stream-response.ts - Chat UI
packages/ai/src/ui/chat.ts - UI message stream
packages/ai/src/ui-message-stream/create-ui-message-stream.ts
Providers and contracts
- Provider contracts
packages/ai/src/types/provider.ts - AI Gateway
packages/gateway/src/gateway-embedding-model.ts - Alibaba provider
packages/alibaba/src/alibaba-model-catalog.ts - Alibaba embeddings
packages/alibaba/src/alibaba-embedding-model-options.ts - Cohere provider
packages/cohere/src/cohere-model-catalog.ts - Cohere embeddings
packages/cohere/src/cohere-embedding-model-options.ts - Perplexity provider
packages/perplexity/src/perplexity-language-model.ts - Perplexity catalog
packages/perplexity/src/perplexity-model-catalog.ts - Response handling
packages/provider-utils/src/response-handler.ts - Schema utilities
packages/provider-utils/src/schema.ts - Binary field scan
packages/provider-utils/src/json-binary-field-scanner.ts
DevTools and harness
- DevTools server
packages/devtools/src/viewer/server.ts - Run database
packages/devtools/src/db.ts - Trace viewer
packages/devtools/src/viewer/client/app.tsx - Step cards
packages/devtools/src/viewer/client/components/step-card.tsx - Trace components
packages/devtools/src/viewer/client/components/shared-components.tsx - Message components
packages/devtools/src/viewer/client/components/message-components.tsx - Trace timeline
packages/devtools/src/viewer/client/components/trace-timeline.tsx - Codex app client
packages/harness-codex/src/bridge/codex-app-server-client.ts
Other components
- Application developer
Connections 21
- Application developer → Text generation: calls
README.md - Application developer → Structured output: requests output
README.md - Application developer → Tool-loop agents: configures
README.md - Tool-loop agents → Agent UI stream: streams through
README.md - Application developer → Chat UI: uses chat hook
README.md - Text generation → Provider contracts: uses model
- Tool-loop agents → Text generation: runs model
- Agent UI stream → UI message stream: streams messages
- AI Gateway → Provider contracts: implements
packages/gateway/src/gateway-embedding-model.ts - Alibaba embeddings → Alibaba provider: catalog reference
packages/alibaba/src/alibaba-embedding-model-options.ts - Cohere embeddings → Cohere provider: catalog reference
packages/cohere/src/cohere-embedding-model-options.ts - Perplexity provider → Perplexity catalog: catalog reference
packages/perplexity/src/perplexity-embedding-model.ts - Response handling → Binary field scan: compiles paths
packages/provider-utils/src/response-handler.ts - Response handling → Schema utilities: validates responses
packages/provider-utils/src/response-handler.ts - DevTools server → Run database: queries and reloads
packages/devtools/src/viewer/server.ts - Trace viewer → Trace components: renders
packages/devtools/src/viewer/client/app.tsx - Trace viewer → Step cards: renders
packages/devtools/src/viewer/client/app.tsx - Trace viewer → Trace timeline: renders
packages/devtools/src/viewer/client/app.tsx - Step cards → Trace components: uses components
packages/devtools/src/viewer/client/components/step-card.tsx - Step cards → Message components: uses components
packages/devtools/src/viewer/client/components/step-card.tsx - Codex app client → Tool-loop agents: harness integration