How dcode-v05/browser-agent works
bap-browser lets an AI agent operate a browser through MCP tools while a person watches and can intervene in a live viewer. The main flow is task input → agent/model → browser tools → policy-checked browser session; the service streams activity to the viewer and routes human controls back to the session. The graph also shows configuration, safety policy, and the viewer’s event-driven state/UI. Some links rely on README statements or SOURCE INDEX references because the relevant source was not excerpted.
Main entry points: App.tsx Viewer application · session.py Browser session · command.py Task input · loop.py Agent loop
Components 31
Entry points
- Task input
src/bap_browser/agent/command.py - MCP server
src/bap_browser/mcp/server.py - Configuration
src/bap_browser/config.py
Agent and tools
- Agent loop
src/bap_browser/agent/loop.py - Agent models
src/bap_browser/agent/models.py - OpenAI adapter
src/bap_browser/agent/openai_model.py - Tool toolkit
src/bap_browser/tools/toolkit.py - Browser tools
src/bap_browser/tools/browser_tools.py - Tool registry
src/bap_browser/tools/registry.py - Tool descriptions
src/bap_browser/tools/sentences.py
Browser and safety
- Browser session
src/bap_browser/driver/session.py - Playwright driver
src/bap_browser/driver/playwright_driver.py - Driver interface
src/bap_browser/driver/base.py - URL policy
src/bap_browser/policy/url_policy.py - Address normalization
src/bap_browser/policy/address.py - Redaction
src/bap_browser/policy/redaction.py
Session service
- Service session
src/bap_browser/service/session.py - HTTP and WebSocket
src/bap_browser/service/app.py - Service runtime
src/bap_browser/service/server.py - Event hub
src/bap_browser/service/events.py
Human viewer
- Viewer application
viewer/src/App.tsx - Viewer protocol
viewer/src/protocol.ts - WebSocket connection
viewer/src/connection/socket.ts - Viewer state
viewer/src/state/reducer.ts - Browser pane
viewer/src/components/BrowserPane.tsx - Settings screen
viewer/src/components/SettingsScreen.tsx - Status panel
viewer/src/components/StatusPanel.tsx - Activity timeline
viewer/src/components/Timeline.tsx - Viewer components
viewer/src/components/ChatPanel.tsx
Other components
- Person
- OpenAI model
Connections 39
- Person → Task input: submits task
- Task input → Agent loop: starts run
src/bap_browser/agent/command.py - Agent loop → Agent models: uses model types
src/bap_browser/agent/loop.py - Agent loop → Tool toolkit: offers tools
src/bap_browser/agent/loop.py - OpenAI adapter → OpenAI model: requests completion
src/bap_browser/agent/openai_model.py - Agent loop → OpenAI adapter: uses model adapter
- Tool toolkit → Browser tools: registers tools
- Browser tools → Browser session: operates browser
src/bap_browser/tools/browser_tools.py - Browser tools → Tool registry: uses registry
src/bap_browser/tools/browser_tools.py - Tool descriptions → Tool registry: describes tools
src/bap_browser/tools/sentences.py - MCP server → Tool toolkit: exposes tools
src/bap_browser/mcp/server.py - MCP server → Browser session: creates driver session
- Task input → Service runtime: starts service
src/bap_browser/agent/command.py - Task input → Service session: starts session
src/bap_browser/agent/command.py - Service session → Browser session: owns browser
src/bap_browser/service/session.py - Browser session → Playwright driver: starts driver
src/bap_browser/driver/session.py - Playwright driver → Driver interface: implements interface
src/bap_browser/driver/playwright_driver.py - Browser session → URL policy: checks addresses
src/bap_browser/driver/session.py - Browser session → Redaction: redacts output
src/bap_browser/driver/session.py - URL policy → Address normalization: normalizes URLs
- Service session → Event hub: publishes activity
src/bap_browser/service/session.py - Service runtime → HTTP and WebSocket: hosts app
src/bap_browser/service/server.py - HTTP and WebSocket → Service session: routes viewer commands
src/bap_browser/service/app.py - HTTP and WebSocket → Event hub: streams events
src/bap_browser/service/app.py - Configuration → Browser session: configures browser
src/bap_browser/driver/session.py - Configuration → Service runtime: configures service
src/bap_browser/service/server.py - Service runtime → Person: provides viewer address
src/bap_browser/service/server.py - Person → Viewer application: watches and controls
- Viewer application → WebSocket connection: creates connection
viewer/src/App.tsx - WebSocket connection → Viewer state: dispatches events
- WebSocket connection → HTTP and WebSocket: exchanges events and commands
- Viewer protocol → WebSocket connection: defines messages
viewer/src/connection/socket.ts - Viewer application → Viewer state: reduces events
viewer/src/App.tsx - Viewer application → Browser pane: renders browser
viewer/src/App.tsx - Viewer application → Settings screen: renders settings
viewer/src/App.tsx - Viewer application → Status panel: renders status
viewer/src/App.tsx - Viewer application → Activity timeline: renders activity
viewer/src/App.tsx - Viewer application → Viewer components: renders chat
viewer/src/App.tsx - Viewer application → Viewer protocol: uses message types
viewer/src/App.tsx