How samihzs/sih2026 works
SIH26171 is a Chrome MV3 privacy-preserving browser assistant. The main workflow observes a page, performs local visual and text privacy processing, sends sanitized context to a selected model, grounds its intent to page-owned elements, then validates and executes bounded actions with fresh observations. README documents the pipeline and safety guarantees; sampled source confirms key visual, model-routing, detector, and UI behavior, but several runtime connections rely on that documentation.
Main entry points: background.js Service worker · agentCoordinator.js Agent coordinator · modelManager.js Model router · content.js Page observer
Components 26
Assistant experience
- Assistant sidebar
extension/sidebar.js - Provider settings
extension/options.js - Service worker
extension/background.js
Local perception privacy
- Page observer
extension/content.js - DOM PII detector
extension/detectors/domDetector.js - Text PII detector
extension/detectors/regexDetector.js - Detection fusion
extension/detectionFusion.js - Visual pipeline
extension/vision/visualPipeline.js - Offscreen processor
extension/vision/visualWorker.js - Local OCR
extension/detectors/ocrDetector.js - Context sanitizer
extension/sanitize.js
Grounded safe actions
- Agent coordinator
extension/agentCoordinator.js - Element registry
extension/elementRegistry.js - Intent grounding
extension/grounding.js - Action firewall
extension/validate.js - Bounded executor
extension/execute.js
Model integrations
- Model router
extension/modelManager.js - Gemini adapter
extension/providers/geminiProvider.js - Groq adapter
extension/providers/groqProvider.js - OpenRouter adapter
extension/providers/openRouterProvider.js - Local model adapter
extension/providers/localProvider.js
Other components
- User
- Browser page
- Chrome APIs
- Configured model service
- Extension storage
Connections 35
- User → Assistant sidebar: requests help
- Assistant sidebar → Service worker: sends requests
- Provider settings → Service worker: configures provider
- Service worker → Page observer: requests observation
- Browser page → Page observer: provides DOM
- Page observer → DOM PII detector: scans elements
- Page observer → Text PII detector: scans visible text
- Page observer → Visual pipeline: requests analysis
- Visual pipeline → Service worker: requests processing
- Service worker → Chrome APIs: captures viewport
- Service worker → Offscreen processor: dispatches image
- Offscreen processor → Local OCR: recognizes redacted canvas
- DOM PII detector → Detection fusion: supplies detections
- Text PII detector → Detection fusion: supplies detections
- Offscreen processor → Detection fusion: supplies visual findings
- Detection fusion → Context sanitizer: provides detections
- Page observer → Context sanitizer: provides page context
- Context sanitizer → Service worker: returns protected context
- Service worker → Assistant sidebar: updates context
- Service worker → Agent coordinator: starts transaction
- Agent coordinator → Model router: requests model response
- Model router → Gemini adapter: routes request
- Model router → Groq adapter: routes request
- Model router → OpenRouter adapter: routes request
- Model router → Local model adapter: routes request
- Gemini adapter → Configured model service: sends sanitized request
- Groq adapter → Configured model service: sends sanitized request
- OpenRouter adapter → Configured model service: sends sanitized request
- Model router → Extension storage: reads and writes config
- Agent coordinator → Element registry: uses page index
- Agent coordinator → Intent grounding: grounds intent
- Agent coordinator → Action firewall: checks action
- Agent coordinator → Bounded executor: dispatches action
- Bounded executor → Browser page: performs bounded action
- Agent coordinator → Service worker: requests fresh observation