How rossyanez/freecrawl-seo-tool works
FreeCrawl is a local-first desktop SEO crawler for large sites. A user configures and starts a crawl in the desktop UI; crawling fetches and parses pages, persists URL findings, and streams results for audit and analysis. The product also covers project management, exports, Google data, spelling, AI, logs, and agent-driven operation. The README documents these capabilities; the excerpts and source index support selected internal relationships, while unsampled implementation details are not asserted as verified calls.
Main entry points: crawler.ts Crawler · App.tsx Desktop workspace · project-db.ts Project database · tools.ts MCP tools
Components 26
Desktop experience
- Desktop workspace
apps/desktop/src/renderer/src/App.tsx - UI state
apps/desktop/src/renderer/src/store.ts - URL results grid
apps/desktop/src/renderer/src/grid/UrlGridCanvas.tsx - Audit views
apps/desktop/src/renderer/src/tabs/SeoTab.tsx - Log analysis
packages/core/src/log-parser.ts
Crawl and analysis
- Crawler
packages/core/src/crawler.ts - HTTP and DNS
packages/core/src/http-client.ts - Page parsing
packages/core/src/html-parser.ts - Parser worker
apps/desktop/src/main/parser-worker.ts - SEO checks
packages/shared-types/src/issue-catalog.ts - Browser rendering
packages/core/src/render-fetcher.ts
Projects and export
- Project database
packages/db/src/project-db.ts - Schema migrations
packages/db/src/migrations.ts - Data and reports
packages/core/src/tabular-export.ts - Project archives
apps/desktop/src/main/project-archive.ts
Enrichment and agents
- Google integrations
apps/desktop/src/main/google-oauth.ts - SEO data providers
apps/desktop/src/main/seo-providers.ts - Spelling checks
apps/desktop/src/main/languagetool.ts - AI assistance
apps/desktop/src/main/ai-chat.ts - MCP tools
apps/mcp-server/src/tools.ts - Desktop bridge
apps/mcp-server/src/desktop-bridge.ts
Other components
- SEO user
- AI agent
- Google services
- LanguageTool service
- AI providers
Connections 27
- SEO user → Desktop workspace: uses
README.md - Desktop workspace → UI state: manages
apps/desktop/src/renderer/src/App.tsx - Desktop workspace → URL results grid: shows results
README.md - Desktop workspace → Audit views: opens audits
README.md - SEO user → Crawler: starts crawl
README.md - Crawler → HTTP and DNS: fetches pages
- Crawler → Page parsing: parses pages
- Parser worker → Page parsing: runs parser
apps/desktop/src/main/parser-worker.ts - Crawler → Browser rendering: renders JavaScript
- Crawler → SEO checks: checks pages
- Crawler → Project database: stores findings
- Project database → URL results grid: feeds results
- SEO user → Log analysis: analyzes logs
README.md - SEO user → Data and reports: exports results
README.md - SEO user → Project archives: saves project
README.md - SEO user → Google integrations: connects account
README.md - Google integrations → SEO data providers: fetches metrics
- SEO data providers → Google services: queries services
- SEO user → Spelling checks: checks writing
README.md - Spelling checks → LanguageTool service: checks language
README.md - SEO user → AI assistance: runs prompts
README.md - AI assistance → AI providers: requests completion
README.md - AI agent → MCP tools: calls tools
README.md - MCP tools → Desktop bridge: sends requests
apps/mcp-server/src/tools.ts - Desktop bridge → Crawler: controls crawl
apps/mcp-server/src/desktop-bridge.ts - MCP tools → Project database: reads results
apps/mcp-server/src/tools.ts - Schema migrations → Project database: defines schema
packages/db/src/project-db.ts