How umair706/amazon-omniscient works
Omniscient is a self-hosted Amazon FBA research product. Sellers discover or analyze a niche; the API queues background work that gathers marketplace and supplier data, enriches products and reviews, scores the opportunity, and produces financial projections and a launch brief for the frontend. The graph also preserves settings, exports, and the MCP toolbox. API routing and selected worker/service calls are evidenced by excerpts or the SOURCE INDEX; broader data-store and external-service connections are documented in the README, while unsampled internals are not expanded.
Main entry points: tasks.py Analysis worker · router.py API router · main.py FastAPI app · base_client.py LLM providers
Components 29
Client
- Research UI
frontend/src/app/page.tsx
API and access
- FastAPI app
backend/app/main.py - API router
backend/app/api/router.py - Niche API
backend/app/api/niches.py - Jobs API
backend/app/api/jobs.py - Product API
backend/app/api/products.py - Recommendation API
backend/app/api/recommendations.py - Settings API
backend/app/api/settings.py - Exports API
backend/app/api/exports.py - MCP toolbox
backend/app/mcp/tools.py
Research workflow
- Analysis worker
backend/app/workers/tasks.py - Amazon scraper
backend/app/services/scraper_service.py - Browser session
backend/app/scraping/session.py - SP-API integration
backend/app/services/spapi_service.py - Supplier sourcing
backend/app/services/made_in_china_scraper.py
Analysis and outputs
- Review analysis
backend/app/services/review_analyzer.py - Competitor analysis
backend/app/services/competitor_service.py - Opportunity scoring
backend/app/services/scoring_service.py - Scoring settings
backend/app/services/scoring_config.py - Recommendation engine
backend/app/services/recommendation_engine.py - Financial projections
backend/app/services/financial_report.py - LLM providers
backend/app/llm/base_client.py
Data and integrations
- PostgreSQL
- Redis queue/cache
- Amazon marketplace
- Supplier sites
- LLM service
- Proxy service
Other components
- FBA seller
Connections 35
- FBA seller → Research UI: uses
README.md - Research UI → FastAPI app: REST requests
README.md - FastAPI app → API router: mounts
backend/app/main.py - API router → Niche API: routes
backend/app/api/router.py - API router → Jobs API: routes
backend/app/api/router.py - API router → Product API: routes
backend/app/api/router.py - API router → Recommendation API: routes
backend/app/api/router.py - API router → Settings API: routes
backend/app/api/router.py - API router → Exports API: routes
backend/app/api/router.py - Jobs API → Analysis worker: dispatches jobs
backend/app/api/jobs.py - Analysis worker → Redis queue/cache: queues tasks
README.md - Redis queue/cache → Analysis worker: delivers tasks
README.md - Analysis worker → Amazon scraper: uses
backend/app/workers/tasks.py - Analysis worker → Browser session: builds session
backend/app/workers/tasks.py - Amazon scraper → Browser session: uses session
backend/app/services/scraper_service.py - Amazon scraper → Amazon marketplace: scrapes pages
README.md - Analysis worker → SP-API integration: uses
backend/app/workers/tasks.py - Analysis worker → Supplier sourcing: sources suppliers
README.md - Supplier sourcing → Supplier sites: scrapes data
README.md - Analysis worker → Review analysis: runs analysis
backend/app/workers/tasks.py - Review analysis → LLM providers: uses
backend/app/services/review_analyzer.py - Competitor analysis → LLM providers: uses
backend/app/services/competitor_service.py - Analysis worker → Opportunity scoring: computes score
backend/app/workers/tasks.py - Opportunity scoring → Scoring settings: loads rules
backend/app/services/scoring_service.py - Analysis worker → Recommendation engine: builds brief
backend/app/services/recommendation_engine.py - Recommendation engine → Opportunity scoring: scores metrics
backend/app/services/recommendation_engine.py - Recommendation engine → LLM providers: generates analysis
backend/app/services/recommendation_engine.py - Analysis worker → Financial projections: produces projections
README.md - LLM providers → LLM service: requests analysis
README.md - Browser session → Proxy service: rotates IPs
README.md - FastAPI app → PostgreSQL: stores data
README.md - Analysis worker → PostgreSQL: persists results
README.md - FastAPI app → Redis queue/cache: uses cache
README.md - FastAPI app → MCP toolbox: exposes tools
- FBA seller → MCP toolbox: connects agent
README.md