How kw4ngk1m/multimodal-recsys works
This repository combines a multimodal shopping search and recommendation API with offline model research, A/B experimentation, and user simulation. The main serving flow is a user request routed by FastAPI to search or recommendation logic, which uses catalog data and stored embeddings; interaction events support experiment measurement. Offline RecSys and paper experiments develop and evaluate models, while the simulator generates persona-based behavior for testing. Several router and subsystem implementations were not excerpted, so their internal call paths are omitted or marked unverified.
Main entry points: main.py FastAPI App · search.py Search API · models.py Application Database · __main__.py Simulation Runner
Components 20
API Serving
- FastAPI App
backend/app/main.py - Search API
backend/app/routers/search.py - Search Scoring
backend/app/services/search_core.py - Recommendation API
backend/app/routers/recommend.py - Recommenders
backend/app/recommenders
Catalog and Events
- Event API
backend/app/routers/events.py - Catalog Index
backend/app/services/catalog_index.py - Feature Store
backend/app/services/feature_store.py - Application Database
backend/app/models.py
Experiments and Models
- Admin and Metrics APIs
backend/app/routers/admin.py - A/B and Metrics
backend/app/services/ab.py
User and Admin UI
- Dashboard
dashboard/app.py - Dashboard Data
dashboard/data.py
Research and Simulation
- Offline Training and Evaluation
recsys - Paper Experiments
paper/msrs_paper - Behavior Engine
simulator/engine.py - Simulation Data
simulator/data.py - Simulation Runner
simulator/__main__.py - Monitoring Runner
monitoring/runner.py
Other components
- Shopper
Connections 22
- Shopper → FastAPI App: uses
README.md - FastAPI App → Search API: mounts routes
backend/app/main.py - FastAPI App → Recommendation API: mounts routes
backend/app/main.py - FastAPI App → Event API: mounts routes
backend/app/main.py - FastAPI App → Admin and Metrics APIs: mounts routes
backend/app/main.py - Search API → Search Scoring: scores queries
backend/app/routers/search.py - Search API → Catalog Index: gets index
backend/app/routers/search.py - Search API → Application Database: reads items
backend/app/routers/search.py - FastAPI App → Catalog Index: warms index
backend/app/main.py - Recommendation API → Recommenders: selects model
- Recommendation API → Application Database: loads user data
- Event API → Application Database: writes events
backend/app/routers/events.py - Event API → Feature Store: updates features
backend/app/routers/events.py - Admin and Metrics APIs → Application Database: manages models
- Admin and Metrics APIs → A/B and Metrics: measures experiments
- Dashboard → Dashboard Data: uses data
dashboard/app.py - Dashboard → FastAPI App: calls service
- Offline Training and Evaluation → Paper Experiments: evaluates methods
- Simulation Runner → Simulation Data: loads data
simulator/server.py - Simulation Runner → Behavior Engine: runs behavior
- Behavior Engine → Simulation Data: uses data
simulator/engine.py - Simulation Runner → FastAPI App: feeds A/B logs