How techjarves/mobile-server works
Mobile Server turns an Android phone into an OpenAI-compatible local inference server. The user selects or imports a model, starts the foreground server, and can optionally expose it through Ngrok or Cloudflare so compatible clients can send requests. Model management, downloads, runtime initialization, server hosting, tunnel selection, and background keep-alive are distinct stages. The README documents the API and privacy/tunneling goals; sampled service and model-management excerpts show portions of the implementation, but the server’s request-handling internals were not sampled.
Main entry points: OpenAiServerService.kt Foreground service · ModelManagerViewModel.kt Model manager · GlobalModelManager.kt Server controls · DownloadRepository.kt Model downloads
Components 15
Model lifecycle
- Model manager UI
Android/src/app/src/main/java/com/server/edge/gallery/ui/modelmanager/GlobalModelManager.kt - Model manager
Android/src/app/src/main/java/com/server/edge/gallery/ui/modelmanager/ModelManagerViewModel.kt - Model downloads
Android/src/app/src/main/java/com/server/edge/gallery/data/DownloadRepository.kt - Download worker
Android/src/app/src/main/java/com/server/edge/gallery/worker/DownloadWorker.kt - On-device runtime
Android/src/app/src/main/java/com/server/edge/gallery/runtime/LlmModelHelper.kt - Model keep-alive
Android/src/app/src/main/java/com/server/edge/gallery/worker/ModelKeepAliveService.kt
Server hosting
- Server controls
Android/src/app/src/main/java/com/server/edge/gallery/ui/modelmanager/GlobalModelManager.kt - Foreground service
Android/src/app/src/main/java/com/server/edge/gallery/openai/OpenAiServerService.kt - OpenAI API server
Android/src/app/src/main/java/com/server/edge/gallery/openai/OpenAiServer.kt - Server state
Android/src/app/src/main/java/com/server/edge/gallery/openai/OpenAiServerState.kt
Public access
- Ngrok tunnel
Android/src/app/src/main/java/com/server/edge/gallery/openai/NgrokTunnel.kt - Cloudflare tunnel
Android/src/app/src/main/java/com/server/edge/gallery/openai/CloudflareTunnel.kt
App state
- Preferences store
Android/src/app/src/main/java/com/server/edge/gallery/data/DataStoreRepository.kt
Other components
- Phone user
- API client
Connections 18
- Phone user → Model manager UI: selects model
README.md - Model manager UI → Model manager: manages models
Android/src/app/src/main/java/com/server/edge/gallery/ui/modelmanager/GlobalModelManager.kt - Model manager → Model downloads: requests downloads
Android/src/app/src/main/java/com/server/edge/gallery/ui/modelmanager/ModelManagerViewModel.kt - Model downloads → Download worker: enqueues work
Android/src/app/src/main/java/com/server/edge/gallery/data/DownloadRepository.kt - Model manager → On-device runtime: initializes models
- Model manager → Model keep-alive: starts service
Android/src/app/src/main/java/com/server/edge/gallery/ui/modelmanager/ModelManagerViewModel.kt - Phone user → Server controls: starts server
README.md - Server controls → Foreground service: starts service
Android/src/app/src/main/java/com/server/edge/gallery/ui/modelmanager/GlobalModelManager.kt - Foreground service → OpenAI API server: starts server
Android/src/app/src/main/java/com/server/edge/gallery/openai/OpenAiServerService.kt - Foreground service → Model manager: obtains model manager
Android/src/app/src/main/java/com/server/edge/gallery/openai/OpenAiServerService.kt - Foreground service → Server state: updates status
Android/src/app/src/main/java/com/server/edge/gallery/openai/OpenAiServerService.kt - API client → OpenAI API server: sends API requests
README.md - Server controls → Ngrok tunnel: selects provider
- Server controls → Cloudflare tunnel: selects provider
- Foreground service → Ngrok tunnel: starts tunnel
Android/src/app/src/main/java/com/server/edge/gallery/openai/OpenAiServerService.kt - Foreground service → Cloudflare tunnel: starts tunnel
Android/src/app/src/main/java/com/server/edge/gallery/openai/OpenAiServerService.kt - Server controls → Server state: reads public URL
- Model manager → Preferences store: loads settings
Android/src/app/src/main/java/com/server/edge/gallery/ui/modelmanager/ModelManagerViewModel.kt