How s3n-w6i/drino works
Key Components to Include in the System Design:
Core System Components
a) Data Processing Pipeline:
• Step 1: Data Fetching (GTFS)
• Step 2: Data Import
• Step 3: Data Validation
• Step 4: Data Merging
• Step 5: Simplification
b) Routing Engine Components:
• RAPTOR Algorithm Implementation
• STP (Scalable Transfer Patterns)
• Transfer Pattern Processing
As interconnected modules within the routing component.
c) Visualization Layer:
• A separate section for the visualization stack:
• Backend API (Rust-based)
• Frontend UI (React-based)
Architectural Patterns to Highlight
• Data Layer (bottom)
• Processing Layer (middle)
• Presentation Layer (top)
• Data processing components (e.g., blue)
• Algorithmic components (e.g., green)
• API/UI components (e.g., purple)
Important Details
a) Preprocessing Pipeline:
• Clustering algorithms (DBSCAN, GMM, K-means, OPTICS)
• Preprocessing requirements (RAM < 2GB, Time < 3h)
b) Query Processing:
• Query flow through the system
• Performance constraints (< 50ms, < 500MB RAM)
Technical Implementation Details
• Rust backend components
• React frontend components
• Data storage/processing components
• API endpoints
b) Data structures:
• Transfer Pattern Graph
• Transfer Pattern Table
• Direct Connections