How etalab/transport-site works
Main System Components
a. Core Applications (Umbrella Structure):
• transport: Main web application
• datagouvfr: Integration with data.gouv.fr
• shared: Common functionality
• unlock: Proxy service for real-time data
b. External Services:
• PostgreSQL Database with PostGIS
• S3-compatible Storage (Scaleway)
• OAuth Provider (data.gouv.fr)
• External Validation Tools
• Monitoring Services (updown.io)
Key Flows to Highlight
a. Data Flow:
• User Authentication via OAuth
• Dataset Import/Validation Pipeline
• Real-time Data Proxy
• Geospatial Data Processing
b. Integration Points:
• data.gouv.fr API Integration
• External Validation Tools
• Monitoring Services
• Email Services
Important Details
• Domain routing (transport.data.gouv.fr, proxy.transport.data.gouv.fr)
• Background Job Processing
• Validation Pipeline
• Caching Strategy
• Security Boundaries
Specific Components to Detail
a. Transport App:
• Controllers
• LiveView Components
• Job Processors
• API Endpoints
b. Unlock App:
• Proxy Configuration
• Caching Mechanism
• Request Handling
c. DataGouvFr App:
• API Client
• Authentication
• Data Synchronization