How floschnell/properwatcher works
Main System Components
a) Core Components:
• Crawler System (src/crawlers/)
• Filter System (src/filters/)
• Enricher System (src/enrichers/)
• Observer System (src/observers/)
• Configuration Manager (src/configuration.rs)
• Data Models (src/models/)
External Integration Points
• Property Websites (ImmobilienScout24, Wohnungsboerse, etc.)
• AWS DynamoDB
• Telegram API
• SMTP Email Services
• OpenStreetMap Nominatim API
Specific Implementation Details
Technical details in subcomponents:
• Parallel processing in the crawler section
• Async operations using Rust's async/await
• Firefox Servo technology integration
• AWS Lambda integration points
Key Elements to Highlight
• Parallel processing capability
• Modular architecture
• AWS Lambda support
• Data transformation pipeline
• External service integration
[Property Websites]
• ↓
[Crawler System (Parallel)]
• ↓
[Filter System]
• ↓
[Enricher System]
• ↓
[Observer System]
• ↓
[Storage & Notifications]
Important Considerations:
Technical details
• Thread pools for parallel processing
• Async runtime indicators
• AWS Lambda configuration
• Database schemas
Configuration flow
• TOML/JSON config input
• Configuration distribution to components
• Runtime configuration management