How iam-hemanth/cricket-lake-unfiltered works
Cricket Lake Unfiltered is an ESPNcricinfo match-data extraction, normalization, validation, consolidation, and download product. Its principal workflow fetches and preserves raw match payloads, constructs normalized match JSON, validates and consolidates records, then publishes catalogs and downloadable slices. The graph also includes documented discovery/update and calendar capabilities. Some workflow and download implementation files were not sampled, so those relationships are shown only where the README documents them.
Main entry points: validator.py Match Validation · constructor.py Match Constructor · commentary.py Match Fetching · build_lake_catalog.py Lake Catalog
Components 21
Extraction & Parsing
- Match Fetching
src/commentary.py - Request Signing
src/auth.py - HTTP Client
src/client.py - Match Discovery
scripts/discover_delta.py
Match Normalization
- Offline Reparse
reparse.py - Match Constructor
src/constructor.py - Match Classification
src/classification.py - Player Mapping
src/participants.py - Stage Metadata
src/stage.py - Source Facts
src/source_facts.py - Hundred Rules
src/hundred.py
Lake & Quality
- Match Validation
src/validator.py - Source-Gap Policy
scripts/apply_source_gap_policy.py - Lake Consolidation
consolidate.py - Master Lake
data/manifest_unfiltered_delta.json
Catalog & Downloads
- Lake Catalog
scripts/build_lake_catalog.py - Download Slices
scripts/downloads/build_shard.py - Slice Metadata
scripts/downloads/metadata.py - Match Calendar
scripts/downloads/calendar.py
Other components
- ESPNcricinfo
- Data Consumers
Connections 24
- ESPNcricinfo → Match Fetching: provides payloads
README.md - Match Fetching → Request Signing: signs requests
src/commentary.py - Match Fetching → HTTP Client: sends requests
src/commentary.py - ESPNcricinfo → Match Discovery: supplies match updates
- Offline Reparse → Match Constructor: constructs matches
reparse.py - Offline Reparse → Match Validation: validates matches
reparse.py - Match Constructor → Match Classification: classifies matches
src/constructor.py - Match Constructor → Player Mapping: maps players
src/constructor.py - Match Constructor → Stage Metadata: derives stages
src/constructor.py - Match Constructor → Source Facts: uses source facts
src/constructor.py - Match Constructor → Hundred Rules: applies rules
src/constructor.py - Match Validation → Match Classification: checks classification
src/validator.py - Match Validation → Source Facts: checks source facts
src/validator.py - Match Validation → Hundred Rules: checks Hundred rules
src/validator.py - Source-Gap Policy → Match Validation: uses validation
scripts/apply_source_gap_policy.py - Lake Consolidation → Match Validation: validates inventory
consolidate.py - Lake Consolidation → Master Lake: writes lake archive
README.md - Master Lake → Lake Catalog: indexes matches
- Lake Catalog → Match Validation: checks candidates
scripts/build_lake_catalog.py - Lake Catalog → Download Slices: feeds slice builds
README.md - Download Slices → Slice Metadata: uses slice metadata
scripts/downloads/build_shard.py - Download Slices → Data Consumers: publishes zip slices
README.md - Match Calendar → Stage Metadata: uses stage fields
scripts/downloads/calendar.py - Match Calendar → Data Consumers: serves match calendar
README.md