# 245070002yjq/midterm_project architecture

> Architecture diagram of the GitHub repository 245070002yjq/midterm_project, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-17). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/245070002yjq/midterm_project
- Repository: https://github.com/245070002yjq/midterm_project

## Overview

This repository is a research workflow for comparing CityWalk suitability across 15 Chinese new first-tier cities. The documented path runs from collecting OSM roads and Amap destinations/transit/POIs, through spatial cleaning and destination selection, to walk-network access and commercial/greenery metrics, then integrated evaluation and figures. Its distinct analytical stages include transit routing, commercial density/diversity, NDVI, and weighted suitability scenarios with clustering. The README documents the broad workflow; where source excerpts do not show file-to-file wiring, links are documented at workflow level rather than inferred from imports.

Main entry points: [`data/integrated/15新一线城市_结果.csv`](https://github.com/245070002yjq/midterm_project/blob/main/data/integrated/15%E6%96%B0%E4%B8%80%E7%BA%BF%E5%9F%8E%E5%B8%82_%E7%BB%93%E6%9E%9C.csv) (Integrated results), [`analysis/汇总.py`](https://github.com/245070002yjq/midterm_project/blob/main/analysis/%E6%B1%87%E6%80%BB.py) (Transport summary), [`processing/filter_osm_walkways_qgis.py`](https://github.com/245070002yjq/midterm_project/blob/main/processing/filter_osm_walkways_qgis.py) (Walkway filtering), [`analysis/pingjia.py`](https://github.com/245070002yjq/midterm_project/blob/main/analysis/pingjia.py) (Suitability evaluation)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_collection["Data collection"]
  node_mapcrawl["Amap POI crawler<br/>[gd_map_crawler.py]"]
  node_bizcrawl["Commercial POI crawler<br/>[爬取商业poi.py]"]
  node_osmfetch["OSM road fetch"]
  node_green["NDVI computation<br/>[greenery.js]"]
end

subgraph group_spatial["Spatial preparation"]
  node_data_clean["Data cleaning<br/>[data_clean.py]"]
  node_walk_filter["Walkway filtering"]
  node_top20["Destination selection"]
  node_city_top20["Top-20 selection"]
  node_ningbo_split["Ningbo Suzhou prep"]
  node_osm_merge["OSM merge"]
end

subgraph group_analysis["Suitability analysis"]
  node_walk_access["Transit walk routing<br/>[01distance_code.py]"]
  node_changsha_access["Changsha routing"]
  node_special_access["Ningbo Suzhou routing"]
  node_commercial["Commercial metrics<br/>[密度多样性.py]"]
  node_assessment["Suitability evaluation<br/>[pingjia.py]"]
  node_analysis_run["Metric summaries<br/>[run.py]"]
  node_transport_summary["Transport summary<br/>[汇总.py]"]
  node_ningbo_final["Ningbo final data"]
  node_processing_eval["Processing evaluation<br/>[pingjia.py]"]
end

subgraph group_outputs["Results and figures"]
  node_integrated[("Integrated results<br/>[15新一线城市_结果.csv]")]
  node_transport_figures["Access figures"]
  node_business_figures["Transit business figures"]
  node_cluster_figures["Suitability figures"]
  node_other_figures["Other visualizations<br/>[画图.py]"]
end

node_researcher(("Researcher"))
node_amap{{"Amap services"}}
node_osm{{"OSM roads"}}
node_gee{{"Google Earth Engine"}}

node_researcher -->|"initiates collection"| node_mapcrawl
node_researcher -->|"initiates collection"| node_bizcrawl
node_researcher -->|"initiates collection"| node_osmfetch
node_amap -->|"supplies POIs"| node_mapcrawl
node_osm -->|"supplies roads"| node_osmfetch
node_gee -->|"supplies imagery"| node_green
node_mapcrawl -->|"provides candidates"| node_top20
node_bizcrawl -->|"provides POIs"| node_data_clean
node_osmfetch -->|"provides road data"| node_osm_merge
node_osm_merge -->|"provides roads"| node_walk_filter
node_top20 -->|"selects destinations"| node_city_top20
node_top20 -->|"prepares city samples"| node_ningbo_split
node_walk_filter -->|"provides walk network"| node_walk_access
node_walk_filter -->|"provides walk network"| node_changsha_access
node_walk_filter -->|"provides walk network"| node_special_access
node_city_top20 -->|"provides destinations"| node_walk_access
node_ningbo_split -->|"prepares samples"| node_special_access
node_walk_access -->|"produces distances"| node_transport_summary
node_changsha_access -->|"produces distances"| node_transport_summary
node_special_access -->|"produces distances"| node_transport_summary
node_data_clean -->|"supplies cleaned data"| node_commercial
node_green -->|"supplies NDVI"| node_assessment
node_commercial -->|"supplies business metrics"| node_assessment
node_transport_summary -->|"supplies access metrics"| node_assessment
node_assessment -->|"forms evaluation data"| node_integrated
node_ningbo_final -.->|"prepares final data"| node_integrated
node_processing_eval -.->|"supports evaluation"| node_integrated
node_integrated -.->|"provides metrics"| node_analysis_run
node_transport_summary -.->|"provides access results"| node_transport_figures
node_integrated -.->|"provides comparison data"| node_business_figures
node_integrated -.->|"provides suitability data"| node_cluster_figures
node_integrated -.->|"provides result data"| node_other_figures

click node_mapcrawl "https://github.com/245070002yjq/midterm_project/blob/main/crawler/gd_map_crawler.py"
click node_bizcrawl "https://github.com/245070002yjq/midterm_project/blob/main/crawler/%E7%88%AC%E5%8F%96%E5%95%86%E4%B8%9Apoi.py"
click node_osmfetch "https://github.com/245070002yjq/midterm_project/blob/main/crawler/download_CITY_osm_2025.py"
click node_green "https://github.com/245070002yjq/midterm_project/blob/main/crawler/greenery.js"
click node_data_clean "https://github.com/245070002yjq/midterm_project/blob/main/processing/data_clean.py"
click node_walk_filter "https://github.com/245070002yjq/midterm_project/blob/main/processing/filter_osm_walkways_qgis.py"
click node_top20 "https://github.com/245070002yjq/midterm_project/blob/main/processing/split_top20_cities_aoi.py"
click node_city_top20 "https://github.com/245070002yjq/midterm_project/blob/main/processing/select_citywalk_top20.py"
click node_ningbo_split "https://github.com/245070002yjq/midterm_project/blob/main/processing/split_ningbo_suzhou.py"
click node_walk_access "https://github.com/245070002yjq/midterm_project/blob/main/analysis/01distance_code.py"
click node_changsha_access "https://github.com/245070002yjq/midterm_project/blob/main/analysis/02distance_code_changsha.py"
click node_special_access "https://github.com/245070002yjq/midterm_project/blob/main/analysis/03distance_code_suzhou%26ninbo.py"
click node_commercial "https://github.com/245070002yjq/midterm_project/blob/main/analysis/%E5%AF%86%E5%BA%A6%E5%A4%9A%E6%A0%B7%E6%80%A7.py"
click node_assessment "https://github.com/245070002yjq/midterm_project/blob/main/analysis/pingjia.py"
click node_analysis_run "https://github.com/245070002yjq/midterm_project/blob/main/analysis/run.py"
click node_transport_summary "https://github.com/245070002yjq/midterm_project/blob/main/analysis/%E6%B1%87%E6%80%BB.py"
click node_ningbo_final "https://github.com/245070002yjq/midterm_project/blob/main/processing/build_ningbo_final.py"
click node_processing_eval "https://github.com/245070002yjq/midterm_project/blob/main/processing/pingjia.py"
click node_osm_merge "https://github.com/245070002yjq/midterm_project/blob/main/processing/merge_CITY_osm_2025.py"
click node_integrated "https://github.com/245070002yjq/midterm_project/blob/main/data/integrated/15%E6%96%B0%E4%B8%80%E7%BA%BF%E5%9F%8E%E5%B8%82_%E7%BB%93%E6%9E%9C.csv"
click node_transport_figures "https://github.com/245070002yjq/midterm_project/blob/main/visualization/figure_5.2.1_5.2.2_code.py"
click node_business_figures "https://github.com/245070002yjq/midterm_project/blob/main/visualization/figure_5.2.3_5.2.4_code.py"
click node_cluster_figures "https://github.com/245070002yjq/midterm_project/blob/main/visualization/figure_5.4.1._5.4.2.py"
click node_other_figures "https://github.com/245070002yjq/midterm_project/blob/main/visualization/%E7%94%BB%E5%9B%BE.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_mapcrawl,node_bizcrawl,node_osmfetch,node_green toneBlue
class node_data_clean,node_walk_filter,node_top20,node_city_top20,node_ningbo_split,node_osm_merge toneAmber
class node_walk_access,node_changsha_access,node_special_access,node_commercial,node_assessment,node_analysis_run,node_transport_summary,node_ningbo_final,node_processing_eval toneMint
class node_integrated,node_transport_figures,node_business_figures,node_cluster_figures,node_other_figures toneRose
class node_researcher,node_amap,node_osm,node_gee toneIndigo
```

## Components

### Data collection

- [Amap POI crawler](https://github.com/245070002yjq/midterm_project/blob/main/crawler/gd_map_crawler.py): `crawler/gd_map_crawler.py`
- [Commercial POI crawler](https://github.com/245070002yjq/midterm_project/blob/main/crawler/%E7%88%AC%E5%8F%96%E5%95%86%E4%B8%9Apoi.py): `crawler/爬取商业poi.py`
- [OSM road fetch](https://github.com/245070002yjq/midterm_project/blob/main/crawler/download_CITY_osm_2025.py): `crawler/download_CITY_osm_2025.py`
- [NDVI computation](https://github.com/245070002yjq/midterm_project/blob/main/crawler/greenery.js): `crawler/greenery.js`

### Spatial preparation

- [Data cleaning](https://github.com/245070002yjq/midterm_project/blob/main/processing/data_clean.py): `processing/data_clean.py`
- [Walkway filtering](https://github.com/245070002yjq/midterm_project/blob/main/processing/filter_osm_walkways_qgis.py): `processing/filter_osm_walkways_qgis.py`
- [Destination selection](https://github.com/245070002yjq/midterm_project/blob/main/processing/split_top20_cities_aoi.py): `processing/split_top20_cities_aoi.py`
- [Top-20 selection](https://github.com/245070002yjq/midterm_project/blob/main/processing/select_citywalk_top20.py): `processing/select_citywalk_top20.py`
- [Ningbo Suzhou prep](https://github.com/245070002yjq/midterm_project/blob/main/processing/split_ningbo_suzhou.py): `processing/split_ningbo_suzhou.py`
- [OSM merge](https://github.com/245070002yjq/midterm_project/blob/main/processing/merge_CITY_osm_2025.py): `processing/merge_CITY_osm_2025.py`

### Suitability analysis

- [Transit walk routing](https://github.com/245070002yjq/midterm_project/blob/main/analysis/01distance_code.py): `analysis/01distance_code.py`
- [Changsha routing](https://github.com/245070002yjq/midterm_project/blob/main/analysis/02distance_code_changsha.py): `analysis/02distance_code_changsha.py`
- [Ningbo Suzhou routing](https://github.com/245070002yjq/midterm_project/blob/main/analysis/03distance_code_suzhou%26ninbo.py): `analysis/03distance_code_suzhou&ninbo.py`
- [Commercial metrics](https://github.com/245070002yjq/midterm_project/blob/main/analysis/%E5%AF%86%E5%BA%A6%E5%A4%9A%E6%A0%B7%E6%80%A7.py): `analysis/密度多样性.py`
- [Suitability evaluation](https://github.com/245070002yjq/midterm_project/blob/main/analysis/pingjia.py): `analysis/pingjia.py`
- [Metric summaries](https://github.com/245070002yjq/midterm_project/blob/main/analysis/run.py): `analysis/run.py`
- [Transport summary](https://github.com/245070002yjq/midterm_project/blob/main/analysis/%E6%B1%87%E6%80%BB.py): `analysis/汇总.py`
- [Ningbo final data](https://github.com/245070002yjq/midterm_project/blob/main/processing/build_ningbo_final.py): `processing/build_ningbo_final.py`
- [Processing evaluation](https://github.com/245070002yjq/midterm_project/blob/main/processing/pingjia.py): `processing/pingjia.py`

### Results and figures

- [Integrated results](https://github.com/245070002yjq/midterm_project/blob/main/data/integrated/15%E6%96%B0%E4%B8%80%E7%BA%BF%E5%9F%8E%E5%B8%82_%E7%BB%93%E6%9E%9C.csv): `data/integrated/15新一线城市_结果.csv`
- [Access figures](https://github.com/245070002yjq/midterm_project/blob/main/visualization/figure_5.2.1_5.2.2_code.py): `visualization/figure_5.2.1_5.2.2_code.py`
- [Transit business figures](https://github.com/245070002yjq/midterm_project/blob/main/visualization/figure_5.2.3_5.2.4_code.py): `visualization/figure_5.2.3_5.2.4_code.py`
- [Suitability figures](https://github.com/245070002yjq/midterm_project/blob/main/visualization/figure_5.4.1._5.4.2.py): `visualization/figure_5.4.1._5.4.2.py`
- [Other visualizations](https://github.com/245070002yjq/midterm_project/blob/main/visualization/%E7%94%BB%E5%9B%BE.py): `visualization/画图.py`

### Other components

- **Researcher**
- **Amap services**
- **OSM roads**
- **Google Earth Engine**

## Connections

- Researcher → Amap POI crawler: initiates collection (evidence: `README.md`)
- Researcher → Commercial POI crawler: initiates collection (evidence: `README.md`)
- Researcher → OSM road fetch: initiates collection (evidence: `README.md`)
- Amap services → Amap POI crawler: supplies POIs (evidence: `README.md`)
- OSM roads → OSM road fetch: supplies roads (evidence: `README.md`)
- Google Earth Engine → NDVI computation: supplies imagery (evidence: `README.md`)
- Amap POI crawler → Destination selection: provides candidates (evidence: `README.md`)
- Commercial POI crawler → Data cleaning: provides POIs (evidence: `README.md`)
- OSM road fetch → OSM merge: provides road data (evidence: `README.md`)
- OSM merge → Walkway filtering: provides roads (evidence: `README.md`)
- Destination selection → Top-20 selection: selects destinations (evidence: `README.md`)
- Destination selection → Ningbo Suzhou prep: prepares city samples (evidence: `README.md`)
- Walkway filtering → Transit walk routing: provides walk network (evidence: `README.md`)
- Walkway filtering → Changsha routing: provides walk network (evidence: `README.md`)
- Walkway filtering → Ningbo Suzhou routing: provides walk network (evidence: `README.md`)
- Top-20 selection → Transit walk routing: provides destinations (evidence: `README.md`)
- Ningbo Suzhou prep → Ningbo Suzhou routing: prepares samples (evidence: `README.md`)
- Transit walk routing → Transport summary: produces distances (evidence: `README.md`)
- Changsha routing → Transport summary: produces distances (evidence: `README.md`)
- Ningbo Suzhou routing → Transport summary: produces distances (evidence: `README.md`)
- Data cleaning → Commercial metrics: supplies cleaned data (evidence: `README.md`)
- NDVI computation → Suitability evaluation: supplies NDVI (evidence: `README.md`)
- Commercial metrics → Suitability evaluation: supplies business metrics (evidence: `README.md`)
- Transport summary → Suitability evaluation: supplies access metrics (evidence: `README.md`)
- Suitability evaluation → Integrated results: forms evaluation data (evidence: `README.md`)
- Ningbo final data → Integrated results: prepares final data
- Processing evaluation → Integrated results: supports evaluation
- Integrated results → Metric summaries: provides metrics
- Transport summary → Access figures: provides access results
- Integrated results → Transit business figures: provides comparison data
- Integrated results → Suitability figures: provides suitability data
- Integrated results → Other visualizations: provides result data
