How comeanotherday4/mutil_agent_path_planning works
This research project compares reinforcement-learning methods for resource-constrained desert route planning across three scenarios. Users run a scenario script to simulate travel, resource purchases and mining under weather and deadline constraints, then inspect learned or optimized routes and outcomes. Scenario 1 compares dynamic programming with Q-learning for known weather; scenario 2 evaluates Q-learning under four initial resource mixes; scenario 3 compares fixed-policy-plus-PPO, IPPO and MAPPO in a three-agent setting. The source excerpts are partial, so links between unsampled implementations are omitted; the DP capability is documented in the README.
Main entry points: q2.py Unknown-weather environment · q3_fix.py Three-player environment · q3_mappo.py Three-player environment · q1.py Known-weather environment
Components 19
Single-agent scenarios
- Known-weather environment
code/q1.py - DP and Q-learning
code/q1.py - Route comparison
code/q1.py - Unknown-weather environment
code/q2.py - Initial-buy strategies
code/q2.py - Strategy outcomes
code/q2.py
Multi-agent scenario
- Three-player environment
code/q3_fix.py - Fixed player policies
code/q3_fix.py - Fixed-plus-PPO results
code/q3_fix.py - Three-player environment
code/q3_ippo.py - IPPO results
code/q3_ippo.py - Three-player environment
code/q3_mappo.py - MAPPO results
code/q3_mappo.py
Learning components
- Q-learning agent
code/q2.py - Player-three PPO
code/q3_fix.py - Independent PPO agents
code/q3_ippo.py - Distributed actors
code/q3_mappo.py - Centralized critic
code/q3_mappo.py
Other components
- Researcher
Connections 20
- Researcher → Known-weather environment: runs scenario
- Known-weather environment → DP and Q-learning: provides transitions
- DP and Q-learning → Route comparison: compares routes
- Researcher → Unknown-weather environment: runs scenario
- Unknown-weather environment → Initial-buy strategies: evaluates purchases
- Unknown-weather environment → Q-learning agent: provides transitions
- Initial-buy strategies → Strategy outcomes: reports outcomes
- Q-learning agent → Strategy outcomes: learns policy
- Researcher → Three-player environment: runs scenario
- Three-player environment → Fixed player policies: uses policies
- Three-player environment → Player-three PPO: provides observations
- Player-three PPO → Fixed-plus-PPO results: trains policy
- Researcher → Three-player environment: runs scenario
- Three-player environment → Independent PPO agents: provides observations
- Independent PPO agents → IPPO results: trains agents
- Researcher → Three-player environment: runs scenario
- Three-player environment → Distributed actors: provides observations
- Three-player environment → Centralized critic: provides global state
- Distributed actors → MAPPO results: trains actors
- Centralized critic → MAPPO results: trains critic