# gamzetuncay/dynamicpricingwithreinforcementlearning architecture

> Architecture diagram of the GitHub repository gamzetuncay/dynamicpricingwithreinforcementlearning, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-01). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/gamzetuncay/dynamicpricingwithreinforcementlearning
- Repository: https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning

## Overview

This repository is a research implementation of reinforcement-learning-based dynamic hotel pricing. The documented workflow models pricing as an MDP, uses Q-learning and a reward balancing profit with demand, and uses digitized hotel features to support estimates for newly added hotels. The notebooks indicate preprocessing, model experiments, and result analysis; the README does not map those stages to specific notebooks, and no source excerpts were provided, so edges show only documented relationships.

Main entry points: [`Dynamic_Pricing_3acts_modular.ipynb`](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb) (Pricing experiments), [`Q_table.ipynb`](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Q_table.ipynb) (Q-learning), [`Preprocessing.ipynb`](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Preprocessing.ipynb) (Data preprocessing), [`Dynamic_Pricing_3acts_modular_train - validation100.ipynb`](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular_train%20-%20validation100.ipynb) (Training validation)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_model["Pricing model"]
  node_pricing_mdp["Pricing MDP"]
  node_reward["Profit-demand reward"]
  node_q_learning["Q-learning<br/>[Q_table.ipynb]"]
end

subgraph group_features["Hotel similarity"]
  node_hotel_features["Hotel features"]
  node_similarity["Hotel similarity"]
  node_cold_start["New hotel estimates"]
end

subgraph group_experiments["Experiments and analysis"]
  node_preprocessing["Data preprocessing"]
  node_dynamic_pricing["Pricing experiments"]
  node_validation["Training validation"]
  node_hotel_experiments["Hotel experiments"]
  node_week_experiments["Week experiments"]
  node_results_analysis["Results analysis<br/>[Figures.ipynb]"]
end

node_researcher(("Researcher"))
node_hotel_data["Hotel sales data"]

node_researcher -->|"runs experiments"| node_dynamic_pricing
node_hotel_data -->|"provides records"| node_preprocessing
node_hotel_features -->|"supports comparisons"| node_similarity
node_similarity -->|"enables estimates"| node_cold_start
node_pricing_mdp -->|"solved with"| node_q_learning
node_reward -->|"guides learning"| node_q_learning
node_hotel_data -->|"evaluates predictions"| node_dynamic_pricing
node_dynamic_pricing -.->|"evaluated by"| node_validation
node_dynamic_pricing -.->|"varied by hotel"| node_hotel_experiments
node_dynamic_pricing -.->|"varied by week"| node_week_experiments
node_dynamic_pricing -.->|"results analyzed"| node_results_analysis

click node_preprocessing "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Preprocessing.ipynb"
click node_hotel_features "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb"
click node_similarity "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb"
click node_cold_start "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb"
click node_pricing_mdp "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb"
click node_reward "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb"
click node_q_learning "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Q_table.ipynb"
click node_dynamic_pricing "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb"
click node_validation "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular_train%20-%20validation100.ipynb"
click node_hotel_experiments "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular_noncurriculum_byhotels.ipynb"
click node_week_experiments "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular_noncurriculum_byweeks.ipynb"
click node_results_analysis "https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Figures.ipynb"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_pricing_mdp,node_reward,node_q_learning toneBlue
class node_hotel_features,node_similarity,node_cold_start toneAmber
class node_preprocessing,node_dynamic_pricing,node_validation,node_hotel_experiments,node_week_experiments,node_results_analysis toneMint
class node_researcher,node_hotel_data toneIndigo
```

## Components

### Pricing model

- [Pricing MDP](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb): `Dynamic_Pricing_3acts_modular.ipynb`
- [Profit-demand reward](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb): `Dynamic_Pricing_3acts_modular.ipynb`
- [Q-learning](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Q_table.ipynb): `Q_table.ipynb`

### Hotel similarity

- [Hotel features](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb): `Dynamic_Pricing_3acts_modular.ipynb`
- [Hotel similarity](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb): `Dynamic_Pricing_3acts_modular.ipynb`
- [New hotel estimates](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb): `Dynamic_Pricing_3acts_modular.ipynb`

### Experiments and analysis

- [Data preprocessing](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Preprocessing.ipynb): `Preprocessing.ipynb`
- [Pricing experiments](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular.ipynb): `Dynamic_Pricing_3acts_modular.ipynb`
- [Training validation](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular_train%20-%20validation100.ipynb): `Dynamic_Pricing_3acts_modular_train - validation100.ipynb`
- [Hotel experiments](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular_noncurriculum_byhotels.ipynb): `Dynamic_Pricing_3acts_modular_noncurriculum_byhotels.ipynb`
- [Week experiments](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Dynamic_Pricing_3acts_modular_noncurriculum_byweeks.ipynb): `Dynamic_Pricing_3acts_modular_noncurriculum_byweeks.ipynb`
- [Results analysis](https://github.com/gamzetuncay/dynamicpricingwithreinforcementlearning/blob/main/Figures.ipynb): `Figures.ipynb`

### Other components

- **Researcher**
- **Hotel sales data**

## Connections

- Researcher → Pricing experiments: runs experiments (evidence: `README.md`)
- Hotel sales data → Data preprocessing: provides records (evidence: `README.md`)
- Hotel features → Hotel similarity: supports comparisons (evidence: `README.md`)
- Hotel similarity → New hotel estimates: enables estimates (evidence: `README.md`)
- Pricing MDP → Q-learning: solved with (evidence: `README.md`)
- Profit-demand reward → Q-learning: guides learning (evidence: `README.md`)
- Hotel sales data → Pricing experiments: evaluates predictions (evidence: `README.md`)
- Pricing experiments → Training validation: evaluated by
- Pricing experiments → Hotel experiments: varied by hotel
- Pricing experiments → Week experiments: varied by week
- Pricing experiments → Results analysis: results analyzed
