# palliplease/web-crawler-for-protein-powder architecture

> Architecture diagram of the GitHub repository palliplease/web-crawler-for-protein-powder, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-09-29). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/palliplease/web-crawler-for-protein-powder
- Repository: https://github.com/palliplease/web-crawler-for-protein-powder

## Overview

This is a small, notebook-based product crawler for Avvatar India and MuscleBlaze. The documented workflow visits site links, scrapes product information, and stores it in a pandas DataFrame. The README and file tree support the brand-specific notebook paths and this workflow; notebook internals were not available to verify further details.

Main entry points: [`WebCrawler_for_Avvatar.ipynb`](https://github.com/palliplease/web-crawler-for-protein-powder/blob/main/WebCrawler_for_Avvatar.ipynb) (Avvatar crawler), [`WebCrawler_for_MuscleBlaze.ipynb`](https://github.com/palliplease/web-crawler-for-protein-powder/blob/main/WebCrawler_for_MuscleBlaze.ipynb) (MuscleBlaze crawler)

## Diagram (Mermaid)

```mermaid
flowchart TD

node_avvatar(("Avvatar India"))
node_avvatar_crawler["Avvatar crawler"]
node_muscleblaze(("MuscleBlaze"))
node_muscleblaze_crawler["MuscleBlaze crawler"]
node_product_data["Product DataFrame"]

node_avvatar_crawler -->|"visits and scrapes"| node_avvatar
node_avvatar_crawler -->|"stores product data"| node_product_data
node_muscleblaze_crawler -->|"visits and scrapes"| node_muscleblaze
node_muscleblaze_crawler -->|"stores product data"| node_product_data

click node_avvatar_crawler "https://github.com/palliplease/web-crawler-for-protein-powder/blob/main/WebCrawler_for_Avvatar.ipynb"
click node_muscleblaze_crawler "https://github.com/palliplease/web-crawler-for-protein-powder/blob/main/WebCrawler_for_MuscleBlaze.ipynb"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_avvatar,node_muscleblaze,node_product_data toneIndigo
class node_avvatar_crawler,node_muscleblaze_crawler toneTeal
```

## Components

### Other components

- **Avvatar India**
- [Avvatar crawler](https://github.com/palliplease/web-crawler-for-protein-powder/blob/main/WebCrawler_for_Avvatar.ipynb): `WebCrawler_for_Avvatar.ipynb`
- **MuscleBlaze**
- [MuscleBlaze crawler](https://github.com/palliplease/web-crawler-for-protein-powder/blob/main/WebCrawler_for_MuscleBlaze.ipynb): `WebCrawler_for_MuscleBlaze.ipynb`
- **Product DataFrame**

## Connections

- Avvatar crawler → Avvatar India: visits and scrapes
- Avvatar crawler → Product DataFrame: stores product data
- MuscleBlaze crawler → MuscleBlaze: visits and scrapes
- MuscleBlaze crawler → Product DataFrame: stores product data