# bryansycruz/taller_webscraping architecture

> Architecture diagram of the GitHub repository bryansycruz/taller_webscraping, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-05-04). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/bryansycruz/taller_webscraping
- Repository: https://github.com/bryansycruz/taller_webscraping

## Overview

##### Project type and purpose
- This is an educational Python “Web Scraping” workshop. Its goal is to demonstrate how to extract property data from ciencuadras.com using Selenium, manage dependencies with a virtual environment, and persist results in a CSV for further analysis or recommendation-engine prototyping.

##### File structure
- Top-level:
- Presentacion/Web.pdf: The slide deck describing the tutorial.
- README.md: High-level overview.
- Web_Scraping directory:
- web_scraping.ipynb: Jupyter Notebook with step-by-step scraping code.
- requirements.txt: Lists selenium, webdriver-manager, pandas.
- datos_extraidos.csv: Sample output data.
- venv/: Isolated Python environment.
- Imagenes/: Screenshots or assets for the notebook.
- README.md: Domain-specific instructions.

##### README for additional insights
- Confirms use of Selenium + WebDriver-Manager to drive a real browser session.
- Uses pandas for data manipulation and export.
- Target system: ciencuadras.com.

## Diagram (Mermaid)

```mermaid
flowchart TD
  %% Developer Environment
  subgraph "Developer Environment"
    venv["venv\n(isolated Python interpreter)"]:::internal
    notebook["web_scraping.ipynb\n(Jupyter Notebook Interface)"]:::internal
    req["requirements.txt\n(Dependency Specification)"]:::internal
    assets["Imagenes/\n(Notebook Assets)"]:::internal
    instructions["README.md\n(Domain-specific Workshop Instructions)"]:::internal
  end

  %% Project Overview
  subgraph "Project Overview"
    overview["README.md\n(High-level Project Overview)"]:::internal
    slides["Web.pdf\n(Presentation Slide Deck)"]:::internal
  end

  %% Scraper Workflow
  subgraph "Scraper Workflow"
    notebook -->|Runs in| venv
    notebook -->|Reads| req
    notebook -->|Imports| webdriver_mgr["WebDriver Manager"]:::internal
    webdriver_mgr -->|Manages| driver["Browser Driver\n(ChromeDriver/GeckoDriver)"]:::external
    notebook -->|Uses| selenium["Selenium WebDriver"]:::internal
    selenium -->|Controls| driver
    driver -->|Fetches pages| website["Ciencuadras.com"]:::external
    website -->|Returns HTML| selenium
    notebook -->|Parses HTML with| pandas["pandas"]:::internal
    pandas -->|Writes data to| csv["datos_extraidos.csv"]:::datastore
  end

  %% Downstream Analytics
  subgraph "Downstream Analytics (Optional)"
    analytics["Analytics / Recommendation Engine"]:::internal
    analytics -->|Reads| csv
  end

  %% Click Events
  click venv "https://github.com/bryansycruz/taller_webscraping/tree/main/Web_Scraping/venv"
  click notebook "https://github.com/bryansycruz/taller_webscraping/blob/main/Web_Scraping/web_scraping.ipynb"
  click req "https://github.com/bryansycruz/taller_webscraping/blob/main/Web_Scraping/requirements.txt"
  click csv "https://github.com/bryansycruz/taller_webscraping/blob/main/Web_Scraping/datos_extraidos.csv"
  click assets "https://github.com/bryansycruz/taller_webscraping/tree/main/Web_Scraping/Imagenes"
  click instructions "https://github.com/bryansycruz/taller_webscraping/blob/main/Web_Scraping/README.md"
  click overview "https://github.com/bryansycruz/taller_webscraping/blob/main/README.md"
  click slides "https://github.com/bryansycruz/taller_webscraping/blob/main/Presentacion/Web.pdf"

  %% Styles
  classDef internal fill:#d4f4dd,stroke:#2d6a4f,color:#1b4332
  classDef external fill:#ddeaf6,stroke:#1a5f7a,color:#153e5f
  classDef datastore fill:#fef3c7,stroke:#b38f00,color:#664d03
```
