# firaold/customer-experience_for_fintech_apps architecture

> Architecture diagram of the GitHub repository firaold/customer-experience_for_fintech_apps, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-06-09). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/firaold/customer-experience_for_fintech_apps
- Repository: https://github.com/firaold/customer-experience_for_fintech_apps

## Overview

##### Project type and purpose
- This is a data-pipeline / ETL module for scraping user reviews from the Google Play Store and performing sequential preprocessing, sentiment analysis, and keyword extraction.
- Its primary goal is to generate four datasets in `data/`:
- raw_reviews.csv
- clean_reviews.csv
- sentiment_reviews.csv
- thematic_reviews.csv

##### Main components
a. External Data Source
– Google Play Store API (via `google-play-scraper` library)
b. Web Scraper Component
– `src/web_scrapper.py`
– Outputs: raw_reviews.csv
c. Preprocessor Component
– `src/pre_processor.py`
– Operations: drop duplicates, handle missing, normalize dates, remove stopwords
– Outputs: clean_reviews.csv
d. Sentiment Analysis Component
– `src/sentiment_analysis.py`
– Uses: `pandas`, `numpy` (and any sentiment model/library)
– Outputs: sentiment_reviews.csv
e. Keyword / Thematic Extraction Component
– `src/keyword_extractor.py`
– Outputs: thematic_reviews.csv
f. Data Storage
– Local file system under `data/` folder (CSV files)

##### Relationships and data flow
- Web Scraper → raw_reviews.csv (data store)
- raw_reviews.csv → Preprocessor → clean_reviews.csv
- clean_reviews.csv → Sentiment Analysis → sentiment_reviews.csv
- clean_reviews.csv → Keyword Extraction → thematic_reviews.csv

##### Architectural patterns & design principles
- Linear ETL pipeline (extract → transform → load)
- Modular scripts, each with single responsibility
- File-based staging between steps (loose coupling)
- Reproducibility via requirements.txt for environment

##### Essential technologies & libraries
- Python 3.8+
- google-play-scraper (data extraction)
- pandas, numpy (data manipulation)
- Optional: nltk/spacy for stopwords & keyword extraction
- Local CSV files as storage

## Diagram (Mermaid)

```mermaid
flowchart TD
    %% External Source
    GooglePlay[/Google Play Store API/]:::external

    %% ETL Pipeline
    GooglePlay -->|"scrape"| WebScraper
    WebScraper["Web Scraper"]:::process
    WebScraper -->|"raw_reviews.csv"| RawDataStore
    RawDataStore[(raw_reviews.csv)]:::datastore

    RawDataStore -->|"raw_reviews.csv"| Preprocessor
    Preprocessor["Preprocessor\n(drop duplicates, handle missing,\nnormalize dates, remove stopwords)"]:::process
    Preprocessor -->|"clean_reviews.csv"| CleanDataStore
    CleanDataStore[(clean_reviews.csv)]:::datastore

    CleanDataStore -->|"clean_reviews.csv"| SentimentAnalysis
    SentimentAnalysis["Sentiment Analysis"]:::process
    SentimentAnalysis -->|"sentiment_reviews.csv"| SentimentDataStore
    SentimentDataStore[(sentiment_reviews.csv)]:::datastore

    CleanDataStore -->|"clean_reviews.csv"| KeywordExtractor
    KeywordExtractor["Keyword / Thematic Extraction"]:::process
    KeywordExtractor -->|"thematic_reviews.csv"| ThematicDataStore
    ThematicDataStore[(thematic_reviews.csv)]:::datastore

    %% CI/CD and Testing
    subgraph "CI/CD & Testing"
        Requirements["requirements.txt"]:::ci
        Tests["Test Suite"]:::ci
    end
    Requirements --> WebScraper
    Requirements --> Preprocessor
    Requirements --> SentimentAnalysis
    Requirements --> KeywordExtractor
    Tests --> WebScraper
    Tests --> Preprocessor
    Tests --> SentimentAnalysis
    Tests --> KeywordExtractor

    %% Click Events
    click WebScraper "https://github.com/firaold/customer-experience_for_fintech_apps/blob/main/src/web_scrapper.py"
    click Preprocessor "https://github.com/firaold/customer-experience_for_fintech_apps/blob/main/src/pre_processor.py"
    click SentimentAnalysis "https://github.com/firaold/customer-experience_for_fintech_apps/blob/main/src/sentiment_analysis.py"
    click KeywordExtractor "https://github.com/firaold/customer-experience_for_fintech_apps/blob/main/src/keyword_extractor.py"
    click RawDataStore "https://github.com/firaold/customer-experience_for_fintech_apps/blob/main/data/raw_reviews.csv"
    click CleanDataStore "https://github.com/firaold/customer-experience_for_fintech_apps/blob/main/data/clean_reviews.csv"
    click SentimentDataStore "https://github.com/firaold/customer-experience_for_fintech_apps/blob/main/data/sentiment_reviews.csv"
    click ThematicDataStore "https://github.com/firaold/customer-experience_for_fintech_apps/blob/main/data/thematic_reviews.csv"
    click Requirements "https://github.com/firaold/customer-experience_for_fintech_apps/blob/main/requirements.txt"
    click Tests "https://github.com/firaold/customer-experience_for_fintech_apps/tree/main/test/"

    %% Styles
    classDef external fill:#FFA500,stroke:#333,stroke-width:1px,color:#fff
    classDef process fill:#28a745,stroke:#333,stroke-width:1px,color:#fff
    classDef datastore fill:#007BFF,stroke:#333,stroke-width:1px,color:#fff
    classDef ci fill:#6c757d,stroke:#333,stroke-width:1px,color:#fff
```
