# iamvishwa01/bulkfilevalidator architecture

> Architecture diagram of the GitHub repository iamvishwa01/bulkfilevalidator, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-22). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/iamvishwa01/bulkfilevalidator
- Repository: https://github.com/iamvishwa01/bulkfilevalidator

## Overview

Bulk File Validator compares an actual CSV/XLSX dataset with an expected file or MySQL query result, pairing rows by key and producing XLSX and HTML reports. Its documented workflow streams and normalizes rows, externally sorts bounded chunks, merges by key, then checks headers, keys, and column values under optional JSON rules. The graph follows README-documented relationships; source excerpts were unavailable, so internal implementation details beyond that documentation are not inferred.

Main entry points: [`src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java`](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java) (Bulk file comparator), [`src/test/java/execution/DatabaseTest.java`](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/test/java/execution/DatabaseTest.java) (Database entry point), [`src/main/java/com/test/qa/utils/excel/comparision/ValidationProfile.java`](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/ValidationProfile.java) (Validation profile), [`src/main/java/com/test/qa/utils/excel/comparision/JdbcQueryConfig.java`](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/JdbcQueryConfig.java) (JDBC query settings)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_entry["Runnable entry points"]
  node_file_entry["File entry point<br/>[Test.java]"]
  node_db_entry["Database entry point<br/>[DatabaseTest.java]"]
  node_profile_entry["Profile-based entry point"]
end

subgraph group_ingest["Input and comparison"]
  node_comparator["Bulk file comparator"]
  node_stream["Stream and normalize"]
  node_external_sort["Bounded chunk sorting"]
  node_key_merge["Key-based merge"]
  node_value_check["Header and value checks"]
  node_jdbc_config["JDBC query settings"]
end

subgraph group_rules["Validation rules"]
  node_profile["Validation profile"]
  node_rule_loader["JSON profile loader"]
  node_column_rule["Column rules<br/>[ColumnRule.java]"]
  node_value_comparator["Rule-based value comparison"]
end

subgraph group_reports["Reports"]
  node_xlsx_report["Excel report"]
  node_html_report["HTML report"]
end

node_actual_data["Actual CSV/XLSX"]
node_expected_file["Expected CSV/XLSX"]
node_sql_config["Expected SQL"]
node_mysql[("MySQL query result")]

node_file_entry -->|"compares files"| node_comparator
node_db_entry -->|"runs database mode"| node_comparator
node_profile_entry -->|"runs comparison"| node_comparator
node_actual_data -->|"streams rows"| node_stream
node_expected_file -->|"streams rows"| node_stream
node_mysql -->|"streams query rows"| node_stream
node_sql_config -->|"supplies query"| node_db_entry
node_db_entry -->|"configures query"| node_jdbc_config
node_jdbc_config -->|"connects to"| node_mysql
node_comparator -->|"coordinates"| node_stream
node_stream -->|"sorts bounded chunks"| node_external_sort
node_external_sort -->|"merges sorted rows"| node_key_merge
node_key_merge -->|"compares by key"| node_value_check
node_rule_loader -->|"loads and validates"| node_profile
node_profile -->|"provides comparison rules"| node_value_check
node_column_rule -->|"defines column settings"| node_profile
node_value_check -->|"applies rules"| node_value_comparator
node_comparator -->|"writes workbook"| node_xlsx_report
node_comparator -->|"writes report"| node_html_report

click node_file_entry "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/test/java/execution/Test.java"
click node_db_entry "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/test/java/execution/DatabaseTest.java"
click node_profile_entry "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/ProfileBasedTest.java"
click node_comparator "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java"
click node_stream "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java"
click node_external_sort "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java"
click node_key_merge "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java"
click node_value_check "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java"
click node_profile "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/ValidationProfile.java"
click node_rule_loader "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/RuleConfigLoader.java"
click node_column_rule "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/ColumnRule.java"
click node_value_comparator "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/RuleBasedValueComparator.java"
click node_xlsx_report "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java"
click node_html_report "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java"
click node_jdbc_config "https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/JdbcQueryConfig.java"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_file_entry,node_db_entry,node_profile_entry toneBlue
class node_comparator,node_stream,node_external_sort,node_key_merge,node_value_check,node_jdbc_config,node_mysql toneAmber
class node_profile,node_rule_loader,node_column_rule,node_value_comparator toneMint
class node_xlsx_report,node_html_report toneRose
class node_actual_data,node_expected_file,node_sql_config toneIndigo
```

## Components

### Runnable entry points

- [File entry point](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/test/java/execution/Test.java): `src/test/java/execution/Test.java`
- [Database entry point](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/test/java/execution/DatabaseTest.java): `src/test/java/execution/DatabaseTest.java`
- [Profile-based entry point](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/ProfileBasedTest.java): `src/main/java/com/test/qa/utils/excel/comparision/ProfileBasedTest.java`

### Input and comparison

- [Bulk file comparator](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java): `src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java`
- [Stream and normalize](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java): `src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java`
- [Bounded chunk sorting](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java): `src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java`
- [Key-based merge](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java): `src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java`
- [Header and value checks](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java): `src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java`
- [JDBC query settings](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/JdbcQueryConfig.java): `src/main/java/com/test/qa/utils/excel/comparision/JdbcQueryConfig.java`

### Validation rules

- [Validation profile](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/ValidationProfile.java): `src/main/java/com/test/qa/utils/excel/comparision/ValidationProfile.java`
- [JSON profile loader](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/RuleConfigLoader.java): `src/main/java/com/test/qa/utils/excel/comparision/RuleConfigLoader.java`
- [Column rules](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/ColumnRule.java): `src/main/java/com/test/qa/utils/excel/comparision/ColumnRule.java`
- [Rule-based value comparison](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/RuleBasedValueComparator.java): `src/main/java/com/test/qa/utils/excel/comparision/RuleBasedValueComparator.java`

### Reports

- [Excel report](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java): `src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java`
- [HTML report](https://github.com/iamvishwa01/bulkfilevalidator/blob/master/src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java): `src/main/java/com/test/qa/utils/excel/comparision/BulkFileComparator.java`

### Other components

- **Actual CSV/XLSX**
- **Expected CSV/XLSX**
- **Expected SQL**
- **MySQL query result**

## Connections

- File entry point → Bulk file comparator: compares files (evidence: `README.md`)
- Database entry point → Bulk file comparator: runs database mode (evidence: `README.md`)
- Profile-based entry point → Bulk file comparator: runs comparison (evidence: `README.md`)
- Actual CSV/XLSX → Stream and normalize: streams rows (evidence: `README.md`)
- Expected CSV/XLSX → Stream and normalize: streams rows (evidence: `README.md`)
- MySQL query result → Stream and normalize: streams query rows (evidence: `README.md`)
- Expected SQL → Database entry point: supplies query (evidence: `README.md`)
- Database entry point → JDBC query settings: configures query (evidence: `README.md`)
- JDBC query settings → MySQL query result: connects to (evidence: `README.md`)
- Bulk file comparator → Stream and normalize: coordinates (evidence: `README.md`)
- Stream and normalize → Bounded chunk sorting: sorts bounded chunks (evidence: `README.md`)
- Bounded chunk sorting → Key-based merge: merges sorted rows (evidence: `README.md`)
- Key-based merge → Header and value checks: compares by key (evidence: `README.md`)
- JSON profile loader → Validation profile: loads and validates (evidence: `README.md`)
- Validation profile → Header and value checks: provides comparison rules (evidence: `README.md`)
- Column rules → Validation profile: defines column settings (evidence: `README.md`)
- Header and value checks → Rule-based value comparison: applies rules (evidence: `README.md`)
- Bulk file comparator → Excel report: writes workbook (evidence: `README.md`)
- Bulk file comparator → HTML report: writes report (evidence: `README.md`)
