# daintiness-group/pythia architecture

> Architecture diagram of the GitHub repository daintiness-group/pythia, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/daintiness-group/pythia
- Repository: https://github.com/daintiness-group/pythia

## Overview

Pythia is a Java/Spark library for producing automated statistical profiles and reports from registered datasets. The documented workflow is to create a profiler, register a dataset and schema, optionally add labeling and dominance settings, choose analyses, compute the profile, and generate reports. The graph preserves the documented analysis capabilities and the principal data products. Relationships within unsampled analysis implementations are omitted; documented workflow links cite the README.

Main entry points: [`src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java) (Dataset Profiler), [`src/main/java/gr/uoi/cs/pythia/descriptivestatistics/DescriptiveStatisticsCalculator.java`](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/descriptivestatistics/DescriptiveStatisticsCalculator.java) (Descriptive Statistics), [`src/main/java/gr/uoi/cs/pythia/histogram/HistogramManager.java`](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/histogram/HistogramManager.java) (Histograms), [`src/main/java/gr/uoi/cs/pythia/report`](https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/report) (Report Generators)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_api["Profiler API"]
  node_profiler["Dataset Profiler"]
  node_controller["App Controller<br/>[AppController.java]"]
  node_reader["Dataset Readers"]
end

subgraph group_analysis["Profile Analyses"]
  node_types["Type Detection"]
  node_stats["Descriptive Statistics"]
  node_cardinality["Cardinalities"]
  node_histograms["Histograms"]
  node_correlations["Correlations"]
  node_decisiontrees["Decision Trees"]
  node_clustering["Clustering"]
  node_outliers["Outlier Detection"]
  node_regression["Regression"]
end

subgraph group_patterns["Patterns and Highlights"]
  node_labeling["Column Labeling<br/>[RuleSet.java]"]
  node_dominance["Dominance Patterns"]
  node_highlights["Story Highlights"]
end

subgraph group_outputs["Results and Reports"]
  node_profile["Dataset Profile"]
  node_column["Column Results<br/>[Column.java]"]
  node_reports["Report Generators"]
  node_writer["Dataset Writers"]
end

node_user(("Library User"))

node_user -->|"creates"| node_profiler
node_user -->|"registers dataset"| node_profiler
node_profiler -.->|"loads dataset"| node_reader
node_user -->|"sets labeling"| node_profiler
node_profiler -->|"computes labels"| node_labeling
node_user -->|"sets dominance"| node_profiler
node_user -->|"selects analyses"| node_profiler
node_profiler -->|"computes statistics"| node_stats
node_profiler -->|"computes histograms"| node_histograms
node_profiler -->|"computes correlations"| node_correlations
node_profiler -->|"computes trees"| node_decisiontrees
node_profiler -.->|"runs clustering"| node_clustering
node_profiler -.->|"runs detection"| node_outliers
node_profiler -.->|"runs regression"| node_regression
node_profiler -->|"identifies patterns"| node_dominance
node_profiler -->|"computes profile"| node_profile
node_stats -.->|"profiles columns"| node_column
node_histograms -->|"sets histograms"| node_column
node_highlights -.->|"stores highlights"| node_profile
node_profiler -->|"generates reports"| node_reports
node_reports -->|"returns findings"| node_user

click node_profiler "https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java"
click node_controller "https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/Appcontroller/AppController.java"
click node_reader "https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/reader"
click node_types "https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/datatypeIdentifier/ScoreCalculatorManager.java"
click node_stats "https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/descriptivestatistics/DescriptiveStatisticsCalculator.java"
click node_cardinality "https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/cardinalities"
click node_histograms "https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/histogram/HistogramManager.java"
click node_correlations "https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/correlations"
click node_decisiontrees "https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/decisiontree/DecisionTreeManager.java"
click node_clustering "https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/clustering"
click node_outliers "https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/outliers"
click node_regression "https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/regression"
click node_labeling "https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/labeling/RuleSet.java"
click node_dominance "https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/patterns/PatternManager.java"
click node_highlights "https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/highlights/HighlightsManagerV01.java"
click node_profile "https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/model/DatasetProfile.java"
click node_column "https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/model/Column.java"
click node_reports "https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/report"
click node_writer "https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/writer"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_profiler,node_controller,node_reader,node_user toneBlue
class node_types,node_stats,node_cardinality,node_histograms,node_correlations,node_decisiontrees,node_clustering,node_outliers,node_regression toneAmber
class node_labeling,node_dominance,node_highlights toneMint
class node_profile,node_column,node_reports,node_writer toneRose
```

## Components

### Profiler API

- [Dataset Profiler](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java): `src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`
- [App Controller](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/Appcontroller/AppController.java): `src/main/java/gr/uoi/cs/pythia/Appcontroller/AppController.java`
- [Dataset Readers](https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/reader): `src/main/java/gr/uoi/cs/pythia/reader`

### Profile Analyses

- [Type Detection](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/datatypeIdentifier/ScoreCalculatorManager.java): `src/main/java/gr/uoi/cs/pythia/datatypeIdentifier/ScoreCalculatorManager.java`
- [Descriptive Statistics](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/descriptivestatistics/DescriptiveStatisticsCalculator.java): `src/main/java/gr/uoi/cs/pythia/descriptivestatistics/DescriptiveStatisticsCalculator.java`
- [Cardinalities](https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/cardinalities): `src/main/java/gr/uoi/cs/pythia/cardinalities`
- [Histograms](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/histogram/HistogramManager.java): `src/main/java/gr/uoi/cs/pythia/histogram/HistogramManager.java`
- [Correlations](https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/correlations): `src/main/java/gr/uoi/cs/pythia/correlations`
- [Decision Trees](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/decisiontree/DecisionTreeManager.java): `src/main/java/gr/uoi/cs/pythia/decisiontree/DecisionTreeManager.java`
- [Clustering](https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/clustering): `src/main/java/gr/uoi/cs/pythia/clustering`
- [Outlier Detection](https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/outliers): `src/main/java/gr/uoi/cs/pythia/outliers`
- [Regression](https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/regression): `src/main/java/gr/uoi/cs/pythia/regression`

### Patterns and Highlights

- [Column Labeling](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/labeling/RuleSet.java): `src/main/java/gr/uoi/cs/pythia/labeling/RuleSet.java`
- [Dominance Patterns](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/patterns/PatternManager.java): `src/main/java/gr/uoi/cs/pythia/patterns/PatternManager.java`
- [Story Highlights](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/highlights/HighlightsManagerV01.java): `src/main/java/gr/uoi/cs/pythia/highlights/HighlightsManagerV01.java`

### Results and Reports

- [Dataset Profile](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/model/DatasetProfile.java): `src/main/java/gr/uoi/cs/pythia/model/DatasetProfile.java`
- [Column Results](https://github.com/daintiness-group/pythia/blob/master/src/main/java/gr/uoi/cs/pythia/model/Column.java): `src/main/java/gr/uoi/cs/pythia/model/Column.java`
- [Report Generators](https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/report): `src/main/java/gr/uoi/cs/pythia/report`
- [Dataset Writers](https://github.com/daintiness-group/pythia/tree/master/src/main/java/gr/uoi/cs/pythia/writer): `src/main/java/gr/uoi/cs/pythia/writer`

### Other components

- **Library User**

## Connections

- Library User → Dataset Profiler: creates
- Library User → Dataset Profiler: registers dataset
- Dataset Profiler → Dataset Readers: loads dataset (evidence: `src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`)
- Library User → Dataset Profiler: sets labeling
- Dataset Profiler → Column Labeling: computes labels (evidence: `src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`)
- Library User → Dataset Profiler: sets dominance
- Library User → Dataset Profiler: selects analyses
- Dataset Profiler → Descriptive Statistics: computes statistics
- Dataset Profiler → Histograms: computes histograms (evidence: `src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`)
- Dataset Profiler → Correlations: computes correlations (evidence: `src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`)
- Dataset Profiler → Decision Trees: computes trees (evidence: `src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`)
- Dataset Profiler → Clustering: runs clustering (evidence: `src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`)
- Dataset Profiler → Outlier Detection: runs detection (evidence: `src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`)
- Dataset Profiler → Regression: runs regression (evidence: `src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`)
- Dataset Profiler → Dominance Patterns: identifies patterns
- Dataset Profiler → Dataset Profile: computes profile (evidence: `src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`)
- Descriptive Statistics → Column Results: profiles columns (evidence: `src/main/java/gr/uoi/cs/pythia/descriptivestatistics/DescriptiveStatisticsCalculator.java`)
- Histograms → Column Results: sets histograms (evidence: `src/main/java/gr/uoi/cs/pythia/histogram/HistogramManager.java`)
- Story Highlights → Dataset Profile: stores highlights (evidence: `src/main/java/gr/uoi/cs/pythia/highlights/HighlightsManagerV01.java`)
- Dataset Profiler → Report Generators: generates reports (evidence: `src/main/java/gr/uoi/cs/pythia/engine/DatasetProfiler.java`)
- Report Generators → Library User: returns findings
