# marinoslabrakis/sap-data-extractor-analytics-dashboard architecture

> Architecture diagram of the GitHub repository marinoslabrakis/sap-data-extractor-analytics-dashboard, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-07). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/marinoslabrakis/sap-data-extractor-analytics-dashboard
- Repository: https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard

## Overview

This is a SAP procure-to-pay extraction and analytics platform. Its main workflow fetches purchase orders and invoices from SAP, normalizes invoice data, persists records and an audit entry, then computes analytics for reports and the dashboard. Scheduled jobs trigger extraction and reporting; additional capabilities include anomaly detection and optional natural-language queries. The graph combines excerpted call relationships with capabilities and architecture explicitly documented in the README; unsampled implementations are represented only where their paths are listed in the tree.

Main entry points: [`src/services/extraction_service.py`](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/services/extraction_service.py) (Extraction service), [`src/services/reporting_service.py`](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/services/reporting_service.py) (Reporting service), [`src/core/container.py`](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/core/container.py) (DI container), [`src/services/analytics_service.py`](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/services/analytics_service.py) (Analytics service)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_integration["SAP Integration"]
  node_config["Settings<br/>[config.py]"]
  node_container["DI container<br/>[container.py]"]
  node_odata["OData client<br/>[odata_client.py]"]
  node_rfc["RFC client<br/>[rfc_client.py]"]
  node_mock["Mock SAP client<br/>[mock_client.py]"]
end

subgraph group_pipeline["Data Pipeline"]
  node_schemas["P2P DTOs"]
  node_extract["Extraction service"]
  node_normalize["Invoice normalization<br/>[normalize.py]"]
  node_po_repo["Purchase-order repository"]
  node_invoice_repo["Invoice repository<br/>[invoice_repo.py]"]
  node_audit_repo["Audit repository<br/>[audit_repo.py]"]
end

subgraph group_insights["Analytics &amp; AI"]
  node_analytics["Analytics service"]
  node_enrich["Data enrichment<br/>[enrich.py]"]
  node_anomaly["Anomaly detection<br/>[anomaly.py]"]
  node_nlq["Natural-language queries<br/>[nlq_assistant.py]"]
end

subgraph group_delivery["Reports &amp; Access"]
  node_dashboard["Analytics dashboard<br/>[app.py]"]
  node_reporting["Reporting service"]
  node_excel["Excel report<br/>[excel_report.py]"]
  node_pdf["PDF report<br/>[pdf_report.py]"]
  node_emailer["Report email<br/>[emailer.py]"]
  node_scheduler["Scheduled jobs<br/>[jobs.py]"]
  node_pipeline_cli["Pipeline command<br/>[run_pipeline.py]"]
end

node_finance(("Finance user"))
node_sap{{"SAP S/4HANA"}}
node_postgres[("PostgreSQL")]

node_container -->|"loads settings"| node_config
node_container -->|"selects client"| node_odata
node_container -->|"selects client"| node_rfc
node_container -->|"selects client"| node_mock
node_odata -->|"fetches via OData"| node_sap
node_rfc -->|"fetches via RFC"| node_sap
node_mock -->|"creates DTOs"| node_schemas
node_odata -->|"creates DTOs"| node_schemas
node_rfc -->|"creates DTOs"| node_schemas
node_extract -->|"builds clients"| node_container
node_extract -->|"normalizes invoices"| node_normalize
node_extract -->|"upserts orders"| node_po_repo
node_extract -->|"upserts invoices"| node_invoice_repo
node_extract -->|"records run"| node_audit_repo
node_po_repo -->|"writes orders"| node_postgres
node_invoice_repo -->|"writes invoices"| node_postgres
node_audit_repo -->|"writes audit log"| node_postgres
node_analytics -->|"uses enrichment"| node_enrich
node_dashboard -->|"requests KPIs"| node_analytics
node_dashboard -->|"uses detection"| node_anomaly
node_reporting -->|"gets metrics"| node_analytics
node_reporting -->|"builds workbook"| node_excel
node_reporting -->|"builds PDF"| node_pdf
node_reporting -->|"sends attachments"| node_emailer
node_scheduler -->|"runs pipeline"| node_extract
node_scheduler -->|"runs reports"| node_reporting
node_pipeline_cli -->|"runs pipeline"| node_extract
node_pipeline_cli -->|"runs reports"| node_reporting
node_finance -.->|"views analytics"| node_dashboard
node_nlq -.->|"queries data"| node_analytics

click node_config "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/core/config.py"
click node_container "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/core/container.py"
click node_odata "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/extractors/odata_client.py"
click node_rfc "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/extractors/rfc_client.py"
click node_mock "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/extractors/mock_client.py"
click node_schemas "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/tree/main/src/schemas"
click node_extract "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/services/extraction_service.py"
click node_normalize "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/transformers/normalize.py"
click node_po_repo "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/repositories/purchase_order_repo.py"
click node_invoice_repo "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/repositories/invoice_repo.py"
click node_audit_repo "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/repositories/audit_repo.py"
click node_analytics "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/services/analytics_service.py"
click node_enrich "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/transformers/enrich.py"
click node_anomaly "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/ai/anomaly.py"
click node_nlq "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/ai/nlq_assistant.py"
click node_dashboard "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/dashboard/app.py"
click node_reporting "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/services/reporting_service.py"
click node_excel "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/reports/excel_report.py"
click node_pdf "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/reports/pdf_report.py"
click node_emailer "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/reports/emailer.py"
click node_scheduler "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/scheduler/jobs.py"
click node_pipeline_cli "https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/scripts/run_pipeline.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_config,node_container,node_odata,node_rfc,node_mock,node_finance toneBlue
class node_schemas,node_extract,node_normalize,node_po_repo,node_invoice_repo,node_audit_repo,node_postgres toneAmber
class node_analytics,node_enrich,node_anomaly,node_nlq toneMint
class node_dashboard,node_reporting,node_excel,node_pdf,node_emailer,node_scheduler,node_pipeline_cli toneRose
class node_sap toneIndigo
```

## Components

### SAP Integration

- [Settings](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/core/config.py): `src/core/config.py`
- [DI container](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/core/container.py): `src/core/container.py`
- [OData client](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/extractors/odata_client.py): `src/extractors/odata_client.py`
- [RFC client](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/extractors/rfc_client.py): `src/extractors/rfc_client.py`
- [Mock SAP client](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/extractors/mock_client.py): `src/extractors/mock_client.py`

### Data Pipeline

- [P2P DTOs](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/tree/main/src/schemas): `src/schemas`
- [Extraction service](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/services/extraction_service.py): `src/services/extraction_service.py`
- [Invoice normalization](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/transformers/normalize.py): `src/transformers/normalize.py`
- [Purchase-order repository](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/repositories/purchase_order_repo.py): `src/repositories/purchase_order_repo.py`
- [Invoice repository](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/repositories/invoice_repo.py): `src/repositories/invoice_repo.py`
- [Audit repository](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/repositories/audit_repo.py): `src/repositories/audit_repo.py`

### Analytics & AI

- [Analytics service](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/services/analytics_service.py): `src/services/analytics_service.py`
- [Data enrichment](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/transformers/enrich.py): `src/transformers/enrich.py`
- [Anomaly detection](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/ai/anomaly.py): `src/ai/anomaly.py`
- [Natural-language queries](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/ai/nlq_assistant.py): `src/ai/nlq_assistant.py`

### Reports & Access

- [Analytics dashboard](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/dashboard/app.py): `src/dashboard/app.py`
- [Reporting service](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/services/reporting_service.py): `src/services/reporting_service.py`
- [Excel report](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/reports/excel_report.py): `src/reports/excel_report.py`
- [PDF report](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/reports/pdf_report.py): `src/reports/pdf_report.py`
- [Report email](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/reports/emailer.py): `src/reports/emailer.py`
- [Scheduled jobs](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/src/scheduler/jobs.py): `src/scheduler/jobs.py`
- [Pipeline command](https://github.com/marinoslabrakis/sap-data-extractor-analytics-dashboard/blob/main/scripts/run_pipeline.py): `scripts/run_pipeline.py`

### Other components

- **Finance user**
- **SAP S/4HANA**
- **PostgreSQL**

## Connections

- DI container → Settings: loads settings (evidence: `src/core/container.py`)
- DI container → OData client: selects client (evidence: `src/core/container.py`)
- DI container → RFC client: selects client (evidence: `src/core/container.py`)
- DI container → Mock SAP client: selects client (evidence: `src/core/container.py`)
- OData client → SAP S/4HANA: fetches via OData (evidence: `README.md`)
- RFC client → SAP S/4HANA: fetches via RFC (evidence: `README.md`)
- Mock SAP client → P2P DTOs: creates DTOs (evidence: `src/extractors/mock_client.py`)
- OData client → P2P DTOs: creates DTOs (evidence: `src/extractors/odata_client.py`)
- RFC client → P2P DTOs: creates DTOs (evidence: `src/extractors/rfc_client.py`)
- Extraction service → DI container: builds clients (evidence: `src/services/extraction_service.py`)
- Extraction service → Invoice normalization: normalizes invoices (evidence: `src/services/extraction_service.py`)
- Extraction service → Purchase-order repository: upserts orders (evidence: `src/services/extraction_service.py`)
- Extraction service → Invoice repository: upserts invoices (evidence: `src/services/extraction_service.py`)
- Extraction service → Audit repository: records run (evidence: `src/services/extraction_service.py`)
- Purchase-order repository → PostgreSQL: writes orders (evidence: `README.md`)
- Invoice repository → PostgreSQL: writes invoices (evidence: `README.md`)
- Audit repository → PostgreSQL: writes audit log (evidence: `README.md`)
- Analytics service → Data enrichment: uses enrichment (evidence: `src/services/analytics_service.py`)
- Analytics dashboard → Analytics service: requests KPIs (evidence: `src/dashboard/app.py`)
- Analytics dashboard → Anomaly detection: uses detection (evidence: `src/dashboard/app.py`)
- Reporting service → Analytics service: gets metrics (evidence: `src/services/reporting_service.py`)
- Reporting service → Excel report: builds workbook (evidence: `src/services/reporting_service.py`)
- Reporting service → PDF report: builds PDF (evidence: `src/services/reporting_service.py`)
- Reporting service → Report email: sends attachments (evidence: `src/services/reporting_service.py`)
- Scheduled jobs → Extraction service: runs pipeline (evidence: `src/scheduler/jobs.py`)
- Scheduled jobs → Reporting service: runs reports (evidence: `src/scheduler/jobs.py`)
- Pipeline command → Extraction service: runs pipeline (evidence: `scripts/run_pipeline.py`)
- Pipeline command → Reporting service: runs reports (evidence: `scripts/run_pipeline.py`)
- Finance user → Analytics dashboard: views analytics (evidence: `README.md`)
- Natural-language queries → Analytics service: queries data
