# m-abdelrazek/dataextractionpdf architecture

> Architecture diagram of the GitHub repository m-abdelrazek/dataextractionpdf, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-22). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/m-abdelrazek/dataextractionpdf
- Repository: https://github.com/m-abdelrazek/dataextractionpdf

## Overview

PTS to SLD Data Extractor is a Windows desktop application that turns a transformer-substation PDF into an evidence-backed, populated Excel template, with optional Groq-assisted extraction and GIS CAD drafting. The main workflow runs from GUI input through PDF sectioning, evidence retrieval and extraction, then writes workbook and audit outputs. A separate optional branch converts extraction results into a reviewable bay plan and an unconnected AutoCAD draft. The graph follows the README and shown excerpts; unsampled subsystem links are included only where documentation or the source index supports them.

Main entry points: [`core/pipeline.py`](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/pipeline.py) (Extraction pipeline), [`gui/main_window.py`](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/gui/main_window.py) (Extraction GUI), [`cad/gis_planner.py`](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/cad/gis_planner.py) (GIS plan builder), [`core/markdown_sections.py`](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/markdown_sections.py) (Markdown sectionizer)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_interface["Desktop interface"]
  node_gui["Extraction GUI<br/>[main_window.py]"]
  node_settings["Settings panel<br/>[settings_panel.py]"]
  node_validation["PDF validation<br/>[file_handler.py]"]
end

subgraph group_extract["PDF extraction"]
  node_pipeline["Extraction pipeline<br/>[pipeline.py]"]
  node_sectionizer["Markdown sectionizer"]
  node_pdf["PDF processor<br/>[pdf_processor.py]"]
  node_retrieval["PDF index and retrieval"]
  node_contract["Template contract"]
  node_remote["Remote-end discovery<br/>[remote_ends.py]"]
  node_groq["Groq extraction<br/>[groq_extractor.py]"]
  node_outputs["Extraction outputs<br/>[pipeline.py]"]
end

subgraph group_gis["GIS planning"]
  node_planner["GIS plan builder<br/>[gis_planner.py]"]
  node_layout["Bay layout<br/>[bay_layout.py]"]
  node_geometry["Placement geometry<br/>[geometry.py]"]
end

subgraph group_cad["CAD drafting"]
  node_autocad["AutoCAD backend<br/>[autocad_backend.py]"]
end

node_engineer(("Engineer"))
node_groq_service{{"Groq Cloud"}}
node_autocad_service{{"AutoCAD"}}

node_engineer -->|"selects inputs"| node_gui
node_gui -->|"validates PDF"| node_validation
node_gui -->|"opens settings"| node_settings
node_gui -->|"starts extraction"| node_pipeline
node_pipeline -->|"converts PDF"| node_sectionizer
node_sectionizer -->|"extracts pages"| node_pdf
node_pipeline -->|"discovers ends"| node_remote
node_pipeline -->|"retrieves evidence"| node_retrieval
node_pipeline -->|"extracts batches"| node_groq
node_groq -->|"requests extraction"| node_groq_service
node_pipeline -->|"uses template rules"| node_contract
node_pipeline -->|"writes results"| node_outputs
node_outputs -->|"supplies extraction results"| node_planner
node_planner -->|"builds bay schedule"| node_layout
node_layout -->|"creates placements"| node_geometry
node_planner -->|"uses geometry"| node_geometry
node_gui -->|"requests CAD plan"| node_planner
node_gui -->|"assembles draft"| node_autocad
node_autocad -->|"inserts and saves"| node_autocad_service

click node_gui "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/gui/main_window.py"
click node_settings "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/gui/settings_panel.py"
click node_validation "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/utils/file_handler.py"
click node_pipeline "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/pipeline.py"
click node_sectionizer "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/markdown_sections.py"
click node_pdf "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/pdf_processor.py"
click node_retrieval "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/sld_template_extractor.py"
click node_contract "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/template_contract.py"
click node_remote "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/remote_ends.py"
click node_groq "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/groq_extractor.py"
click node_outputs "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/pipeline.py"
click node_planner "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/cad/gis_planner.py"
click node_layout "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/cad/bay_layout.py"
click node_geometry "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/cad/geometry.py"
click node_autocad "https://github.com/m-abdelrazek/dataextractionpdf/blob/master/cad/autocad_backend.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_gui,node_settings,node_validation toneBlue
class node_pipeline,node_sectionizer,node_pdf,node_retrieval,node_contract,node_remote,node_groq,node_outputs toneAmber
class node_planner,node_layout,node_geometry toneMint
class node_autocad toneRose
class node_engineer,node_groq_service,node_autocad_service toneIndigo
```

## Components

### Desktop interface

- [Extraction GUI](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/gui/main_window.py): `gui/main_window.py`
- [Settings panel](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/gui/settings_panel.py): `gui/settings_panel.py`
- [PDF validation](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/utils/file_handler.py): `utils/file_handler.py`

### PDF extraction

- [Extraction pipeline](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/pipeline.py): `core/pipeline.py`
- [Markdown sectionizer](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/markdown_sections.py): `core/markdown_sections.py`
- [PDF processor](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/pdf_processor.py): `core/pdf_processor.py`
- [PDF index and retrieval](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/sld_template_extractor.py): `core/sld_template_extractor.py`
- [Template contract](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/template_contract.py): `core/template_contract.py`
- [Remote-end discovery](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/remote_ends.py): `core/remote_ends.py`
- [Groq extraction](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/groq_extractor.py): `core/groq_extractor.py`
- [Extraction outputs](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/core/pipeline.py): `core/pipeline.py`

### GIS planning

- [GIS plan builder](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/cad/gis_planner.py): `cad/gis_planner.py`
- [Bay layout](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/cad/bay_layout.py): `cad/bay_layout.py`
- [Placement geometry](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/cad/geometry.py): `cad/geometry.py`

### CAD drafting

- [AutoCAD backend](https://github.com/m-abdelrazek/dataextractionpdf/blob/master/cad/autocad_backend.py): `cad/autocad_backend.py`

### Other components

- **Engineer**
- **Groq Cloud**
- **AutoCAD**

## Connections

- Engineer → Extraction GUI: selects inputs (evidence: `README.md`)
- Extraction GUI → PDF validation: validates PDF (evidence: `gui/main_window.py`)
- Extraction GUI → Settings panel: opens settings (evidence: `gui/main_window.py`)
- Extraction GUI → Extraction pipeline: starts extraction (evidence: `gui/main_window.py`)
- Extraction pipeline → Markdown sectionizer: converts PDF (evidence: `core/pipeline.py`)
- Markdown sectionizer → PDF processor: extracts pages (evidence: `core/markdown_sections.py`)
- Extraction pipeline → Remote-end discovery: discovers ends (evidence: `core/pipeline.py`)
- Extraction pipeline → PDF index and retrieval: retrieves evidence (evidence: `core/pipeline.py`)
- Extraction pipeline → Groq extraction: extracts batches (evidence: `core/pipeline.py`)
- Groq extraction → Groq Cloud: requests extraction (evidence: `README.md`)
- Extraction pipeline → Template contract: uses template rules (evidence: `core/pipeline.py`)
- Extraction pipeline → Extraction outputs: writes results (evidence: `core/pipeline.py`)
- Extraction outputs → GIS plan builder: supplies extraction results (evidence: `README.md`)
- GIS plan builder → Bay layout: builds bay schedule (evidence: `cad/gis_planner.py`)
- Bay layout → Placement geometry: creates placements (evidence: `cad/bay_layout.py`)
- GIS plan builder → Placement geometry: uses geometry (evidence: `cad/gis_planner.py`)
- Extraction GUI → GIS plan builder: requests CAD plan (evidence: `gui/main_window.py`)
- Extraction GUI → AutoCAD backend: assembles draft (evidence: `gui/main_window.py`)
- AutoCAD backend → AutoCAD: inserts and saves (evidence: `cad/autocad_backend.py`)
