# googlecloudplatform/enterprise-knowledge-solution architecture

> Architecture diagram of the GitHub repository googlecloudplatform/enterprise-knowledge-solution, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/googlecloudplatform/enterprise-knowledge-solution
- Repository: https://github.com/googlecloudplatform/enterprise-knowledge-solution

## Overview

EKS is a Google Cloud document-processing and knowledge-search solution. Its principal workflow takes documents from storage, orchestrates duplicate checks and classification, runs format-specific or Document AI processing, then imports processed documents for search and retrieval in the Web UI. The graph preserves registry, deletion, configuration, and search capabilities documented or represented in the tree. Some implementation details are unsampled; those connections are omitted rather than inferred from component names.

Main entry points: [`components/dpu-workflow/src/docs_processing_orchestrator.py`](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/dpu-workflow/src/docs_processing_orchestrator.py) (Workflow orchestrator), [`components/processing/libs/processor-msg/src/processors/msg/main_processor.py`](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/processing/libs/processor-msg/src/processors/msg/main_processor.py) (Office processors), [`components/dpu-workflow/src/utils/datastore_utils.py`](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/dpu-workflow/src/utils/datastore_utils.py) (Search data store), [`components/specialized-parser/src/runner.py`](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/specialized-parser/src/runner.py) (Specialized parser)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_workflow["Workflow and intake"]
  node_workflow["Workflow orchestrator"]
  node_classifier["Document classifier"]
end

subgraph group_processing["Processing and parsing"]
  node_office["Office processors<br/>[main_processor.py]"]
  node_xlsx["Spreadsheet processor<br/>[xlsx_processor.py]"]
  node_results["Result writer<br/>[result_writer.py]"]
  node_parser["Specialized parser<br/>[runner.py]"]
  node_converter["Format conversion<br/>[converter.py]"]
end

subgraph group_management["Document management"]
  node_registry[("Document registry")]
  node_deletion["Document deletion"]
end

subgraph group_search["Search and retrieval"]
  node_datastore[("Search data store<br/>[datastore_utils.py]")]
  node_webui["Knowledge interface<br/>[Home.py]"]
  node_searchapi["Search and answers<br/>[api.py]"]
  node_views["Document views<br/>[components.py]"]
end

subgraph group_platform["Storage and configuration"]
  node_gcsio["Storage I/O<br/>[gcsio.py]"]
  node_gcs[("Cloud Storage")]
  node_config["Database setup<br/>[dbconfig_main.py]"]
end

node_operator(("Document submitter"))

node_operator -->|"uploads documents"| node_gcs
node_gcs -.->|"starts processing"| node_workflow
node_workflow -->|"dispatches classification"| node_classifier
node_workflow -->|"checks duplicates"| node_registry
node_workflow -->|"dispatches processing"| node_office
node_workflow -->|"dispatches parsing"| node_parser
node_office -->|"calls processor"| node_xlsx
node_office -->|"reads and writes"| node_gcsio
node_xlsx -->|"reads and writes"| node_gcsio
node_office -->|"writes results"| node_results
node_workflow -->|"imports documents"| node_datastore
node_parser -.->|"reads and writes"| node_gcs
node_parser -.->|"records parsed data"| node_datastore
node_gcsio -->|"accesses objects"| node_gcs
node_operator -->|"searches and browses"| node_webui
node_webui -->|"requests answers"| node_searchapi
node_webui -->|"renders documents"| node_views
node_views -->|"loads document data"| node_searchapi
node_searchapi -.->|"queries content"| node_datastore
node_views -->|"retrieves originals"| node_gcs
node_operator -.->|"requests deletion"| node_deletion
node_config -.->|"configures database"| node_datastore
node_converter -.->|"converts documents"| node_gcs

click node_workflow "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/dpu-workflow/src/docs_processing_orchestrator.py"
click node_classifier "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/doc-classifier/src/doc_classifier_main.py"
click node_registry "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/doc-registry/src/document_registry_service.py"
click node_deletion "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/doc-deletion/src/doc_deletion_main.py"
click node_office "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/processing/libs/processor-msg/src/processors/msg/main_processor.py"
click node_xlsx "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/processing/libs/processor-xlsx/src/processors/xlsx/xlsx_processor.py"
click node_gcsio "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/processing/libs/processor-base/src/processors/base/gcsio.py"
click node_results "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/processing/libs/processor-base/src/processors/base/result_writer.py"
click node_parser "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/specialized-parser/src/runner.py"
click node_datastore "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/dpu-workflow/src/utils/datastore_utils.py"
click node_webui "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/webui/src/Home.py"
click node_searchapi "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/webui/src/dpu/api.py"
click node_views "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/webui/src/dpu/components.py"
click node_config "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/post-setup-config/src/dbconfig_main.py"
click node_converter "https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/utils/converter.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_workflow,node_classifier toneBlue
class node_office,node_xlsx,node_results,node_parser,node_converter toneAmber
class node_registry,node_deletion toneMint
class node_datastore,node_webui,node_searchapi,node_views toneRose
class node_gcsio,node_gcs,node_config,node_operator toneIndigo
```

## Components

### Workflow and intake

- [Workflow orchestrator](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/dpu-workflow/src/docs_processing_orchestrator.py): `components/dpu-workflow/src/docs_processing_orchestrator.py`
- [Document classifier](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/doc-classifier/src/doc_classifier_main.py): `components/doc-classifier/src/doc_classifier_main.py`

### Processing and parsing

- [Office processors](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/processing/libs/processor-msg/src/processors/msg/main_processor.py): `components/processing/libs/processor-msg/src/processors/msg/main_processor.py`
- [Spreadsheet processor](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/processing/libs/processor-xlsx/src/processors/xlsx/xlsx_processor.py): `components/processing/libs/processor-xlsx/src/processors/xlsx/xlsx_processor.py`
- [Result writer](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/processing/libs/processor-base/src/processors/base/result_writer.py): `components/processing/libs/processor-base/src/processors/base/result_writer.py`
- [Specialized parser](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/specialized-parser/src/runner.py): `components/specialized-parser/src/runner.py`
- [Format conversion](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/utils/converter.py): `components/utils/converter.py`

### Document management

- [Document registry](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/doc-registry/src/document_registry_service.py): `components/doc-registry/src/document_registry_service.py`
- [Document deletion](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/doc-deletion/src/doc_deletion_main.py): `components/doc-deletion/src/doc_deletion_main.py`

### Search and retrieval

- [Search data store](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/dpu-workflow/src/utils/datastore_utils.py): `components/dpu-workflow/src/utils/datastore_utils.py`
- [Knowledge interface](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/webui/src/Home.py): `components/webui/src/Home.py`
- [Search and answers](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/webui/src/dpu/api.py): `components/webui/src/dpu/api.py`
- [Document views](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/webui/src/dpu/components.py): `components/webui/src/dpu/components.py`

### Storage and configuration

- [Storage I/O](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/processing/libs/processor-base/src/processors/base/gcsio.py): `components/processing/libs/processor-base/src/processors/base/gcsio.py`
- **Cloud Storage**
- [Database setup](https://github.com/googlecloudplatform/enterprise-knowledge-solution/blob/main/components/post-setup-config/src/dbconfig_main.py): `components/post-setup-config/src/dbconfig_main.py`

### Other components

- **Document submitter**

## Connections

- Document submitter → Cloud Storage: uploads documents
- Cloud Storage → Workflow orchestrator: starts processing
- Workflow orchestrator → Document classifier: dispatches classification (evidence: `components/dpu-workflow/src/docs_processing_orchestrator.py`)
- Workflow orchestrator → Document registry: checks duplicates (evidence: `components/dpu-workflow/src/docs_processing_orchestrator.py`)
- Workflow orchestrator → Office processors: dispatches processing
- Workflow orchestrator → Specialized parser: dispatches parsing
- Office processors → Spreadsheet processor: calls processor (evidence: `components/processing/libs/processor-msg/src/processors/msg/main_processor.py`)
- Office processors → Storage I/O: reads and writes (evidence: `components/processing/libs/processor-msg/src/processors/msg/main_processor.py`)
- Spreadsheet processor → Storage I/O: reads and writes (evidence: `components/processing/libs/processor-xlsx/src/processors/xlsx/xlsx_processor.py`)
- Office processors → Result writer: writes results (evidence: `components/processing/libs/processor-msg/src/processors/msg/main_processor.py`)
- Workflow orchestrator → Search data store: imports documents (evidence: `components/dpu-workflow/src/docs_processing_orchestrator.py`)
- Specialized parser → Cloud Storage: reads and writes
- Specialized parser → Search data store: records parsed data
- Storage I/O → Cloud Storage: accesses objects (evidence: `components/processing/libs/processor-base/src/processors/base/gcsio.py`)
- Document submitter → Knowledge interface: searches and browses
- Knowledge interface → Search and answers: requests answers
- Knowledge interface → Document views: renders documents (evidence: `components/webui/src/Home.py`)
- Document views → Search and answers: loads document data (evidence: `components/webui/src/dpu/components.py`)
- Search and answers → Search data store: queries content
- Document views → Cloud Storage: retrieves originals (evidence: `components/webui/src/dpu/components.py`)
- Document submitter → Document deletion: requests deletion
- Database setup → Search data store: configures database
- Format conversion → Cloud Storage: converts documents
