# progress/hybrid-data-pipeline architecture

> Architecture diagram of the GitHub repository progress/hybrid-data-pipeline, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-04-10). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/progress/hybrid-data-pipeline
- Repository: https://github.com/progress/hybrid-data-pipeline

## Overview

##### Project Type and Purpose
- The project is an integration toolset, allowing external systems (such as Power BI and potentially others using driver drop-ins) to connect to the Hybrid Data Pipeline.
- The README emphasizes the “Hybrid Data Pipeline OData Connector,” which suggests that a primary goal is to facilitate secure, authenticated connections to the pipeline.

##### Main Directories and Their Significance
- Branding: Contains styling, properties, and assets files that likely provide configuration and branding (CSS, properties) for consistency across the connectors.
- Driver Drop In: Contains XML configuration files (options.xml, profile.xml) which probably dictate how drivers are loaded or integrated with client applications.
- Power BI Connectors: This is the most structured section with a clear focus on the OData Connector for Power BI. Files include solution (.sln) files, project descriptors (.mproj, .pq), query files, and build artifacts in the bin and obj folders. This suggests a Visual Studio-managed project with build outputs for the OData connector.

##### Architectural Components
a. Core Components:
- Connector Module (OData Connector): This is the central component that provides the functionality to interact with the Hybrid Data Pipeline using different authentication methods.
- Branding Module: Supplies necessary UI/UX assets and configuration properties that might be used to customize the connector's display or behavior.
- Driver Drop In Component: Likely serves as a plug-in mechanism to allow dynamic loading or configuration changes for connector functionality.

b. Relationships and Interactions:
- The OData Connector interacts directly with the Hybrid Data Pipeline, handling API calls (probably secured via OAuth or other authentication methods, as indicated by the file names like HdpOAuthConnect).
- Branding resources are integrated with the connectors to ensure a consistent look and feel.
- Driver Drop In configurations may influence how or when connector components are loaded or activated in response to external integration requests.

c. Architectural Patterns/Design Principles:
- Modularity: Each functional area (connector logic, branding adaptations, driver configurations) is compartmentalized into its own directory.
- Clear separation of concerns: The distinct separation of Power BI Connectors, Branding, and Driver Drop Ins indicates a clean, layered design.
- Standard build and deployment practices for .NET/Visual Studio projects (as evidenced by the use of .sln files, bin/obj directories).

## Diagram (Mermaid)

```mermaid
flowchart TD
    subgraph "External Layer"
        ExternalApp("External Applications (Power BI/ThirdParty)"):::external
    end

    subgraph "Connector Layer"
        OData("OData Connector"):::connector
        Hdp("Hybrid Data Pipeline"):::backend
    end

    subgraph "Supporting Modules"
        Branding("Branding Module"):::module
        Driver("Driver Drop In Module"):::module
    end

    ExternalApp -->|"initiateRequest"| OData
    OData <-->|"authenticateAndDataFlow"| Hdp
    Branding -->|"configures"| OData
    Driver -->|"configures"| OData

    click OData "https://github.com/progress/hybrid-data-pipeline/tree/main/Power BI Connectors/OData Connector/HdpOAuthConnect"
    click Branding "https://github.com/progress/hybrid-data-pipeline/tree/main/Branding"
    click Driver "https://github.com/progress/hybrid-data-pipeline/tree/main/Driver Drop In"

    classDef external fill:#f9c,stroke:#333,stroke-width:2px;
    classDef connector fill:#aaf,stroke:#333,stroke-width:2px;
    classDef backend fill:#afa,stroke:#333,stroke-width:2px;
    classDef module fill:#ff9,stroke:#333,stroke-width:2px;
```
