# hurtn/datalake-on-adls architecture

> Architecture diagram of the GitHub repository hurtn/datalake-on-adls, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-09-30). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/hurtn/datalake-on-adls
- Repository: https://github.com/hurtn/datalake-on-adls

## Overview

This repository is a set of runnable Python examples for provisioning ADLS Gen2 resources and configuring access through Azure REST APIs. The documented workflow covers creating a security group, creating a filesystem container, assigning ACLs, and assigning RBAC roles; the examples are standalone scripts, not a shared orchestrated pipeline. Each script owns its own API calls. The README points readers to a separate ADLS configuration guide, but its contents were not sampled, so the graph reflects only capabilities supported by the README and shown source excerpts.

Main entry points: [`APIs/create_security_group.py`](https://github.com/hurtn/datalake-on-adls/blob/master/APIs/create_security_group.py) (Create security group), [`APIs/create_ADLS_container.py`](https://github.com/hurtn/datalake-on-adls/blob/master/APIs/create_ADLS_container.py) (Create container), [`APIs/assign_acls.py`](https://github.com/hurtn/datalake-on-adls/blob/master/APIs/assign_acls.py) (Assign ACLs), [`APIs/assign_rbac.py`](https://github.com/hurtn/datalake-on-adls/blob/master/APIs/assign_rbac.py) (Assign RBAC roles)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_examples["API examples"]
  node_create_group["Create security group"]
  node_create_container["Create container"]
end

subgraph group_lake["Lake access"]
  node_assign_acls["Assign ACLs<br/>[assign_acls.py]"]
  node_assign_rbac["Assign RBAC roles<br/>[assign_rbac.py]"]
end

node_operator(("LakeOps operator"))
node_identity{{"Microsoft identity"}}
node_graph{{"Microsoft Graph"}}
node_adls[("ADLS Gen2")]
node_azure_arm{{"Azure Resource Manager"}}

node_operator -->|"runs example"| node_create_group
node_operator -->|"runs example"| node_create_container
node_operator -->|"runs example"| node_assign_acls
node_operator -->|"runs example"| node_assign_rbac
node_create_group -->|"requests token"| node_identity
node_identity -->|"returns token"| node_create_group
node_create_group -->|"creates group"| node_graph
node_create_container -->|"requests token"| node_identity
node_identity -->|"returns token"| node_create_container
node_create_container -->|"creates filesystem"| node_adls
node_assign_acls -->|"requests token"| node_identity
node_identity -->|"returns token"| node_assign_acls
node_assign_acls -->|"sets ACLs"| node_adls
node_assign_rbac -->|"assigns roles"| node_azure_arm

click node_create_group "https://github.com/hurtn/datalake-on-adls/blob/master/APIs/create_security_group.py"
click node_create_container "https://github.com/hurtn/datalake-on-adls/blob/master/APIs/create_ADLS_container.py"
click node_assign_acls "https://github.com/hurtn/datalake-on-adls/blob/master/APIs/assign_acls.py"
click node_assign_rbac "https://github.com/hurtn/datalake-on-adls/blob/master/APIs/assign_rbac.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_create_group,node_create_container toneBlue
class node_assign_acls,node_assign_rbac,node_adls toneAmber
class node_operator,node_identity,node_graph,node_azure_arm toneIndigo
```

## Components

### API examples

- [Create security group](https://github.com/hurtn/datalake-on-adls/blob/master/APIs/create_security_group.py): `APIs/create_security_group.py`
- [Create container](https://github.com/hurtn/datalake-on-adls/blob/master/APIs/create_ADLS_container.py): `APIs/create_ADLS_container.py`

### Lake access

- [Assign ACLs](https://github.com/hurtn/datalake-on-adls/blob/master/APIs/assign_acls.py): `APIs/assign_acls.py`
- [Assign RBAC roles](https://github.com/hurtn/datalake-on-adls/blob/master/APIs/assign_rbac.py): `APIs/assign_rbac.py`

### Other components

- **LakeOps operator**
- **Microsoft identity**
- **Microsoft Graph**
- **ADLS Gen2**
- **Azure Resource Manager**

## Connections

- LakeOps operator → Create security group: runs example (evidence: `README.md`)
- LakeOps operator → Create container: runs example (evidence: `README.md`)
- LakeOps operator → Assign ACLs: runs example (evidence: `README.md`)
- LakeOps operator → Assign RBAC roles: runs example (evidence: `README.md`)
- Create security group → Microsoft identity: requests token (evidence: `APIs/create_security_group.py`)
- Microsoft identity → Create security group: returns token (evidence: `APIs/create_security_group.py`)
- Create security group → Microsoft Graph: creates group (evidence: `APIs/create_security_group.py`)
- Create container → Microsoft identity: requests token (evidence: `APIs/create_ADLS_container.py`)
- Microsoft identity → Create container: returns token (evidence: `APIs/create_ADLS_container.py`)
- Create container → ADLS Gen2: creates filesystem (evidence: `APIs/create_ADLS_container.py`)
- Assign ACLs → Microsoft identity: requests token (evidence: `APIs/assign_acls.py`)
- Microsoft identity → Assign ACLs: returns token (evidence: `APIs/assign_acls.py`)
- Assign ACLs → ADLS Gen2: sets ACLs (evidence: `APIs/assign_acls.py`)
- Assign RBAC roles → Azure Resource Manager: assigns roles (evidence: `APIs/assign_rbac.py`)
