# aws-samples/create-security-observability-using-generative-ai-with-security-lake-and-amazon-q-for-quicksight architecture

> Architecture diagram of the GitHub repository aws-samples/create-security-observability-using-generative-ai-with-security-lake-and-amazon-q-for-quicksight, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-04-22). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/aws-samples/create-security-observability-using-generative-ai-with-security-lake-and-amazon-q-for-quicksight
- Repository: https://github.com/aws-samples/create-security-observability-using-generative-ai-with-security-lake-and-amazon-q-for-quicksight

## Overview

##### Project Type and Purpose
- This is not a traditional codebase but a documentation repository providing QuickSight view templates (CloudTrail, Security Hub, VPC Flow Logs) that plug into Amazon Security Lake and feed into Amazon Q for QuickSight.

##### Main Components of the System
a. Data Sources (AWS Services)
- AWS CloudTrail
- AWS Security Hub
- AWS VPC Flow Logs
b. Central Data Store
- Amazon Security Lake
c. Analytics & Visualization
- Amazon Q for QuickSight (QuickSight Q)
- QuickSight Dashboards / Views
d. Deployment & Management (implied)
- AWS IAM for permissions
- AWS CloudFormation or AWS CDK (optional, not in this repo)
- Workshop environment (per the README link)
e. Documentation Artifacts
- Markdown files: `cloudtrail_view.md`, `security_hub_view.md`, `vpc_flow_log_view.md`

##### Relationships and Data Flow
- Each AWS service (CloudTrail, Security Hub, VPC Flow Logs) continuously emits security records.
- Those records are ingested automatically or via a connector into Amazon Security Lake.
- Security Lake normalizes and stores them in a central LakeHouse.
- Amazon Q for QuickSight connects to Security Lake as a data source.
- The view-definition templates (from each .md file) are used to create QuickSight Q data sets and dashboards.
- End users interact via QuickSight dashboards or natural-language queries in Q.

##### Architectural Patterns & Design Principles
- Event-driven ingestion: decoupling producers (CloudTrail, Hub, VPC logs) from the analytics layer.
- Centralized data lake (Security Lake) for schema unification.
- Self-service analytics via QuickSight Q.
- Separation of concerns: ingestion → storage → visualization.

- cloudtrail_view.md
- security_hub_view.md
- vpc_flow_log_view.md
g. Optional deployment steps (e.g., CloudFormation or workshop steps) as a side note.

##### Important Details to Capture
- Three distinct data ingestion streams.
- Central normalized repository (Security Lake).
- Use of generative AI capabilities in QuickSight Q for natural-language queries.
- Role of the Markdown templates as the “business logic” for QuickSight views.
- Security boundary (IAM) controlling access between components.

## Diagram (Mermaid)

```mermaid
flowchart TD
    %% Title
    Title["Security Observability Architecture with Amazon Security Lake & QuickSight Q"]:::title

    subgraph "Data Ingestion"
        direction TB
        CT["AWS CloudTrail"]:::ingestion
        SH["AWS Security Hub"]:::ingestion
        VPC["AWS VPC Flow Logs"]:::ingestion
    end

    SL["Amazon Security Lake"]:::storage
    IAM["AWS IAM Permissions"]:::security
    QSQ["Amazon Q for QuickSight"]:::analytics

    subgraph "View Templates"
        direction TB
        CTmd["cloudtrail_view.md"]:::doc
        SHmd["security_hub_view.md"]:::doc
        VPCmd["vpc_flow_log_view.md"]:::doc
    end

    EU["End Users / Analysts"]:::external
    README["README.md"]:::doc

    %% Data flows
    CT -->|"ingest events"| SL
    SH -->|"ingest findings"| SL
    VPC -->|"ingest flow logs"| SL

    SL -->|"access control"| IAM
    SL -->|"query/view"| QSQ

    CTmd -->|"defines dataset"| QSQ
    SHmd -->|"defines dataset"| QSQ
    VPCmd -->|"defines dataset"| QSQ

    QSQ -->|"natural-language queries"| EU
    README -.->|"deployment guide"| IAM

    %% Click events
    click CTmd "https://github.com/aws-samples/create-security-observability-using-generative-ai-with-security-lake-and-amazon-q-for-quicksight/blob/main/cloudtrail_view.md"
    click SHmd "https://github.com/aws-samples/create-security-observability-using-generative-ai-with-security-lake-and-amazon-q-for-quicksight/blob/main/security_hub_view.md"
    click VPCmd "https://github.com/aws-samples/create-security-observability-using-generative-ai-with-security-lake-and-amazon-q-for-quicksight/blob/main/vpc_flow_log_view.md"
    click README "https://github.com/aws-samples/create-security-observability-using-generative-ai-with-security-lake-and-amazon-q-for-quicksight/blob/main/README.md"

    %% Styles
    classDef ingestion fill:#E0F3FF,stroke:#68BFFF,color:#000
    classDef storage fill:#E0FFE0,stroke:#3FBF3F,color:#000
    classDef analytics fill:#FFF3E0,stroke:#FFA500,color:#000
    classDef doc fill:#F0F0F0,stroke:#AAA,color:#000
    classDef security fill:#F5F5F5,stroke:#888,color:#000
    classDef external fill:#FFF0F5,stroke:#FF69B4,color:#000
    classDef title fill:#FFFFFF,stroke:none,color:#000,font-weight:bold,font-size:16px
```
