# guppyfish123/soc_lab architecture

> Architecture diagram of the GitHub repository guppyfish123/soc_lab, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-04-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/guppyfish123/soc_lab
- Repository: https://github.com/guppyfish123/soc_lab

## Overview

##### Project Type & Purpose
- This is a lab/instructional project designed to build a comprehensive security operations environment.
- The primary goal is to integrate various open-source components (Elastic, Kibana, Fleet, Filebeat, The Hive, Cortex, MISP, Shuffle) along with AWS resources to simulate a real-world security monitoring and incident response system.

##### File Structure Insights
- Top-Level Directories:
- “Installation”: Contains documentation for installing individual components (e.g., Cortex, Elastic-Kibana, MISP, TheHive, and AWS).
- “Setup”: Provides instructions on linking components together (e.g., Hive-Cortex-MISP Link, Shuffle SOAR setups, Elastic alerts).
- This separation into “Installation” and “Setup” indicates that after each component is installed, additional configuration is required to integrate them, highlighting the interconnected architecture.

##### README Key Components and Their Roles
- SIEM Infrastructure: Elastic (with Kibana, Filebeat & Fleet)
- Handles log collection, storage, and alert generation.
- SOAR Tools: The Hive and Shuffle
- Facilitate case management, alert correlation, and automated responses.
- Threat Intelligence & Analysis: MISP and Cortex
- MISP aggregates threat intel while Cortex provides observable analysis through its analyzers.
- Underlying Cloud Infrastructure: AWS
- All components are hosted on AWS VMs (E3 Instances), with additional AWS services (EC2, IAM, VPC, etc.) supporting the secure, scalable deployment.
- Additional integrations such as VirusTotal with Cortex and custom alert setups via Elastic illustrate the integrated workflow between these components.

##### Elements
- Use clear labels for each component (e.g., “Elastic SIEM”, “The Hive – SOAR”, “Cortex – Analytics”, “MISP – Threat Intel”, “Shuffle – Automation”, “AWS VPC/EC2”).
- Log/Metric flow from endpoints to Filebeat → Fleet → Elastic.
- Alert flow from Elastic to The Hive.
- Contextual enrichment from Cortex and threat feeds via MISP back to The Hive or alerting components.
- Orchestration commands from Shuffle directed toward response actions.
- Cloud infrastructure (AWS)
- SIEM components (Elastic suite)
- SOAR components (The Hive and Shuffle)
- Threat analysis (Cortex and MISP)
- Annotations that specify protocols or integration methods (e.g., API calls, log forwarding).

## Diagram (Mermaid)

```mermaid
flowchart TD
    AWS["AWS Cloud Infrastructure (EC2, VPC, IAM)"]:::aws
    EP["Endpoint Devices"]:::external
    FB["Filebeat"]:::siem
    FL["Fleet"]:::siem
    ES["Elastic SIEM (Elastic & Kibana)"]:::siem
    TH["The Hive (SOAR)"]:::soar
    SH["Shuffle (Automation)"]:::soar
    CX["Cortex (Analytics)"]:::threat
    MI["MISP (Threat Intel)"]:::threat
    IL["Integration Link"]:::integration

    %% AWS supports every component
    AWS -.-> EP
    AWS -.-> FB
    AWS -.-> FL
    AWS -.-> ES
    AWS -.-> TH
    AWS -.-> SH
    AWS -.-> CX
    AWS -.-> MI

    %% Log ingestion pipeline
    EP --> FB
    FB --> FL
    FL --> ES
    ES -->|"alerts"| TH

    %% Enrichment and threat intel
    CX -->|"enriches"| TH
    MI -->|"feeds"| TH

    %% Integration Link connecting SOAR & Threat Intelligence components
    TH --- IL
    CX --- IL
    MI --- IL

    %% Orchestration relationship between SOAR tools
    TH <--> SH

    %% Styles
    classDef aws fill:#E0BBE4,stroke:#6A0572,stroke-width:2px;
    classDef siem fill:#CDE4FF,stroke:#1E81CE,stroke-width:2px;
    classDef soar fill:#FFF5BA,stroke:#F4D35E,stroke-width:2px;
    classDef threat fill:#FFDCDC,stroke:#D72638,stroke-width:2px;
    classDef external fill:#C7F9CC,stroke:#90BE6D,stroke-width:2px;
    classDef integration fill:#FFE6E6,stroke:#FF4D4D,stroke-width:2px;

    %% Click Events
    click ES "https://github.com/guppyfish123/soc_lab/blob/main/Installation/Elastic-Kibana.md"
    click FB "https://github.com/guppyfish123/soc_lab/blob/main/Installation/FileBeat.md"
    click FL "https://github.com/guppyfish123/soc_lab/blob/main/Installation/Fleet-Server.md"
    click TH "https://github.com/guppyfish123/soc_lab/blob/main/Installation/TheHive.md"
    click SH "https://github.com/guppyfish123/soc_lab/blob/main/Installation/Shuffle.md"
    click SH "https://github.com/guppyfish123/soc_lab/blob/main/Setup/Shuffle_SOAR.md"
    click CX "https://github.com/guppyfish123/soc_lab/blob/main/Installation/Cortex.md"
    click CX "https://github.com/guppyfish123/soc_lab/blob/main/Setup/Cortex-VirusTotal.md"
    click MI "https://github.com/guppyfish123/soc_lab/blob/main/Installation/MISP.md"
    click IL "https://github.com/guppyfish123/soc_lab/blob/main/Setup/Hive_Cortex_MISP_Link.md"
    click AWS "https://github.com/guppyfish123/soc_lab/blob/main/Installation/aws.md"
```
