How guppyfish123/soc_lab works
Project Type & Purpose
• This is a lab/instructional project designed to build a comprehensive security operations environment.
• The primary goal is to integrate various open-source components (Elastic, Kibana, Fleet, Filebeat, The Hive, Cortex, MISP, Shuffle) along with AWS resources to simulate a real-world security monitoring and incident response system.
File Structure Insights
• Top-Level Directories:
• “Installation”: Contains documentation for installing individual components (e.g., Cortex, Elastic-Kibana, MISP, TheHive, and AWS).
• “Setup”: Provides instructions on linking components together (e.g., Hive-Cortex-MISP Link, Shuffle SOAR setups, Elastic alerts).
• This separation into “Installation” and “Setup” indicates that after each component is installed, additional configuration is required to integrate them, highlighting the interconnected architecture.
README Key Components and Their Roles
• SIEM Infrastructure: Elastic (with Kibana, Filebeat & Fleet)
• Handles log collection, storage, and alert generation.
• SOAR Tools: The Hive and Shuffle
• Facilitate case management, alert correlation, and automated responses.
• Threat Intelligence & Analysis: MISP and Cortex
• MISP aggregates threat intel while Cortex provides observable analysis through its analyzers.
• Underlying Cloud Infrastructure: AWS
• All components are hosted on AWS VMs (E3 Instances), with additional AWS services (EC2, IAM, VPC, etc.) supporting the secure, scalable deployment.
• Additional integrations such as VirusTotal with Cortex and custom alert setups via Elastic illustrate the integrated workflow between these components.
Elements
• Use clear labels for each component (e.g., “Elastic SIEM”, “The Hive – SOAR”, “Cortex – Analytics”, “MISP – Threat Intel”, “Shuffle – Automation”, “AWS VPC/EC2”).
• Log/Metric flow from endpoints to Filebeat → Fleet → Elastic.
• Alert flow from Elastic to The Hive.
• Contextual enrichment from Cortex and threat feeds via MISP back to The Hive or alerting components.
• Orchestration commands from Shuffle directed toward response actions.
• Cloud infrastructure (AWS)
• SIEM components (Elastic suite)
• SOAR components (The Hive and Shuffle)
• Threat analysis (Cortex and MISP)
• Annotations that specify protocols or integration methods (e.g., API calls, log forwarding).