How nv-morpheus/morpheus works
Project type and purpose
• NVIDIA Morpheus is an open‑source AI application framework for cybersecurity.
It provides both a C++ core (CUDA‑accelerated, DOCA support) wrapped by Python packages and CLI tools to assemble streaming/ batch pipelines that ingest network data, perform ML inference (via Triton or PyTorch), and write results to sinks (Kafka, file, Elasticsearch, etc.).
• It ships multiple packages in one monorepo:
• morpheus (core pipeline framework)
• morpheus_dfp (digital‑fingerprinting extensions)
• morpheus_llm (LLM‑based modules and vector DB services)
File structure
• Top‑level build/config: CMakeLists.txt, pyproject.toml, setup.py, Dockerfiles, conda recipes, GitHub workflows.
• Python packages under python/morpheus*: C++ _lib directories built with CMake and pybind11, Python modules defining stages, controllers, parsers, pipeline abstractions, CLI.
• Examples: end‑to‑end pipelines for abp, pcap, LLM, fraud detection, ransomware, sid visualization, etc.
• Models: pretrained model binaries, ONNX, Triton model repo, training scripts, MLflow containers.
• CI/cd: devcontainer, Docker Compose, GitHub Actions, conda channel.
• Docs: Sphinx source with architecture guide, developer guides, examples.
Insights from README
• High‑level description of purpose: build optimized pipelines for cybersecurity.
• CLI “morpheus” and Python API both invoke pipelines.
• Prebuilt Docker containers and conda environments for reproducibility.
• Extensibility via custom “stages” (Python or C++) and plugin architecture.
Be detailed
• Major block: CI/CD → Build Artifacts → Container Runs → Pipeline Orchestrator → Stage Graph → Inference Client → External Model Server → Sinks → Monitoring.
• Data flow direction end‑to‑end.
• Plugin/registry mechanisms and key configuration files (cmake, pbtxt for Triton, conda YAML).
• Keep labels concise but explicit (e.g., “KafkaSourceStage → Kafka cluster”).