How soham-2305/cyber-nids-bda works
The repository is a hybrid network intrusion detection and traffic-analysis project. Its main runtime captures packets, extracts features, applies rules, assigns severity, and logs alerts for dashboard viewing. Separate dataset workflows preprocess CICIDS2017 data, train and evaluate a classifier, and run Spark analytics; the README describes ML as separate from live detection. The simulator is a controlled-traffic utility. Some secondary ML modules are unsampled, so their internal links are omitted rather than inferred.
Main entry points: main.py NIDS orchestrator · processed Processed dataset · app.py Dashboard and API · packet_capture.py Packet capture
Components 20
Live Detection
- NIDS orchestrator
main.py - Packet capture
detector/packet_capture.py - Feature extraction
detector/feature_extractor.py - Rule detection
detector/rule_detector.py - Severity mapping
detector/severity_engine.py - Alert logger
detector/logger.py
Alert Visibility
- Alert CSV logs
logs - Dashboard and API
dashboard/app.py - Dashboard page
dashboard/templates/dashboard.html
Dataset Analysis
- Raw datasets
data/raw - Dataset preprocessing
ml/preprocess_dataset.py - Processed dataset
data/processed - Spark analytics
spark/big_data_analysis.py - Analytics results
Machine Learning
- ML dataset tools
ml - Model training
ml/train_model.py - Model artifacts
models
Controlled Demo
- Traffic simulator
simulator/traffic_simulator.py
Other components
- Operator
- Network traffic
Connections 21
- Operator → NIDS orchestrator: starts
main.py - NIDS orchestrator → Packet capture: starts capture
main.py - Network traffic → Packet capture: supplies packets
detector/packet_capture.py - Packet capture → NIDS orchestrator: calls callback
main.py - NIDS orchestrator → Feature extraction: extracts features
main.py - NIDS orchestrator → Rule detection: analyzes features
main.py - NIDS orchestrator → Severity mapping: assigns severity
main.py - NIDS orchestrator → Alert logger: logs alerts
main.py - Alert logger → Alert CSV logs: writes CSV
detector/logger.py - Dashboard and API → Alert CSV logs: reads latest CSV
dashboard/app.py - Operator → Dashboard and API: views
dashboard/app.py - Dashboard and API → Dashboard page: renders
dashboard/app.py - Raw datasets → Dataset preprocessing: supplies CSVs
- Dataset preprocessing → Processed dataset: writes cleaned data
- Processed dataset → Spark analytics: supplies dataset
spark/big_data_analysis.py - Spark analytics → Analytics results: saves analytics
spark/big_data_analysis.py - Processed dataset → Model training: supplies dataset
ml/train_model.py - Model training → Model artifacts: saves model and reports
ml/train_model.py - Processed dataset → ML dataset tools: dataset workflows
- Operator → Traffic simulator: runs demo
simulator/traffic_simulator.py - Traffic simulator → Network traffic: generates traffic