How sh7shir/anomaly-labelling works
This repository supports a three-step anomaly-analysis workflow: format CESNET traffic data, prepare datasets and run offline/online detectors, then inspect results with dataset-specific visualization scripts. The central runtime pairs offline preparation with streaming anomaly scoring; the detector set includes AnDePeD and NAB-derived approaches. Source excerpts establish the main orchestration and selected detector relationships; other capabilities and visualization branches are included where documented, without assuming unsampled implementation details.
Main entry points: main.py Pipeline runner · online_use.py Online procedure · OnlineDetectors Configured detectors · 3_Result_Visualization Result visualization
Components 27
Data preparation
- CESNET formatter
1_data_processng_for_CESNET/script_for_ces_to_nab_format.py - Dataset selection
2_AnDePeD-main/Code/data_handler.py - CSV and labels
2_AnDePeD-main/Code/read_files.py
Detection runtime
- Runtime config
2_AnDePeD-main/Code/main_config.py - Pipeline runner
2_AnDePeD-main/Code/main.py - Offline preparation
2_AnDePeD-main/Code/offline_prep.py - Parameter optimization
2_AnDePeD-main/Code/optimiser.py - Online procedure
2_AnDePeD-main/Code/online_use.py - Online buffer
2_AnDePeD-main/Code/online_buffer.py - Value scaling
2_AnDePeD-main/Code/scaling.py - Mode removal
2_AnDePeD-main/Code/vmd.py
Detector implementations
- Online detector API
2_AnDePeD-main/Code/OnlineDetectors/online_nab_detector.py - Configured detectors
2_AnDePeD-main/Code/OnlineDetectors - Skyline ensemble
2_AnDePeD-main/Code/OnlineDetectors/earthgeckoSkyline/earthgecko_skyline_detector.py - Skyline algorithms
2_AnDePeD-main/Code/OnlineDetectors/earthgeckoSkyline/algorithms.py - Context OSE detector
2_AnDePeD-main/Code/OnlineDetectors/contextOSE/context_ose_detector.py - Context anomaly engine
2_AnDePeD-main/Code/OnlineDetectors/contextOSE/cad_ose.py - Context operator
2_AnDePeD-main/Code/OnlineDetectors/contextOSE/context_operator.py - NAB detector API
2_AnDePeD-main/Code/NAB/nab/detectors/base.py - NAB Context OSE
2_AnDePeD-main/Code/NAB/nab/detectors/context_ose/context_ose_detector.py - NAB context engine
2_AnDePeD-main/Code/NAB/nab/detectors/context_ose/cad_ose.py - NAB context operator
2_AnDePeD-main/Code/NAB/nab/detectors/context_ose/context_operator.py
Result analysis
- Online results
2_AnDePeD-main/Code/write_files.py - Result visualization
3_Result_Visualization - NAB visualizations
3_Result_Visualization/NAB - CESNET visualizations
3_Result_Visualization/CESNET
Other components
- Engineer
Connections 26
- Engineer → CESNET formatter: formats datasets
- CESNET formatter → Dataset selection: prepares detector inputs
- Engineer → Pipeline runner: runs pipeline
- Pipeline runner → Runtime config: reads settings
2_AnDePeD-main/Code/main.py - Pipeline runner → Dataset selection: selects datasets
2_AnDePeD-main/Code/main.py - Pipeline runner → Offline preparation: runs preparation
2_AnDePeD-main/Code/main.py - Offline preparation → Parameter optimization: optimizes parameters
2_AnDePeD-main/Code/offline_prep.py - Pipeline runner → CSV and labels: loads datasets
2_AnDePeD-main/Code/main.py - Pipeline runner → Online procedure: starts scoring
2_AnDePeD-main/Code/main.py - Online procedure → Online buffer: updates buffer
2_AnDePeD-main/Code/online_use.py - Online procedure → Value scaling: scales values
2_AnDePeD-main/Code/online_use.py - Online procedure → Mode removal: removes modes
2_AnDePeD-main/Code/online_use.py - Online procedure → Configured detectors: selects detector
2_AnDePeD-main/Code/online_use.py - Online procedure → Online detector API: scores timesteps
2_AnDePeD-main/Code/online_use.py - Configured detectors → Skyline ensemble: includes
2_AnDePeD-main/Code/OnlineDetectors/earthgeckoSkyline/earthgecko_skyline_detector.py - Skyline ensemble → Skyline algorithms: uses algorithms
2_AnDePeD-main/Code/OnlineDetectors/earthgeckoSkyline/earthgecko_skyline_detector.py - Configured detectors → Context OSE detector: includes
2_AnDePeD-main/Code/OnlineDetectors/contextOSE/context_ose_detector.py - Context OSE detector → Context anomaly engine: delegates scoring
2_AnDePeD-main/Code/OnlineDetectors/contextOSE/context_ose_detector.py - Context anomaly engine → Context operator: uses context operator
2_AnDePeD-main/Code/OnlineDetectors/contextOSE/cad_ose.py - Pipeline runner → Online results: exports results
2_AnDePeD-main/Code/main.py - Engineer → Result visualization: inspects results
- Result visualization → NAB visualizations: includes NAB views
- Result visualization → CESNET visualizations: includes CESNET views
- NAB Context OSE → NAB detector API: extends detector API
2_AnDePeD-main/Code/NAB/nab/detectors/context_ose/context_ose_detector.py - NAB Context OSE → NAB context engine: delegates scoring
2_AnDePeD-main/Code/NAB/nab/detectors/context_ose/context_ose_detector.py - NAB context engine → NAB context operator: uses context operator
2_AnDePeD-main/Code/NAB/nab/detectors/context_ose/cad_ose.py