How diku-dk/onlinemarketplacebenchmark works
Online Marketplace is a C# benchmark driver for running configurable microservice experiments. A user supplies experiment and workload settings; the driver generates or reuses marketplace data, ingests initial state, submits customer, seller, and delivery transactions to a target platform, then collects and writes performance metrics. Common code provides the lifecycle, workload scheduling, service/worker abstractions, and metrics; platform projects adapt those pieces, including platform-specific ingestion or result collection. The README documents the full lifecycle; source excerpts substantiate core orchestration and workload calls, but not every platform-specific runtime detail.
Main entry points: AbstractExperimentManager.cs Experiment lifecycle · MetricManager.cs Metric collection · WorkloadManager.cs Workload scheduler · CustomerService.cs Customer service
Components 22
Experiment setup
- Experiment config
Common/Experiment/ExperimentConfig.cs - Experiment lifecycle
Common/Experiment/AbstractExperimentManager.cs - Data generation
Common/DataGeneration/Synthetic/SyntheticDataGenerator.cs - DuckDB data
Common/Infra/DuckDbUtils.cs - Data ingestion
Common/Ingestion/DefaultIngestionOrchestrator.cs
Workload execution
- Workload scheduler
Common/Workload/WorkloadManager.cs - Customer service
Common/Services/CustomerService.cs - Seller service
Common/Services/SellerService.cs - Delivery service
Common/Services/DeliveryService.cs - Customer worker
Common/Workers/Customer/DefaultCustomerWorker.cs - Seller worker
Common/Workers/Seller/DefaultSellerWorker.cs - Delivery worker
Common/Workers/Delivery/DefaultDeliveryWorker.cs
Platform adapters
- Dapr adapter
Dapr/Workload/DaprExperimentManager.cs - Statefun adapter
Statefun/Workload/StatefunExperimentManager.cs - Orleans adapter
Orleans/Workload/ActorExperimentManager.cs - Driver benchmark adapter
DriverBench/Experiment/DriverBenchExperimentManager.cs - Modb adapter
Modb/ModbExperimentManager.cs
Metrics and results
- Metric collection
Common/Metric/MetricManager.cs - Platform metric capture
Dapr/Metric/DaprMetricManager.cs - Metric results file
Common/Metric/MetricManager.cs
Other components
- Experiment user
- Marketplace APIs
Connections 27
- Experiment user → Experiment config: configures
README.md - Experiment config → Experiment lifecycle: configures
README.md - Experiment lifecycle → Data generation: generates data
Common/Experiment/AbstractExperimentManager.cs - Data generation → DuckDB data: writes data
README.md - Experiment lifecycle → DuckDB data: loads data
Common/Experiment/AbstractExperimentManager.cs - Experiment lifecycle → Data ingestion: runs ingestion
Common/Experiment/AbstractExperimentManager.cs - Experiment lifecycle → Workload scheduler: runs workload
Common/Experiment/AbstractExperimentManager.cs - Workload scheduler → Customer service: dispatches sessions
Common/Workload/WorkloadManager.cs - Workload scheduler → Seller service: dispatches updates
Common/Workload/WorkloadManager.cs - Workload scheduler → Delivery service: dispatches deliveries
Common/Workload/WorkloadManager.cs - Customer service → Customer worker: runs customer
Common/Services/CustomerService.cs - Seller service → Seller worker: runs seller
Common/Services/SellerService.cs - Customer worker → Marketplace APIs: sends requests
Common/Workers/Customer/DefaultCustomerWorker.cs - Seller worker → Marketplace APIs: sends requests
- Delivery worker → Marketplace APIs: sends requests
- Experiment lifecycle → Metric collection: collects metrics
Common/Experiment/AbstractExperimentManager.cs - Metric collection → Customer service: reads transactions
Common/Metric/MetricManager.cs - Metric collection → Seller service: reads transactions
Common/Metric/MetricManager.cs - Metric collection → Delivery service: reads transactions
- Metric collection → Metric results file: writes results
Common/Metric/MetricManager.cs - Dapr adapter → Experiment lifecycle: extends lifecycle
Dapr/Workload/DaprExperimentManager.cs - Statefun adapter → Experiment lifecycle: extends lifecycle
Statefun/Workload/StatefunExperimentManager.cs - Orleans adapter → Experiment lifecycle: extends lifecycle
Orleans/Workload/ActorExperimentManager.cs - Driver benchmark adapter → Experiment lifecycle: extends lifecycle
DriverBench/Experiment/DriverBenchExperimentManager.cs - Modb adapter → Experiment lifecycle: extends lifecycle
Modb/ModbExperimentManager.cs - Dapr adapter → Platform metric capture: uses metrics
Dapr/Workload/DaprExperimentManager.cs - Platform metric capture → Metric collection: adapts collection
Dapr/Metric/DaprMetricManager.cs