Skip to content

Benchmark Results - Problem C1 - Optimization Strategies

Tested Optimization strategies (1000 iterations):

name class params Constraint-aware
RS OptimRandomSwaps False
GS(1) OptimGuidedSwaps min_swap_size=1
max_swap_size=1		 True
GS(2) OptimGuidedSwaps min_swap_size=2
max_swap_size=2		 True
GS(3) OptimGuidedSwaps min_swap_size=3
max_swap_size=3		 True
GS(1-3) OptimGuidedSwaps min_swap_size=1
max_swap_size=3		 True
GS(1-3,soft) OptimGuidedSwaps min_swap_size=1
max_swap_size=3
constraint_softness=ease_in_out(1.00,0.00)
p_add_constraint_aware=ease_in_out(0.00,1.00)		 True
GS(1-3,wide) OptimGuidedSwaps min_swap_size=1
max_swap_size=3
remove_selectivity_modifier=-0.8
add_selectivity_modifier=-0.8		 True
GS(1-3,narrow) OptimGuidedSwaps min_swap_size=1
max_swap_size=3
remove_selectivity_modifier=0.8
add_selectivity_modifier=0.8		 True
GS(1-3,wi->na) OptimGuidedSwaps min_swap_size=1
max_swap_size=3
remove_selectivity_modifier=linear(-0.80,0.80)
add_selectivity_modifier=linear(-0.80,0.80)		 True
GS(1-3,na->wi) OptimGuidedSwaps min_swap_size=1
max_swap_size=3
remove_selectivity_modifier=linear(0.80,-0.80)
add_selectivity_modifier=linear(0.80,-0.80)		 True
SM(2) OptimSmartSwaps swap_size_max=2
nc_remove_max=2
nc_add_max=2
tau_learn=10
ignore_infeasible_diversity_up_to_fraction=0.8
cost_awareness=0.5		 True
SM(4) OptimSmartSwaps swap_size_max=4
nc_remove_max=4
nc_add_max=4
tau_learn=10
ignore_infeasible_diversity_up_to_fraction=0.8
cost_awareness=0.5		 True
SM(8) OptimSmartSwaps swap_size_max=8
nc_remove_max=8
nc_add_max=8
tau_learn=10
ignore_infeasible_diversity_up_to_fraction=0.8
cost_awareness=0.5		 True

Time Duration

d n k m RS GS(1) GS(2) GS(3) GS(1-3) GS(1-3,soft) GS(1-3,wide) GS(1-3,narrow) GS(1-3,wi->na) GS(1-3,na->wi) SM(2) SM(4) SM(8)
2 100 10 2 25.08 msec ± 0.6% 29.78 msec ± 0.6% 37.23 msec ± 0.3% 43.79 msec ± 0.5% 33.81 msec ± 0.5% 34.02 msec ± 0.7% 33.77 msec ± 0.8% 33.33 msec ± 0.3% 34.63 msec ± 0.6% 34.54 msec ± 0.4% 94.11 msec ± 0.8% 124.4 msec ± 1.8% 129.6 msec ± 2.4%
2 200 20 4 26.27 msec ± 0.8% 31.65 msec ± 0.6% 40.20 msec ± 0.4% 47.38 msec ± 0.5% 36.18 msec ± 0.7% 36.50 msec ± 0.5% 36.03 msec ± 0.4% 36.08 msec ± 0.9% 37.12 msec ± 0.7% 36.88 msec ± 0.7% 99.81 msec ± 0.8% 137.4 msec ± 2.4% 145.5 msec ± 3.9%
2 300 30 6 27.89 msec ± 0.8% 34.58 msec ± 0.7% 43.86 msec ± 0.7% 51.91 msec ± 0.5% 39.49 msec ± 0.6% 39.37 msec ± 0.5% 39.49 msec ± 0.4% 39.24 msec ± 0.7% 40.06 msec ± 1.0% 39.99 msec ± 0.7% 106.4 msec ± 0.8% 147.6 msec ± 2.2% 157.5 msec ± 2.5%
2 400 40 8 28.26 msec ± 0.8% 35.58 msec ± 0.6% 45.65 msec ± 0.6% 54.00 msec ± 0.8% 40.79 msec ± 0.6% 40.69 msec ± 0.7% 40.83 msec ± 0.8% 40.13 msec ± 0.4% 41.63 msec ± 0.4% 41.17 msec ± 0.4% 109.0 msec ± 0.9% 155.9 msec ± 1.4% 169.4 msec ± 2.1%
2 600 60 12 30.74 msec ± 1.0% 39.36 msec ± 1.3% 50.65 msec ± 0.8% 60.90 msec ± 0.7% 45.16 msec ± 0.9% 44.52 msec ± 0.9% 45.34 msec ± 1.0% 44.79 msec ± 0.7% 46.32 msec ± 0.9% 45.74 msec ± 1.3% 119.2 msec ± 0.8% 173.0 msec ± 1.9% 196.4 msec ± 4.1%
2 800 80 16 32.32 msec ± 1.3% 42.70 msec ± 1.0% 55.99 msec ± 0.7% 66.49 msec ± 0.7% 49.03 msec ± 1.3% 48.08 msec ± 1.4% 49.23 msec ± 0.8% 48.49 msec ± 0.5% 50.02 msec ± 1.2% 49.60 msec ± 1.1% 128.0 msec ± 0.9% 185.0 msec ± 1.3% 220.6 msec ± 4.6%
2 1200 120 24 35.43 msec ± 1.7% 47.89 msec ± 1.6% 64.29 msec ± 1.4% 77.76 msec ± 0.9% 55.74 msec ± 1.2% 54.74 msec ± 1.3% 55.81 msec ± 1.6% 55.67 msec ± 0.8% 57.55 msec ± 1.4% 57.11 msec ± 1.3% 145.0 msec ± 0.8% 215.3 msec ± 1.1% 252.2 msec ± 4.3%
2 1600 160 32 40.00 msec ± 2.2% 53.74 msec ± 1.8% 73.75 msec ± 1.6% 89.34 msec ± 1.4% 64.92 msec ± 1.1% 62.05 msec ± 1.9% 65.00 msec ± 2.0% 62.99 msec ± 1.2% 65.27 msec ± 1.1% 64.03 msec ± 0.9% 164.1 msec ± 0.8% 245.9 msec ± 1.4% 294.9 msec ± 2.6%
2 2400 240 48 44.48 msec ± 6.2% 64.80 msec ± 3.8% 94.13 msec ± 1.9% 110.6 msec ± 0.7% 81.03 msec ± 1.2% 72.71 msec ± 1.4% 79.79 msec ± 3.7% 79.80 msec ± 3.4% 80.37 msec ± 3.5% 80.34 msec ± 3.9% 202.6 msec ± 1.6% 316.4 msec ± 1.9% 397.2 msec ± 6.2%
2 3200 320 64 54.61 msec ± 0.5% 79.76 msec ± 1.5% 115.3 msec ± 1.0% 143.3 msec ± 2.2% 96.99 msec ± 0.6% 91.02 msec ± 0.5% 97.10 msec ± 0.6% 95.57 msec ± 0.8% 98.69 msec ± 1.2% 97.97 msec ± 0.8% 243.9 msec ± 2.3% 386.1 msec ± 2.3% 509.2 msec ± 4.9%
2 4800 480 96 76.02 msec ± 1.0% 113.7 msec ± 1.8% 169.0 msec ± 0.7% 221.2 msec ± 1.1% 144.1 msec ± 0.9% 132.8 msec ± 1.1% 141.5 msec ± 0.2% 137.3 msec ± 0.3% 141.2 msec ± 1.3% 140.6 msec ± 0.3% 359.1 msec ± 0.9% 594.1 msec ± 1.4% 836.6 msec ± 4.5%
2 6400 640 128 105.4 msec ± 0.7% 152.7 msec ± 0.5% 242.5 msec ± 0.3% 326.3 msec ± 0.2% 200.8 msec ± 0.2% 182.7 msec ± 0.7% 197.9 msec ± 0.7% 199.3 msec ± 0.9% 198.2 msec ± 0.9% 198.7 msec ± 0.3% 530.0 msec ± 0.9% 904.3 msec ± 1.7% 1.199 sec ± 4.6%
Geomean: 39.45 msec ± 1.4% 52.61 msec ± 1.3% 71.52 msec ± 0.9% 86.96 msec ± 0.9% 62.55 msec ± 0.8% 60.32 msec ± 1.0% 62.34 msec ± 1.1% 61.64 msec ± 0.9% 63.30 msec ± 1.2% 62.89 msec ± 1.0% 163.8 msec ± 1.0% 243.6 msec ± 1.7% 288.2 msec ± 3.9%

Diversity Score

d n k m RS GS(1) GS(2) GS(3) GS(1-3) GS(1-3,soft) GS(1-3,wide) GS(1-3,narrow) GS(1-3,wi->na) GS(1-3,na->wi) SM(2) SM(4) SM(8)
2 100 10 2 0.839 ± 3.7% 0.902 ± 1.6% 0.836 ± 4.4% 0.811 ± 3.1% 0.874 ± 1.3% 0.896 ± 2.3% 0.844 ± 1.8% 0.913 ± 0.3% 0.892 ± 1.5% 0.913 ± 0.2% 0.913 ± 0.0% 0.913 ± 0.5% 0.913 ± 0.9%
2 200 20 4 0.546 ± 1.6% 0.589 ± 0.9% 0.554 ± 1.3% 0.541 ± 1.4% 0.580 ± 1.7% 0.582 ± 1.4% 0.551 ± 1.8% 0.602 ± 1.3% 0.592 ± 0.9% 0.592 ± 0.8% 0.604 ± 0.9% 0.596 ± 0.5% 0.604 ± 1.0%
2 300 30 6 0.385 ± 1.5% 0.412 ± 0.9% 0.401 ± 1.1% 0.388 ± 1.5% 0.411 ± 1.5% 0.411 ± 0.8% 0.393 ± 1.6% 0.435 ± 0.7% 0.429 ± 1.1% 0.423 ± 0.8% 0.437 ± 0.5% 0.434 ± 0.9% 0.435 ± 0.9%
2 400 40 8 0.316 ± 1.9% 0.353 ± 0.8% 0.334 ± 1.4% 0.327 ± 1.3% 0.350 ± 1.1% 0.348 ± 1.3% 0.322 ± 1.4% 0.371 ± 0.7% 0.359 ± 0.7% 0.364 ± 0.7% 0.367 ± 1.1% 0.370 ± 1.4% 0.369 ± 0.9%
2 600 60 12 0.245 ± 1.9% 0.274 ± 0.9% 0.261 ± 0.9% 0.253 ± 1.0% 0.270 ± 0.5% 0.269 ± 0.9% 0.254 ± 1.6% 0.292 ± 0.5% 0.282 ± 0.6% 0.282 ± 0.4% 0.292 ± 0.5% 0.293 ± 0.7% 0.292 ± 0.8%
2 800 80 16 0.199 ± 1.3% 0.230 ± 0.9% 0.220 ± 0.8% 0.212 ± 1.0% 0.227 ± 0.9% 0.228 ± 0.8% 0.211 ± 1.3% 0.248 ± 0.5% 0.239 ± 1.1% 0.238 ± 0.5% 0.248 ± 0.7% 0.248 ± 0.3% 0.249 ± 0.8%
2 1200 120 24 0.153 ± 1.6% 0.182 ± 0.8% 0.175 ± 1.5% 0.170 ± 1.1% 0.179 ± 1.0% 0.177 ± 1.0% 0.165 ± 1.6% 0.203 ± 0.4% 0.192 ± 0.7% 0.191 ± 0.8% 0.203 ± 0.4% 0.203 ± 0.5% 0.202 ± 0.6%
2 1600 160 32 0.123 ± 1.8% 0.151 ± 1.3% 0.144 ± 0.6% 0.141 ± 1.7% 0.148 ± 1.1% 0.146 ± 1.1% 0.135 ± 1.4% 0.169 ± 0.3% 0.161 ± 0.6% 0.160 ± 1.1% 0.170 ± 0.7% 0.170 ± 0.4% 0.170 ± 0.4%
2 2400 240 48 0.090 ± 0.9% 0.113 ± 1.6% 0.108 ± 0.9% 0.106 ± 1.2% 0.111 ± 1.6% 0.110 ± 2.0% 0.102 ± 1.0% 0.136 ± 0.3% 0.125 ± 0.7% 0.121 ± 0.6% 0.136 ± 0.5% 0.136 ± 0.6% 0.137 ± 0.6%
2 3200 320 64 0.073 ± 3.1% 0.091 ± 1.2% 0.092 ± 0.4% 0.090 ± 0.6% 0.092 ± 0.7% 0.088 ± 1.5% 0.084 ± 0.8% 0.117 ± 0.3% 0.105 ± 0.5% 0.098 ± 1.1% 0.114 ± 0.3% 0.116 ± 0.4% 0.117 ± 0.8%
2 4800 480 96 0.050 ± 1.2% 0.065 ± 1.2% 0.069 ± 0.4% 0.070 ± 0.9% 0.065 ± 1.5% 0.065 ± 1.0% 0.060 ± 0.8% 0.095 ± 0.2% 0.084 ± 0.6% 0.072 ± 1.2% 0.091 ± 0.3% 0.093 ± 0.2% 0.094 ± 0.5%
2 6400 640 128 0.036 ± 1.0% 0.047 ± 0.9% 0.054 ± 0.8% 0.056 ± 0.8% 0.051 ± 1.0% 0.049 ± 1.4% 0.045 ± 0.9% 0.080 ± 0.3% 0.066 ± 0.4% 0.052 ± 1.2% 0.074 ± 1.3% 0.078 ± 0.5% 0.079 ± 0.4%
Geomean: 0.170 ± 1.8% 0.200 ± 1.1% 0.196 ± 1.2% 0.193 ± 1.3% 0.200 ± 1.2% 0.198 ± 1.3% 0.185 ± 1.3% 0.234 ± 0.5% 0.220 ± 0.8% 0.211 ± 0.8% 0.231 ± 0.6% 0.233 ± 0.6% 0.234 ± 0.7%

Constraint Score

d n k m RS GS(1) GS(2) GS(3) GS(1-3) GS(1-3,soft) GS(1-3,wide) GS(1-3,narrow) GS(1-3,wi->na) GS(1-3,na->wi) SM(2) SM(4) SM(8)
2 100 10 2 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 200 20 4 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 300 30 6 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 400 40 8 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 600 60 12 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 800 80 16 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 1200 120 24 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 1600 160 32 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 2400 240 48 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 3200 320 64 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 4800 480 96 0.987 ± 0.4% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 6400 640 128 0.973 ± 0.4% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
Mean: 0.997 ± 0.1% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%