Skip to content

Benchmark Results - Problem C2 - Optimization Strategies

Tested Optimization strategies (1000 iterations):

name class params Constraint-aware
RS OptimRandomSwaps False
GS(1) OptimGuidedSwaps min_swap_size=1
max_swap_size=1		 True
GS(2) OptimGuidedSwaps min_swap_size=2
max_swap_size=2		 True
GS(3) OptimGuidedSwaps min_swap_size=3
max_swap_size=3		 True
GS(1-3) OptimGuidedSwaps min_swap_size=1
max_swap_size=3		 True
GS(1-3,soft) OptimGuidedSwaps min_swap_size=1
max_swap_size=3
constraint_softness=ease_in_out(1.00,0.00)
p_add_constraint_aware=ease_in_out(0.00,1.00)		 True
GS(1-3,wide) OptimGuidedSwaps min_swap_size=1
max_swap_size=3
remove_selectivity_modifier=-0.8
add_selectivity_modifier=-0.8		 True
GS(1-3,narrow) OptimGuidedSwaps min_swap_size=1
max_swap_size=3
remove_selectivity_modifier=0.8
add_selectivity_modifier=0.8		 True
GS(1-3,wi->na) OptimGuidedSwaps min_swap_size=1
max_swap_size=3
remove_selectivity_modifier=linear(-0.80,0.80)
add_selectivity_modifier=linear(-0.80,0.80)		 True
GS(1-3,na->wi) OptimGuidedSwaps min_swap_size=1
max_swap_size=3
remove_selectivity_modifier=linear(0.80,-0.80)
add_selectivity_modifier=linear(0.80,-0.80)		 True
SM(2) OptimSmartSwaps swap_size_max=2
nc_remove_max=2
nc_add_max=2
tau_learn=10
ignore_infeasible_diversity_up_to_fraction=0.8
cost_awareness=0.5		 True
SM(4) OptimSmartSwaps swap_size_max=4
nc_remove_max=4
nc_add_max=4
tau_learn=10
ignore_infeasible_diversity_up_to_fraction=0.8
cost_awareness=0.5		 True
SM(8) OptimSmartSwaps swap_size_max=8
nc_remove_max=8
nc_add_max=8
tau_learn=10
ignore_infeasible_diversity_up_to_fraction=0.8
cost_awareness=0.5		 True

Time Duration

d n k m RS GS(1) GS(2) GS(3) GS(1-3) GS(1-3,soft) GS(1-3,wide) GS(1-3,narrow) GS(1-3,wi->na) GS(1-3,na->wi) SM(2) SM(4) SM(8)
2 100 10 2 25.20 msec ± 0.5% 30.25 msec ± 0.4% 37.66 msec ± 0.4% 44.21 msec ± 0.5% 34.14 msec ± 0.4% 34.58 msec ± 0.5% 34.46 msec ± 0.5% 33.85 msec ± 0.4% 35.17 msec ± 0.2% 34.99 msec ± 0.4% 94.36 msec ± 0.7% 124.7 msec ± 1.4% 131.1 msec ± 1.3%
2 200 20 4 26.42 msec ± 0.9% 32.30 msec ± 1.1% 40.92 msec ± 0.3% 48.05 msec ± 0.6% 36.76 msec ± 0.5% 37.07 msec ± 0.4% 36.63 msec ± 0.5% 36.59 msec ± 0.9% 37.60 msec ± 0.9% 37.61 msec ± 0.7% 100.8 msec ± 0.9% 142.4 msec ± 1.8% 149.4 msec ± 1.5%
2 300 30 6 27.31 msec ± 0.4% 34.44 msec ± 1.2% 43.05 msec ± 1.0% 51.24 msec ± 0.8% 38.74 msec ± 0.9% 39.17 msec ± 0.8% 38.79 msec ± 0.8% 38.62 msec ± 0.8% 39.82 msec ± 0.6% 39.54 msec ± 0.8% 104.9 msec ± 0.6% 148.9 msec ± 1.5% 162.5 msec ± 2.8%
2 400 40 8 28.01 msec ± 0.6% 35.64 msec ± 1.1% 45.48 msec ± 1.0% 54.65 msec ± 0.4% 41.16 msec ± 0.6% 40.84 msec ± 0.8% 40.81 msec ± 0.7% 40.28 msec ± 0.4% 41.67 msec ± 1.0% 41.37 msec ± 0.5% 109.6 msec ± 0.7% 158.1 msec ± 2.5% 177.8 msec ± 2.6%
2 600 60 12 30.62 msec ± 0.7% 40.02 msec ± 0.5% 51.12 msec ± 1.1% 61.75 msec ± 0.9% 45.46 msec ± 0.4% 45.04 msec ± 1.0% 45.46 msec ± 0.9% 44.91 msec ± 0.9% 46.29 msec ± 0.5% 46.54 msec ± 1.2% 121.0 msec ± 1.0% 174.6 msec ± 1.7% 202.7 msec ± 2.4%
2 800 80 16 31.99 msec ± 0.5% 42.94 msec ± 1.8% 56.19 msec ± 1.2% 68.18 msec ± 1.0% 48.97 msec ± 0.8% 49.16 msec ± 0.6% 49.22 msec ± 1.1% 48.58 msec ± 0.4% 49.77 msec ± 1.2% 49.59 msec ± 1.1% 130.1 msec ± 0.7% 190.5 msec ± 1.5% 223.9 msec ± 2.5%
2 1200 120 24 36.18 msec ± 1.6% 48.21 msec ± 1.3% 66.62 msec ± 1.4% 79.23 msec ± 1.3% 56.57 msec ± 1.5% 56.12 msec ± 1.5% 57.02 msec ± 1.4% 56.43 msec ± 1.2% 57.64 msec ± 1.4% 57.19 msec ± 1.2% 148.2 msec ± 0.9% 221.0 msec ± 2.3% 260.7 msec ± 2.7%
2 1600 160 32 38.98 msec ± 1.1% 55.45 msec ± 2.2% 76.01 msec ± 1.7% 90.85 msec ± 1.0% 64.18 msec ± 1.7% 61.93 msec ± 1.7% 64.27 msec ± 2.1% 64.62 msec ± 1.2% 65.29 msec ± 1.9% 66.38 msec ± 1.7% 166.5 msec ± 1.1% 251.9 msec ± 2.9% 310.2 msec ± 1.5%
2 2400 240 48 46.46 msec ± 4.4% 68.59 msec ± 4.4% 96.66 msec ± 2.0% 120.1 msec ± 1.7% 81.04 msec ± 3.6% 77.15 msec ± 3.1% 83.20 msec ± 3.3% 78.28 msec ± 2.9% 84.52 msec ± 1.7% 80.98 msec ± 3.9% 208.5 msec ± 1.1% 321.6 msec ± 1.6% 399.8 msec ± 3.9%
2 3200 320 64 54.58 msec ± 1.7% 83.09 msec ± 2.4% 118.9 msec ± 1.7% 149.7 msec ± 1.4% 100.2 msec ± 1.0% 95.33 msec ± 3.5% 101.6 msec ± 2.9% 102.2 msec ± 1.6% 100.3 msec ± 0.4% 103.7 msec ± 1.7% 250.7 msec ± 0.7% 410.2 msec ± 1.0% 531.0 msec ± 5.5%
2 4800 480 96 74.82 msec ± 0.5% 119.0 msec ± 1.1% 179.1 msec ± 2.0% 230.1 msec ± 0.3% 149.6 msec ± 2.6% 139.0 msec ± 0.9% 149.8 msec ± 1.1% 146.3 msec ± 2.1% 152.0 msec ± 1.5% 145.9 msec ± 0.3% 372.8 msec ± 1.0% 620.1 msec ± 1.4% 812.1 msec ± 2.8%
2 6400 640 128 106.9 msec ± 2.2% 158.6 msec ± 0.2% 252.7 msec ± 0.7% 340.0 msec ± 0.7% 208.0 msec ± 0.5% 189.0 msec ± 0.2% 209.4 msec ± 0.9% 205.3 msec ± 1.1% 209.3 msec ± 0.7% 210.4 msec ± 0.8% 555.0 msec ± 1.1% 959.5 msec ± 1.4% 1.229 sec ± 6.2%
Geomean: 39.46 msec ± 1.3% 53.84 msec ± 1.5% 72.98 msec ± 1.2% 89.20 msec ± 0.9% 63.24 msec ± 1.2% 61.71 msec ± 1.2% 63.56 msec ± 1.4% 62.68 msec ± 1.1% 64.44 msec ± 1.0% 64.16 msec ± 1.2% 166.7 msec ± 0.9% 250.4 msec ± 1.7% 295.3 msec ± 3.0%

Diversity Score

d n k m RS GS(1) GS(2) GS(3) GS(1-3) GS(1-3,soft) GS(1-3,wide) GS(1-3,narrow) GS(1-3,wi->na) GS(1-3,na->wi) SM(2) SM(4) SM(8)
2 100 10 2 0.819 ± 4.3% 0.897 ± 1.7% 0.879 ± 2.1% 0.837 ± 1.2% 0.894 ± 1.9% 0.909 ± 1.7% 0.865 ± 4.0% 0.906 ± 1.6% 0.906 ± 1.4% 0.912 ± 0.9% 0.913 ± 1.7% 0.913 ± 0.5% 0.913 ± 0.1%
2 200 20 4 0.502 ± 4.3% 0.578 ± 1.4% 0.553 ± 1.4% 0.538 ± 1.0% 0.570 ± 2.0% 0.570 ± 1.7% 0.547 ± 1.5% 0.583 ± 1.3% 0.587 ± 1.3% 0.577 ± 1.5% 0.580 ± 0.9% 0.584 ± 0.6% 0.585 ± 1.3%
2 300 30 6 0.340 ± 5.4% 0.417 ± 1.8% 0.396 ± 1.7% 0.384 ± 1.4% 0.408 ± 0.6% 0.407 ± 0.8% 0.394 ± 0.9% 0.421 ± 1.2% 0.417 ± 1.2% 0.420 ± 1.4% 0.421 ± 0.9% 0.423 ± 0.9% 0.418 ± 1.0%
2 400 40 8 0.267 ± 4.0% 0.337 ± 0.8% 0.324 ± 1.1% 0.313 ± 1.4% 0.333 ± 0.8% 0.321 ± 1.2% 0.317 ± 1.4% 0.345 ± 0.8% 0.340 ± 0.7% 0.340 ± 0.7% 0.347 ± 0.8% 0.344 ± 0.6% 0.346 ± 0.5%
2 600 60 12 0.186 ± 4.3% 0.270 ± 0.7% 0.258 ± 0.8% 0.250 ± 1.0% 0.267 ± 1.2% 0.260 ± 1.3% 0.250 ± 1.6% 0.277 ± 0.7% 0.275 ± 0.6% 0.274 ± 0.3% 0.279 ± 0.9% 0.280 ± 0.5% 0.280 ± 1.0%
2 800 80 16 0.154 ± 3.7% 0.226 ± 1.0% 0.217 ± 0.9% 0.209 ± 1.2% 0.223 ± 0.8% 0.215 ± 1.2% 0.207 ± 1.3% 0.235 ± 0.8% 0.229 ± 1.2% 0.232 ± 0.4% 0.234 ± 0.6% 0.234 ± 0.3% 0.234 ± 0.6%
2 1200 120 24 0.121 ± 2.6% 0.181 ± 0.8% 0.172 ± 0.8% 0.168 ± 0.9% 0.177 ± 0.7% 0.169 ± 0.9% 0.164 ± 1.1% 0.194 ± 0.5% 0.187 ± 0.6% 0.187 ± 0.5% 0.192 ± 0.7% 0.193 ± 0.4% 0.194 ± 0.5%
2 1600 160 32 0.097 ± 3.6% 0.148 ± 1.3% 0.141 ± 0.7% 0.138 ± 1.1% 0.146 ± 1.4% 0.140 ± 2.1% 0.134 ± 1.0% 0.161 ± 0.3% 0.156 ± 0.7% 0.154 ± 0.3% 0.159 ± 0.3% 0.161 ± 0.3% 0.161 ± 1.0%
2 2400 240 48 0.075 ± 3.5% 0.110 ± 1.2% 0.109 ± 1.1% 0.107 ± 0.4% 0.111 ± 0.7% 0.106 ± 2.0% 0.101 ± 1.3% 0.131 ± 0.5% 0.123 ± 0.9% 0.116 ± 1.0% 0.128 ± 0.7% 0.129 ± 0.6% 0.130 ± 0.5%
2 3200 320 64 0.064 ± 1.0% 0.090 ± 2.7% 0.091 ± 1.0% 0.090 ± 1.2% 0.091 ± 1.0% 0.087 ± 1.6% 0.084 ± 0.5% 0.113 ± 0.2% 0.102 ± 0.3% 0.094 ± 1.0% 0.108 ± 0.7% 0.110 ± 0.7% 0.111 ± 0.6%
2 4800 480 96 0.046 ± 1.3% 0.064 ± 0.4% 0.070 ± 1.5% 0.070 ± 0.2% 0.066 ± 2.1% 0.062 ± 1.1% 0.061 ± 1.7% 0.092 ± 0.2% 0.081 ± 1.1% 0.070 ± 0.3% 0.084 ± 0.5% 0.088 ± 0.3% 0.089 ± 0.7%
2 6400 640 128 0.035 ± 1.0% 0.045 ± 1.0% 0.053 ± 0.7% 0.056 ± 1.0% 0.051 ± 0.1% 0.047 ± 0.7% 0.046 ± 2.1% 0.078 ± 0.1% 0.062 ± 0.7% 0.054 ± 0.3% 0.065 ± 0.6% 0.073 ± 0.6% 0.074 ± 0.8%
Geomean: 0.147 ± 3.2% 0.197 ± 1.2% 0.195 ± 1.2% 0.192 ± 1.0% 0.198 ± 1.1% 0.191 ± 1.4% 0.185 ± 1.5% 0.225 ± 0.7% 0.213 ± 0.9% 0.205 ± 0.7% 0.218 ± 0.8% 0.222 ± 0.5% 0.223 ± 0.7%

Constraint Score

d n k m RS GS(1) GS(2) GS(3) GS(1-3) GS(1-3,soft) GS(1-3,wide) GS(1-3,narrow) GS(1-3,wi->na) GS(1-3,na->wi) SM(2) SM(4) SM(8)
2 100 10 2 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 200 20 4 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 300 30 6 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 400 40 8 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 600 60 12 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 800 80 16 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 1200 120 24 0.999 ± 0.1% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 1600 160 32 0.999 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 2400 240 48 0.997 ± 0.1% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 3200 320 64 0.993 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 4800 480 96 0.987 ± 0.1% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
2 6400 640 128 0.976 ± 0.1% 0.999 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 0.997 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%
Mean: 0.996 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0% 1.000 ± 0.0%