Benchmark Results - Problem U3 - Initialization Strategies
Tested Initialization strategies:
name |
class |
params |
|---|---|---|
fast |
InitFast | |
ros(u) |
InitRandomOneShot | uniform=True ignore_constraints=False |
ros(nu) |
InitRandomOneShot | uniform=False ignore_constraints=False |
rb(2) |
InitRandomBatched | b=2 ignore_constraints=False |
rb(4) |
InitRandomBatched | b=4 ignore_constraints=False |
rb(8) |
InitRandomBatched | b=8 ignore_constraints=False |
rb(16) |
InitRandomBatched | b=16 ignore_constraints=False |
e(2) |
InitEager | nc=2 ignore_constraints=False |
e(4) |
InitEager | nc=4 ignore_constraints=False |
e(8) |
InitEager | nc=8 ignore_constraints=False |
e(16) |
InitEager | nc=16 ignore_constraints=False |
Time Duration
d |
n |
k |
m |
fast |
ros(u) |
ros(nu) |
rb(2) |
rb(4) |
rb(8) |
rb(16) |
e(2) |
e(4) |
e(8) |
e(16) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 100 | 10 | 0 | 29.25 μsec ± 6.1% | 32.19 μsec ± 8.5% | 31.44 μsec ± 1.8% | 51.35 μsec ± 6.7% | 75.10 μsec ± 2.4% | 119.1 μsec ± 1.7% | 139.7 μsec ± 1.5% | 321.6 μsec ± 1.8% | 479.5 μsec ± 0.9% | 803.6 μsec ± 0.8% | 1.459 msec ± 2.1% |
| 2 | 200 | 20 | 0 | 53.94 μsec ± 6.5% | 53.92 μsec ± 3.0% | 54.87 μsec ± 1.0% | 77.98 μsec ± 5.6% | 104.5 μsec ± 2.5% | 158.0 μsec ± 2.5% | 246.7 μsec ± 2.2% | 662.3 μsec ± 1.7% | 999.1 μsec ± 1.1% | 1.687 msec ± 2.2% | 3.027 msec ± 2.0% |
| 3 | 300 | 30 | 0 | 90.62 μsec ± 4.4% | 80.13 μsec ± 3.2% | 85.92 μsec ± 3.8% | 106.8 μsec ± 3.1% | 132.1 μsec ± 2.5% | 185.4 μsec ± 1.6% | 289.7 μsec ± 1.5% | 1.062 msec ± 4.5% | 1.582 msec ± 2.0% | 2.631 msec ± 1.2% | 4.765 msec ± 1.4% |
| 4 | 400 | 40 | 0 | 123.1 μsec ± 5.1% | 106.9 μsec ± 2.7% | 110.1 μsec ± 2.4% | 134.8 μsec ± 1.8% | 162.6 μsec ± 1.9% | 217.0 μsec ± 1.7% | 333.3 μsec ± 4.3% | 1.458 msec ± 2.8% | 2.154 msec ± 2.3% | 3.667 msec ± 1.6% | 6.544 msec ± 0.9% |
| 6 | 600 | 60 | 0 | 202.2 μsec ± 2.6% | 170.4 μsec ± 2.9% | 176.2 μsec ± 2.6% | 205.8 μsec ± 2.5% | 238.5 μsec ± 2.1% | 301.3 μsec ± 3.6% | 434.2 μsec ± 2.6% | 2.413 msec ± 2.5% | 3.594 msec ± 2.3% | 6.176 msec ± 2.1% | 11.08 msec ± 1.8% |
| 8 | 800 | 80 | 0 | 263.4 μsec ± 6.1% | 239.4 μsec ± 2.7% | 254.0 μsec ± 5.4% | 314.1 μsec ± 11.5% | 317.9 μsec ± 4.3% | 385.3 μsec ± 4.6% | 529.7 μsec ± 7.0% | 3.343 msec ± 2.4% | 5.293 msec ± 2.4% | 8.791 msec ± 2.9% | 15.67 msec ± 1.2% |
| 12 | 1200 | 120 | 0 | 433.5 μsec ± 1.2% | 423.4 μsec ± 1.7% | 447.4 μsec ± 5.0% | 508.6 μsec ± 9.0% | 527.3 μsec ± 6.7% | 608.3 μsec ± 2.4% | 774.7 μsec ± 6.8% | 5.906 msec ± 3.1% | 9.114 msec ± 2.7% | 15.32 msec ± 2.2% | 27.46 msec ± 1.8% |
| 16 | 1600 | 160 | 0 | 628.7 μsec ± 1.0% | 695.0 μsec ± 5.6% | 721.3 μsec ± 8.6% | 827.0 μsec ± 6.7% | 787.1 μsec ± 8.7% | 905.9 μsec ± 3.2% | 1.143 msec ± 5.1% | 8.991 msec ± 3.6% | 14.07 msec ± 1.8% | 23.24 msec ± 1.3% | 41.35 msec ± 2.1% |
| 24 | 2400 | 240 | 0 | 1.097 msec ± 1.5% | 1.355 msec ± 0.9% | 1.421 msec ± 15.6% | 1.506 msec ± 5.4% | 1.536 msec ± 4.5% | 1.829 msec ± 6.6% | 1.906 msec ± 3.4% | 15.15 msec ± 2.4% | 25.43 msec ± 1.2% | 43.86 msec ± 1.7% | 76.11 msec ± 0.7% |
| 32 | 3200 | 320 | 0 | 1.657 msec ± 1.7% | 2.572 msec ± 2.9% | 2.509 msec ± 1.8% | 2.863 msec ± 3.0% | 2.750 msec ± 3.4% | 2.938 msec ± 3.3% | 3.092 msec ± 1.7% | 23.79 msec ± 0.4% | 36.64 msec ± 0.3% | 62.65 msec ± 0.1% | 112.7 msec ± 0.5% |
| 48 | 4800 | 480 | 0 | 3.151 msec ± 0.7% | 6.752 msec ± 2.9% | 6.732 msec ± 2.3% | 7.282 msec ± 1.9% | 7.490 msec ± 2.5% | 7.429 msec ± 0.5% | 7.922 msec ± 3.1% | 46.64 msec ± 0.6% | 75.77 msec ± 0.7% | 135.2 msec ± 0.4% | 255.0 msec ± 2.3% |
| 64 | 6400 | 640 | 0 | 5.178 msec ± 0.8% | 15.16 msec ± 0.4% | 14.73 msec ± 1.4% | 17.43 msec ± 3.3% | 18.10 msec ± 1.0% | 18.37 msec ± 6.0% | 18.24 msec ± 0.1% | 79.60 msec ± 1.5% | 131.5 msec ± 1.4% | 257.6 msec ± 0.8% | 515.8 msec ± 0.4% |
| Geomean: | 374.4 μsec ± 3.1% | 447.0 μsec ± 3.1% | 457.2 μsec ± 4.2% | 555.2 μsec ± 5.0% | 616.9 μsec ± 3.5% | 757.2 μsec ± 3.1% | 955.1 μsec ± 3.3% | 4.895 msec ± 2.3% | 7.597 msec ± 1.6% | 13.04 msec ± 1.4% | 23.65 msec ± 1.4% |
Diversity Score
d |
n |
k |
m |
fast |
ros(u) |
ros(nu) |
rb(2) |
rb(4) |
rb(8) |
rb(16) |
e(2) |
e(4) |
e(8) |
e(16) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 100 | 10 | 0 | 0.002 ± 0.0% | 0.126 ± 32.1% | 0.467 ± 15.6% | 0.261 ± 17.5% | 0.388 ± 34.8% | 0.746 ± 12.2% | 0.744 ± 8.1% | 0.892 ± 5.2% | 0.912 ± 3.1% | 0.917 ± 2.3% | 0.939 ± 1.7% |
| 2 | 200 | 20 | 0 | 0.028 ± 0.0% | 0.513 ± 10.6% | 1.114 ± 11.0% | 1.081 ± 9.2% | 1.292 ± 10.0% | 1.386 ± 11.8% | 1.599 ± 9.5% | 1.765 ± 1.2% | 1.880 ± 2.7% | 1.915 ± 2.3% | 1.959 ± 1.3% |
| 3 | 300 | 30 | 0 | 0.111 ± 0.0% | 1.015 ± 10.9% | 1.577 ± 5.9% | 1.653 ± 4.3% | 2.003 ± 5.8% | 2.070 ± 6.2% | 2.082 ± 10.6% | 2.734 ± 5.7% | 2.910 ± 1.7% | 3.031 ± 1.0% | 3.107 ± 1.4% |
| 4 | 400 | 40 | 0 | 0.315 ± 0.0% | 1.579 ± 5.8% | 2.117 ± 7.4% | 2.535 ± 4.4% | 2.986 ± 8.2% | 3.059 ± 6.2% | 2.780 ± 6.0% | 3.528 ± 3.1% | 3.886 ± 1.4% | 3.996 ± 1.2% | 4.098 ± 1.3% |
| 6 | 600 | 60 | 0 | 0.703 ± 0.0% | 2.697 ± 4.0% | 3.230 ± 4.1% | 3.881 ± 6.1% | 4.292 ± 3.3% | 4.368 ± 2.1% | 4.305 ± 2.6% | 4.762 ± 2.7% | 5.456 ± 1.2% | 5.602 ± 0.5% | 5.675 ± 0.5% |
| 8 | 800 | 80 | 0 | 1.274 ± 0.0% | 3.637 ± 3.3% | 4.219 ± 3.0% | 5.010 ± 2.5% | 5.383 ± 1.5% | 5.519 ± 2.8% | 5.233 ± 2.0% | 5.755 ± 2.2% | 6.682 ± 0.7% | 6.890 ± 0.4% | 7.010 ± 0.4% |
| 12 | 1200 | 120 | 0 | 2.603 ± 0.0% | 5.526 ± 3.2% | 6.072 ± 2.0% | 6.932 ± 1.4% | 7.446 ± 1.5% | 7.525 ± 0.9% | 7.407 ± 1.9% | 7.295 ± 1.8% | 8.877 ± 0.9% | 9.295 ± 0.2% | 9.454 ± 0.4% |
| 16 | 1600 | 160 | 0 | 3.733 ± 0.0% | 7.258 ± 0.5% | 7.845 ± 1.1% | 8.672 ± 1.8% | 9.276 ± 0.8% | 9.337 ± 1.2% | 9.192 ± 0.9% | 8.610 ± 1.4% | 10.614 ± 0.4% | 11.330 ± 0.4% | 11.534 ± 0.5% |
| 24 | 2400 | 240 | 0 | 6.322 ± 0.0% | 10.171 ± 0.6% | 10.472 ± 0.4% | 11.597 ± 0.5% | 12.222 ± 0.6% | 12.259 ± 0.5% | 12.213 ± 0.8% | 10.668 ± 0.3% | 13.083 ± 0.6% | 14.486 ± 0.4% | 14.799 ± 0.3% |
| 32 | 3200 | 320 | 0 | 8.628 ± 0.0% | 12.661 ± 0.5% | 12.976 ± 0.8% | 14.020 ± 0.6% | 14.551 ± 0.5% | 14.752 ± 0.5% | 14.607 ± 0.3% | 12.591 ± 0.3% | 15.027 ± 0.3% | 17.034 ± 0.3% | 17.505 ± 0.1% |
| 48 | 4800 | 480 | 0 | 12.787 ± 0.0% | 16.935 ± 0.2% | 17.314 ± 0.3% | 18.314 ± 0.4% | 18.863 ± 0.2% | 19.116 ± 0.3% | 18.889 ± 0.2% | 16.158 ± 0.4% | 18.343 ± 0.5% | 20.939 ± 0.2% | 22.113 ± 0.1% |
| 64 | 6400 | 640 | 0 | 16.375 ± 0.0% | 20.762 ± 0.2% | 20.854 ± 0.1% | 21.935 ± 0.1% | 22.549 ± 0.2% | 22.767 ± 0.5% | 22.582 ± 0.2% | 19.304 ± 0.2% | 21.344 ± 0.4% | 23.926 ± 0.2% | 25.827 ± 0.1% |
| Geomean: | 0.877 ± 0.0% | 3.328 ± 5.8% | 4.418 ± 4.4% | 4.602 ± 4.0% | 5.166 ± 5.4% | 5.560 ± 3.8% | 5.522 ± 3.6% | 5.666 ± 2.1% | 6.444 ± 1.2% | 6.851 ± 0.8% | 7.048 ± 0.7% |