Benchmark Results - Problem U1 - Initialization Strategies
Tested Initialization strategies:
name |
class |
params |
|---|---|---|
fast |
InitFast | |
ros(u) |
InitRandomOneShot | uniform=True ignore_constraints=False |
ros(nu) |
InitRandomOneShot | uniform=False ignore_constraints=False |
rb(2) |
InitRandomBatched | b=2 ignore_constraints=False |
rb(4) |
InitRandomBatched | b=4 ignore_constraints=False |
rb(8) |
InitRandomBatched | b=8 ignore_constraints=False |
rb(16) |
InitRandomBatched | b=16 ignore_constraints=False |
e(2) |
InitEager | nc=2 ignore_constraints=False |
e(4) |
InitEager | nc=4 ignore_constraints=False |
e(8) |
InitEager | nc=8 ignore_constraints=False |
e(16) |
InitEager | nc=16 ignore_constraints=False |
Time Duration
d |
n |
k |
m |
fast |
ros(u) |
ros(nu) |
rb(2) |
rb(4) |
rb(8) |
rb(16) |
e(2) |
e(4) |
e(8) |
e(16) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 100 | 10 | 0 | 29.04 μsec ± 6.4% | 30.25 μsec ± 3.4% | 30.50 μsec ± 0.7% | 50.00 μsec ± 4.7% | 74.42 μsec ± 1.2% | 117.3 μsec ± 0.9% | 138.8 μsec ± 2.0% | 323.5 μsec ± 3.9% | 486.0 μsec ± 2.0% | 799.9 μsec ± 1.6% | 1.444 msec ± 1.3% |
| 2 | 200 | 20 | 0 | 55.33 μsec ± 4.0% | 55.52 μsec ± 3.2% | 54.40 μsec ± 1.3% | 76.75 μsec ± 2.6% | 101.9 μsec ± 2.0% | 150.4 μsec ± 2.3% | 245.5 μsec ± 2.2% | 664.0 μsec ± 1.0% | 1.004 msec ± 3.9% | 1.674 msec ± 1.8% | 3.005 msec ± 1.8% |
| 3 | 300 | 30 | 0 | 90.88 μsec ± 8.3% | 82.83 μsec ± 5.8% | 84.52 μsec ± 6.2% | 118.6 μsec ± 11.0% | 136.2 μsec ± 6.6% | 182.9 μsec ± 6.2% | 284.3 μsec ± 3.1% | 1.027 msec ± 2.0% | 1.568 msec ± 3.7% | 2.674 msec ± 3.0% | 4.882 msec ± 1.4% |
| 4 | 400 | 40 | 0 | 117.5 μsec ± 3.5% | 110.0 μsec ± 5.7% | 115.6 μsec ± 8.1% | 137.4 μsec ± 3.3% | 161.3 μsec ± 5.5% | 227.2 μsec ± 4.4% | 334.5 μsec ± 5.5% | 1.497 msec ± 2.6% | 2.213 msec ± 3.1% | 3.684 msec ± 2.5% | 6.676 msec ± 1.1% |
| 6 | 600 | 60 | 0 | 183.5 μsec ± 5.5% | 173.3 μsec ± 5.8% | 180.3 μsec ± 2.4% | 212.0 μsec ± 4.1% | 236.1 μsec ± 5.6% | 303.7 μsec ± 5.2% | 426.9 μsec ± 3.5% | 2.388 msec ± 3.3% | 3.674 msec ± 2.2% | 6.029 msec ± 1.1% | 11.00 msec ± 1.0% |
| 8 | 800 | 80 | 0 | 247.5 μsec ± 3.2% | 250.0 μsec ± 9.1% | 260.3 μsec ± 4.4% | 295.4 μsec ± 2.8% | 318.4 μsec ± 1.9% | 403.7 μsec ± 10.6% | 517.5 μsec ± 3.5% | 3.449 msec ± 1.9% | 5.186 msec ± 1.4% | 8.596 msec ± 1.0% | 15.51 msec ± 1.3% |
| 12 | 1200 | 120 | 0 | 407.2 μsec ± 2.4% | 436.3 μsec ± 4.0% | 458.6 μsec ± 4.2% | 532.6 μsec ± 8.8% | 519.7 μsec ± 3.0% | 621.5 μsec ± 8.0% | 771.7 μsec ± 8.3% | 5.823 msec ± 4.3% | 8.765 msec ± 3.0% | 14.62 msec ± 1.9% | 26.61 msec ± 1.2% |
| 16 | 1600 | 160 | 0 | 604.5 μsec ± 3.9% | 671.8 μsec ± 15.3% | 812.7 μsec ± 20.0% | 800.5 μsec ± 14.7% | 903.2 μsec ± 12.0% | 945.1 μsec ± 10.7% | 1.163 msec ± 8.0% | 8.870 msec ± 2.3% | 13.72 msec ± 3.6% | 22.72 msec ± 4.7% | 39.90 msec ± 1.9% |
| 24 | 2400 | 240 | 0 | 1.082 msec ± 0.8% | 1.404 msec ± 7.5% | 1.454 msec ± 5.3% | 1.511 msec ± 5.4% | 1.573 msec ± 3.2% | 1.775 msec ± 5.3% | 2.169 msec ± 6.1% | 16.22 msec ± 2.5% | 23.44 msec ± 4.9% | 42.23 msec ± 4.0% | 66.86 msec ± 1.1% |
| 32 | 3200 | 320 | 0 | 1.662 msec ± 0.4% | 2.776 msec ± 5.8% | 2.620 msec ± 4.9% | 2.622 msec ± 1.3% | 3.033 msec ± 6.6% | 3.000 msec ± 2.6% | 3.298 msec ± 5.8% | 24.09 msec ± 1.3% | 36.51 msec ± 1.8% | 62.38 msec ± 2.4% | 109.2 msec ± 2.0% |
| 48 | 4800 | 480 | 0 | 3.162 msec ± 0.4% | 6.559 msec ± 0.6% | 6.419 msec ± 0.9% | 6.852 msec ± 1.7% | 7.036 msec ± 0.5% | 7.350 msec ± 6.6% | 7.655 msec ± 0.5% | 50.13 msec ± 1.9% | 80.53 msec ± 2.5% | 131.6 msec ± 2.1% | 236.7 msec ± 1.0% |
| 64 | 6400 | 640 | 0 | 5.257 msec ± 0.4% | 14.98 msec ± 0.5% | 14.85 msec ± 2.6% | 15.57 msec ± 0.4% | 16.44 msec ± 1.4% | 16.66 msec ± 1.2% | 16.84 msec ± 0.8% | 94.62 msec ± 1.8% | 148.3 msec ± 0.8% | 256.5 msec ± 0.4% | 470.8 msec ± 0.8% |
| Geomean: | 365.8 μsec ± 3.2% | 452.8 μsec ± 5.5% | 465.3 μsec ± 5.0% | 546.3 μsec ± 5.0% | 620.3 μsec ± 4.1% | 755.2 μsec ± 5.3% | 957.3 μsec ± 4.1% | 5.027 msec ± 2.4% | 7.641 msec ± 2.7% | 12.85 msec ± 2.2% | 22.90 msec ± 1.3% |
Diversity Score
d |
n |
k |
m |
fast |
ros(u) |
ros(nu) |
rb(2) |
rb(4) |
rb(8) |
rb(16) |
e(2) |
e(4) |
e(8) |
e(16) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 100 | 10 | 0 | 0.004 ± 0.0% | 0.031 ± 20.5% | 0.046 ± 17.3% | 0.032 ± 37.8% | 0.054 ± 18.6% | 0.087 ± 6.3% | 0.088 ± 4.8% | 0.093 ± 1.9% | 0.096 ± 1.9% | 0.098 ± 2.2% | 0.099 ± 1.0% |
| 2 | 200 | 20 | 0 | 0.029 ± 0.0% | 0.104 ± 4.8% | 0.106 ± 11.6% | 0.121 ± 6.9% | 0.137 ± 16.9% | 0.156 ± 8.5% | 0.191 ± 5.2% | 0.203 ± 1.8% | 0.209 ± 2.1% | 0.218 ± 1.8% | 0.220 ± 1.7% |
| 3 | 300 | 30 | 0 | 0.090 ± 0.0% | 0.191 ± 4.4% | 0.190 ± 5.3% | 0.214 ± 6.2% | 0.225 ± 3.3% | 0.247 ± 5.0% | 0.259 ± 2.7% | 0.306 ± 3.0% | 0.324 ± 1.8% | 0.333 ± 1.6% | 0.341 ± 1.3% |
| 4 | 400 | 40 | 0 | 0.167 ± 0.0% | 0.265 ± 3.3% | 0.270 ± 5.0% | 0.298 ± 3.4% | 0.324 ± 4.6% | 0.349 ± 3.8% | 0.349 ± 3.7% | 0.397 ± 1.9% | 0.426 ± 1.8% | 0.440 ± 1.3% | 0.445 ± 1.2% |
| 6 | 600 | 60 | 0 | 0.290 ± 0.0% | 0.413 ± 2.0% | 0.427 ± 2.5% | 0.461 ± 2.1% | 0.495 ± 2.6% | 0.510 ± 3.2% | 0.508 ± 2.5% | 0.554 ± 1.2% | 0.602 ± 0.7% | 0.616 ± 0.5% | 0.630 ± 0.7% |
| 8 | 800 | 80 | 0 | 0.394 ± 0.0% | 0.545 ± 1.8% | 0.553 ± 1.6% | 0.599 ± 1.1% | 0.627 ± 1.2% | 0.650 ± 1.6% | 0.626 ± 1.5% | 0.679 ± 0.8% | 0.739 ± 1.0% | 0.770 ± 0.5% | 0.783 ± 0.6% |
| 12 | 1200 | 120 | 0 | 0.652 ± 0.0% | 0.777 ± 0.8% | 0.783 ± 1.2% | 0.839 ± 1.5% | 0.871 ± 1.7% | 0.888 ± 0.8% | 0.876 ± 0.9% | 0.884 ± 0.7% | 0.991 ± 0.9% | 1.034 ± 0.4% | 1.052 ± 0.3% |
| 16 | 1600 | 160 | 0 | 0.833 ± 0.0% | 0.974 ± 0.7% | 0.983 ± 0.7% | 1.047 ± 1.2% | 1.081 ± 0.8% | 1.094 ± 1.2% | 1.075 ± 1.2% | 1.064 ± 0.5% | 1.186 ± 0.5% | 1.242 ± 0.3% | 1.265 ± 0.2% |
| 24 | 2400 | 240 | 0 | 1.221 ± 0.0% | 1.323 ± 0.2% | 1.328 ± 0.3% | 1.390 ± 0.2% | 1.432 ± 0.3% | 1.434 ± 0.5% | 1.424 ± 0.5% | 1.358 ± 0.2% | 1.499 ± 0.2% | 1.598 ± 0.1% | 1.628 ± 0.1% |
| 32 | 3200 | 320 | 0 | 1.495 ± 0.0% | 1.614 ± 0.4% | 1.620 ± 0.2% | 1.684 ± 0.5% | 1.725 ± 0.2% | 1.733 ± 0.3% | 1.719 ± 0.5% | 1.617 ± 0.2% | 1.762 ± 0.4% | 1.887 ± 0.2% | 1.930 ± 0.1% |
| 48 | 4800 | 480 | 0 | 2.004 ± 0.0% | 2.105 ± 0.2% | 2.115 ± 0.2% | 2.184 ± 0.3% | 2.222 ± 0.3% | 2.226 ± 0.2% | 2.213 ± 0.1% | 2.070 ± 0.3% | 2.202 ± 0.2% | 2.359 ± 0.1% | 2.436 ± 0.1% |
| 64 | 6400 | 640 | 0 | 2.424 ± 0.0% | 2.532 ± 0.0% | 2.533 ± 0.2% | 2.611 ± 0.1% | 2.638 ± 0.1% | 2.649 ± 0.0% | 2.634 ± 0.1% | 2.450 ± 0.1% | 2.584 ± 0.1% | 2.731 ± 0.1% | 2.863 ± 0.0% |
| Geomean: | 0.313 ± 0.0% | 0.511 ± 3.2% | 0.533 ± 3.9% | 0.552 ± 4.7% | 0.603 ± 4.3% | 0.649 ± 2.6% | 0.657 ± 2.0% | 0.676 ± 1.1% | 0.727 ± 1.0% | 0.760 ± 0.8% | 0.776 ± 0.6% |