Benchmark Results - Problem U2 - Initialization Strategies
Tested Initialization strategies:
name |
class |
params |
|---|---|---|
fast |
InitFast | |
ros(u) |
InitRandomOneShot | uniform=True ignore_constraints=False |
ros(nu) |
InitRandomOneShot | uniform=False ignore_constraints=False |
rb(2) |
InitRandomBatched | b=2 ignore_constraints=False |
rb(4) |
InitRandomBatched | b=4 ignore_constraints=False |
rb(8) |
InitRandomBatched | b=8 ignore_constraints=False |
rb(16) |
InitRandomBatched | b=16 ignore_constraints=False |
e(2) |
InitEager | nc=2 ignore_constraints=False |
e(4) |
InitEager | nc=4 ignore_constraints=False |
e(8) |
InitEager | nc=8 ignore_constraints=False |
e(16) |
InitEager | nc=16 ignore_constraints=False |
Time Duration
d |
n |
k |
m |
fast |
ros(u) |
ros(nu) |
rb(2) |
rb(4) |
rb(8) |
rb(16) |
e(2) |
e(4) |
e(8) |
e(16) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 100 | 10 | 0 | 29.04 μsec ± 2.3% | 30.85 μsec ± 1.8% | 31.04 μsec ± 1.6% | 50.15 μsec ± 4.4% | 75.29 μsec ± 3.5% | 117.8 μsec ± 2.1% | 140.5 μsec ± 1.4% | 323.7 μsec ± 2.5% | 486.6 μsec ± 2.4% | 815.2 μsec ± 2.8% | 1.460 msec ± 2.0% |
| 2 | 200 | 20 | 0 | 53.52 μsec ± 4.2% | 55.23 μsec ± 2.5% | 55.33 μsec ± 1.3% | 77.38 μsec ± 2.7% | 103.7 μsec ± 1.9% | 151.8 μsec ± 2.5% | 246.8 μsec ± 1.9% | 671.6 μsec ± 7.4% | 1.008 msec ± 1.5% | 1.690 msec ± 1.4% | 3.109 msec ± 1.8% |
| 3 | 300 | 30 | 0 | 82.83 μsec ± 1.7% | 80.73 μsec ± 3.9% | 86.85 μsec ± 6.4% | 107.3 μsec ± 4.2% | 138.3 μsec ± 4.2% | 185.1 μsec ± 4.9% | 288.2 μsec ± 3.4% | 1.056 msec ± 1.7% | 1.585 msec ± 3.5% | 2.688 msec ± 1.2% | 4.947 msec ± 2.1% |
| 4 | 400 | 40 | 0 | 108.2 μsec ± 4.7% | 108.3 μsec ± 2.0% | 113.0 μsec ± 4.5% | 138.5 μsec ± 1.7% | 176.6 μsec ± 5.9% | 224.4 μsec ± 4.2% | 341.3 μsec ± 4.1% | 1.479 msec ± 2.5% | 2.269 msec ± 2.7% | 3.733 msec ± 0.9% | 6.854 msec ± 0.5% |
| 6 | 600 | 60 | 0 | 173.2 μsec ± 2.3% | 176.5 μsec ± 4.1% | 181.9 μsec ± 2.1% | 212.4 μsec ± 3.2% | 237.7 μsec ± 1.9% | 315.5 μsec ± 3.1% | 433.2 μsec ± 3.9% | 2.511 msec ± 4.7% | 3.681 msec ± 2.8% | 6.371 msec ± 2.0% | 11.43 msec ± 1.3% |
| 8 | 800 | 80 | 0 | 237.0 μsec ± 3.9% | 240.1 μsec ± 5.4% | 262.0 μsec ± 4.5% | 299.0 μsec ± 8.2% | 326.8 μsec ± 5.0% | 392.8 μsec ± 8.7% | 518.5 μsec ± 2.7% | 3.515 msec ± 2.3% | 5.300 msec ± 2.3% | 9.050 msec ± 1.4% | 16.43 msec ± 2.1% |
| 12 | 1200 | 120 | 0 | 399.2 μsec ± 2.1% | 442.5 μsec ± 2.1% | 437.5 μsec ± 2.5% | 510.7 μsec ± 10.8% | 571.4 μsec ± 14.3% | 623.2 μsec ± 2.5% | 801.3 μsec ± 6.9% | 5.954 msec ± 2.9% | 9.268 msec ± 2.2% | 15.55 msec ± 1.5% | 27.68 msec ± 1.0% |
| 16 | 1600 | 160 | 0 | 602.7 μsec ± 2.7% | 724.8 μsec ± 4.2% | 694.0 μsec ± 10.4% | 778.5 μsec ± 8.7% | 783.2 μsec ± 3.5% | 936.9 μsec ± 6.6% | 1.048 msec ± 4.5% | 8.588 msec ± 1.5% | 13.40 msec ± 2.8% | 22.76 msec ± 2.9% | 41.71 msec ± 2.5% |
| 24 | 2400 | 240 | 0 | 1.048 msec ± 2.7% | 1.454 msec ± 7.8% | 1.429 msec ± 7.3% | 1.492 msec ± 11.7% | 1.584 msec ± 4.7% | 1.699 msec ± 2.9% | 1.928 msec ± 6.7% | 15.56 msec ± 2.9% | 23.36 msec ± 6.1% | 40.08 msec ± 5.0% | 69.67 msec ± 4.2% |
| 32 | 3200 | 320 | 0 | 1.601 msec ± 0.2% | 2.594 msec ± 2.1% | 2.649 msec ± 10.4% | 2.801 msec ± 3.8% | 2.843 msec ± 2.1% | 2.914 msec ± 3.0% | 3.101 msec ± 1.1% | 23.86 msec ± 0.3% | 36.76 msec ± 0.5% | 62.36 msec ± 0.4% | 112.0 msec ± 0.3% |
| 48 | 4800 | 480 | 0 | 3.114 msec ± 0.4% | 6.520 msec ± 2.7% | 6.784 msec ± 2.6% | 7.283 msec ± 2.5% | 7.335 msec ± 0.4% | 7.380 msec ± 1.6% | 8.987 msec ± 12.9% | 46.69 msec ± 2.3% | 74.76 msec ± 0.4% | 134.5 msec ± 0.3% | 247.4 msec ± 0.6% |
| 64 | 6400 | 640 | 0 | 5.089 msec ± 0.3% | 15.00 msec ± 0.4% | 14.67 msec ± 1.2% | 17.08 msec ± 1.5% | 17.79 msec ± 0.6% | 18.18 msec ± 2.4% | 18.18 msec ± 0.9% | 82.80 msec ± 0.6% | 131.9 msec ± 0.2% | 253.0 msec ± 0.9% | 500.2 msec ± 0.4% |
| Geomean: | 352.3 μsec ± 2.3% | 453.0 μsec ± 3.3% | 460.9 μsec ± 4.5% | 549.4 μsec ± 5.2% | 629.8 μsec ± 4.0% | 757.5 μsec ± 3.7% | 962.0 μsec ± 4.2% | 4.957 msec ± 2.6% | 7.584 msec ± 2.3% | 13.03 msec ± 1.7% | 23.75 msec ± 1.6% |
Diversity Score
d |
n |
k |
m |
fast |
ros(u) |
ros(nu) |
rb(2) |
rb(4) |
rb(8) |
rb(16) |
e(2) |
e(4) |
e(8) |
e(16) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 100 | 10 | 0 | 0.014 ± 0.0% | 0.139 ± 26.4% | 0.216 ± 26.9% | 0.186 ± 19.4% | 0.278 ± 20.8% | 0.402 ± 8.7% | 0.402 ± 4.7% | 0.429 ± 3.4% | 0.438 ± 3.3% | 0.447 ± 1.6% | 0.450 ± 0.8% |
| 2 | 200 | 20 | 0 | 0.091 ± 0.0% | 0.391 ± 9.2% | 0.540 ± 13.5% | 0.566 ± 10.2% | 0.696 ± 6.9% | 0.787 ± 6.4% | 0.840 ± 4.8% | 0.969 ± 3.0% | 0.991 ± 1.6% | 1.029 ± 1.5% | 1.031 ± 1.5% |
| 3 | 300 | 30 | 0 | 0.269 ± 0.0% | 0.664 ± 7.2% | 0.783 ± 3.9% | 0.915 ± 3.1% | 1.063 ± 5.7% | 1.110 ± 3.7% | 1.170 ± 4.5% | 1.314 ± 3.1% | 1.424 ± 1.0% | 1.458 ± 1.4% | 1.502 ± 0.8% |
| 4 | 400 | 40 | 0 | 0.346 ± 0.0% | 0.971 ± 5.9% | 1.103 ± 3.3% | 1.294 ± 5.3% | 1.479 ± 4.0% | 1.501 ± 5.0% | 1.467 ± 4.0% | 1.669 ± 2.3% | 1.842 ± 1.4% | 1.900 ± 1.4% | 1.922 ± 0.7% |
| 6 | 600 | 60 | 0 | 0.702 ± 0.0% | 1.427 ± 4.7% | 1.558 ± 2.8% | 1.776 ± 3.9% | 1.936 ± 2.2% | 1.988 ± 1.7% | 1.947 ± 2.1% | 2.142 ± 1.0% | 2.432 ± 0.8% | 2.508 ± 1.1% | 2.554 ± 1.2% |
| 8 | 800 | 80 | 0 | 1.085 ± 0.0% | 1.871 ± 2.2% | 1.960 ± 2.5% | 2.194 ± 1.6% | 2.354 ± 1.7% | 2.425 ± 2.4% | 2.373 ± 2.4% | 2.579 ± 1.8% | 2.915 ± 1.0% | 3.063 ± 0.5% | 3.121 ± 0.6% |
| 12 | 1200 | 120 | 0 | 1.779 ± 0.0% | 2.647 ± 2.0% | 2.772 ± 1.4% | 3.094 ± 0.8% | 3.229 ± 1.3% | 3.285 ± 1.0% | 3.216 ± 1.4% | 3.236 ± 1.1% | 3.782 ± 0.5% | 3.978 ± 0.3% | 4.034 ± 0.5% |
| 16 | 1600 | 160 | 0 | 2.340 ± 0.0% | 3.337 ± 0.6% | 3.427 ± 0.7% | 3.719 ± 1.4% | 3.878 ± 0.8% | 3.914 ± 0.7% | 3.868 ± 1.6% | 3.739 ± 0.9% | 4.393 ± 0.4% | 4.706 ± 0.3% | 4.806 ± 0.2% |
| 24 | 2400 | 240 | 0 | 3.427 ± 0.0% | 4.518 ± 0.7% | 4.552 ± 0.5% | 4.889 ± 0.7% | 5.085 ± 0.5% | 5.119 ± 0.9% | 5.064 ± 0.9% | 4.707 ± 0.6% | 5.427 ± 0.3% | 5.962 ± 0.3% | 6.075 ± 0.2% |
| 32 | 3200 | 320 | 0 | 4.400 ± 0.0% | 5.485 ± 0.4% | 5.534 ± 0.4% | 5.899 ± 0.4% | 6.045 ± 0.5% | 6.119 ± 0.4% | 6.058 ± 0.4% | 5.510 ± 0.5% | 6.224 ± 0.3% | 6.934 ± 0.3% | 7.117 ± 0.2% |
| 48 | 4800 | 480 | 0 | 6.022 ± 0.0% | 7.171 ± 0.1% | 7.224 ± 0.1% | 7.584 ± 0.1% | 7.753 ± 0.2% | 7.788 ± 0.1% | 7.746 ± 0.4% | 6.944 ± 0.2% | 7.583 ± 0.1% | 8.462 ± 0.1% | 8.869 ± 0.0% |
| 64 | 6400 | 640 | 0 | 7.476 ± 0.0% | 8.656 ± 0.1% | 8.683 ± 0.2% | 9.057 ± 0.2% | 9.219 ± 0.1% | 9.276 ± 0.3% | 9.207 ± 0.2% | 8.289 ± 0.2% | 8.876 ± 0.1% | 9.687 ± 0.1% | 10.327 ± 0.1% |
| Geomean: | 0.895 ± 0.0% | 1.813 ± 5.1% | 2.020 ± 4.6% | 2.173 ± 4.0% | 2.409 ± 3.8% | 2.545 ± 2.6% | 2.542 ± 2.3% | 2.590 ± 1.5% | 2.864 ± 0.9% | 3.039 ± 0.7% | 3.110 ± 0.6% |