Benchmark Results - Problem U4 - Initialization Strategies
Tested Initialization strategies:
name |
class |
params |
|---|---|---|
fast |
InitFast | |
ros(u) |
InitRandomOneShot | uniform=True ignore_constraints=False |
ros(nu) |
InitRandomOneShot | uniform=False ignore_constraints=False |
rb(2) |
InitRandomBatched | b=2 ignore_constraints=False |
rb(4) |
InitRandomBatched | b=4 ignore_constraints=False |
rb(8) |
InitRandomBatched | b=8 ignore_constraints=False |
rb(16) |
InitRandomBatched | b=16 ignore_constraints=False |
e(2) |
InitEager | nc=2 ignore_constraints=False |
e(4) |
InitEager | nc=4 ignore_constraints=False |
e(8) |
InitEager | nc=8 ignore_constraints=False |
e(16) |
InitEager | nc=16 ignore_constraints=False |
Time Duration
d |
n |
k |
m |
fast |
ros(u) |
ros(nu) |
rb(2) |
rb(4) |
rb(8) |
rb(16) |
e(2) |
e(4) |
e(8) |
e(16) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 100 | 10 | 0 | 29.98 μsec ± 1.6% | 31.38 μsec ± 3.0% | 32.13 μsec ± 3.0% | 54.40 μsec ± 6.1% | 81.92 μsec ± 5.4% | 122.3 μsec ± 3.8% | 143.5 μsec ± 3.5% | 327.3 μsec ± 1.4% | 488.9 μsec ± 3.2% | 814.2 μsec ± 2.2% | 1.456 msec ± 3.6% |
| 2 | 200 | 20 | 0 | 51.15 μsec ± 2.4% | 54.69 μsec ± 1.9% | 55.94 μsec ± 6.8% | 80.77 μsec ± 3.9% | 108.1 μsec ± 3.8% | 156.2 μsec ± 3.4% | 251.0 μsec ± 2.4% | 681.6 μsec ± 2.8% | 1.015 msec ± 1.8% | 1.688 msec ± 2.5% | 3.058 msec ± 2.3% |
| 3 | 300 | 30 | 0 | 76.48 μsec ± 3.1% | 82.96 μsec ± 5.5% | 84.81 μsec ± 3.0% | 107.0 μsec ± 3.5% | 136.9 μsec ± 4.6% | 188.8 μsec ± 2.9% | 293.8 μsec ± 5.9% | 1.054 msec ± 2.8% | 1.603 msec ± 3.2% | 2.636 msec ± 2.3% | 4.874 msec ± 1.5% |
| 4 | 400 | 40 | 0 | 104.6 μsec ± 3.7% | 107.8 μsec ± 2.5% | 119.3 μsec ± 5.1% | 147.5 μsec ± 7.2% | 166.1 μsec ± 4.2% | 229.7 μsec ± 3.0% | 346.3 μsec ± 3.6% | 1.445 msec ± 1.7% | 2.154 msec ± 2.6% | 3.634 msec ± 2.8% | 6.573 msec ± 1.0% |
| 6 | 600 | 60 | 0 | 176.9 μsec ± 2.5% | 172.4 μsec ± 1.5% | 179.9 μsec ± 3.6% | 213.0 μsec ± 5.7% | 246.3 μsec ± 6.8% | 309.5 μsec ± 5.8% | 440.0 μsec ± 6.6% | 2.404 msec ± 4.8% | 3.671 msec ± 3.1% | 6.008 msec ± 3.3% | 10.72 msec ± 0.6% |
| 8 | 800 | 80 | 0 | 274.3 μsec ± 2.5% | 243.4 μsec ± 6.6% | 253.9 μsec ± 3.9% | 280.6 μsec ± 3.8% | 336.3 μsec ± 3.2% | 398.1 μsec ± 4.3% | 530.1 μsec ± 5.7% | 3.441 msec ± 2.7% | 5.125 msec ± 2.5% | 8.594 msec ± 1.4% | 15.41 msec ± 1.7% |
| 12 | 1200 | 120 | 0 | 422.5 μsec ± 1.6% | 421.9 μsec ± 3.3% | 436.6 μsec ± 3.9% | 499.3 μsec ± 4.5% | 524.4 μsec ± 4.1% | 613.8 μsec ± 8.8% | 764.0 μsec ± 4.8% | 5.812 msec ± 2.9% | 8.587 msec ± 2.0% | 14.78 msec ± 2.9% | 25.81 msec ± 2.7% |
| 16 | 1600 | 160 | 0 | 644.1 μsec ± 1.8% | 687.6 μsec ± 13.4% | 695.6 μsec ± 4.4% | 748.0 μsec ± 9.1% | 772.4 μsec ± 2.6% | 887.5 μsec ± 8.4% | 1.052 msec ± 5.0% | 8.528 msec ± 3.8% | 12.95 msec ± 4.5% | 22.10 msec ± 2.6% | 37.42 msec ± 2.8% |
| 24 | 2400 | 240 | 0 | 1.214 msec ± 1.6% | 1.315 msec ± 1.7% | 1.365 msec ± 5.2% | 1.473 msec ± 3.0% | 1.496 msec ± 2.0% | 1.624 msec ± 1.2% | 2.060 msec ± 2.3% | 15.42 msec ± 2.6% | 22.65 msec ± 3.2% | 36.49 msec ± 2.1% | 64.39 msec ± 0.2% |
| 32 | 3200 | 320 | 0 | 1.902 msec ± 1.1% | 2.482 msec ± 1.6% | 2.488 msec ± 2.4% | 2.657 msec ± 1.6% | 2.706 msec ± 3.0% | 2.887 msec ± 2.2% | 3.110 msec ± 2.5% | 23.89 msec ± 0.6% | 35.89 msec ± 0.8% | 59.40 msec ± 0.2% | 105.6 msec ± 0.4% |
| 48 | 4800 | 480 | 0 | 3.966 msec ± 0.8% | 7.333 msec ± 6.3% | 6.563 msec ± 3.6% | 6.577 msec ± 1.5% | 6.838 msec ± 0.3% | 7.014 msec ± 0.5% | 7.688 msec ± 1.5% | 50.32 msec ± 1.4% | 77.61 msec ± 1.1% | 130.1 msec ± 1.6% | 233.0 msec ± 1.3% |
| 64 | 6400 | 640 | 0 | 6.612 msec ± 0.1% | 15.08 msec ± 1.2% | 14.14 msec ± 2.5% | 15.55 msec ± 1.7% | 15.07 msec ± 0.1% | 15.35 msec ± 0.6% | 15.65 msec ± 0.6% | 98.39 msec ± 0.7% | 150.9 msec ± 1.0% | 254.5 msec ± 1.1% | 469.0 msec ± 1.5% |
| Geomean: | 382.5 μsec ± 1.9% | 449.2 μsec ± 4.0% | 455.4 μsec ± 3.9% | 540.3 μsec ± 4.3% | 613.1 μsec ± 3.3% | 742.5 μsec ± 3.7% | 948.4 μsec ± 3.7% | 5.017 msec ± 2.3% | 7.547 msec ± 2.4% | 12.60 msec ± 2.1% | 22.51 msec ± 1.6% |
Diversity Score
d |
n |
k |
m |
fast |
ros(u) |
ros(nu) |
rb(2) |
rb(4) |
rb(8) |
rb(16) |
e(2) |
e(4) |
e(8) |
e(16) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 100 | 10 | 0 | 0.010 ± 0.0% | 0.033 ± 21.0% | 0.059 ± 11.6% | 0.045 ± 13.6% | 0.056 ± 39.3% | 0.103 ± 8.4% | 0.105 ± 4.2% | 0.109 ± 3.4% | 0.109 ± 2.3% | 0.115 ± 1.9% | 0.114 ± 1.8% |
| 2 | 200 | 20 | 0 | 0.020 ± 0.0% | 0.067 ± 9.2% | 0.090 ± 12.3% | 0.088 ± 12.0% | 0.096 ± 10.6% | 0.116 ± 9.0% | 0.137 ± 5.3% | 0.150 ± 2.5% | 0.157 ± 1.9% | 0.159 ± 1.5% | 0.163 ± 1.5% |
| 3 | 300 | 30 | 0 | 0.049 ± 0.0% | 0.111 ± 8.4% | 0.122 ± 6.3% | 0.129 ± 5.5% | 0.150 ± 6.0% | 0.156 ± 4.6% | 0.160 ± 3.9% | 0.190 ± 2.1% | 0.200 ± 0.8% | 0.208 ± 1.3% | 0.209 ± 0.9% |
| 4 | 400 | 40 | 0 | 0.090 ± 0.0% | 0.146 ± 2.6% | 0.155 ± 2.7% | 0.164 ± 6.0% | 0.176 ± 2.1% | 0.186 ± 3.5% | 0.189 ± 4.1% | 0.216 ± 2.3% | 0.235 ± 1.6% | 0.242 ± 0.6% | 0.245 ± 0.8% |
| 6 | 600 | 60 | 0 | 0.131 ± 0.0% | 0.209 ± 2.7% | 0.209 ± 3.3% | 0.232 ± 1.2% | 0.241 ± 1.5% | 0.249 ± 2.3% | 0.246 ± 3.1% | 0.268 ± 1.1% | 0.289 ± 0.4% | 0.297 ± 0.6% | 0.301 ± 0.4% |
| 8 | 800 | 80 | 0 | 0.192 ± 0.0% | 0.256 ± 1.7% | 0.263 ± 0.9% | 0.277 ± 1.6% | 0.288 ± 1.3% | 0.297 ± 1.5% | 0.293 ± 1.2% | 0.311 ± 1.4% | 0.337 ± 0.7% | 0.345 ± 0.6% | 0.350 ± 0.4% |
| 12 | 1200 | 120 | 0 | 0.281 ± 0.0% | 0.340 ± 0.8% | 0.346 ± 0.9% | 0.361 ± 0.7% | 0.374 ± 0.8% | 0.378 ± 0.7% | 0.376 ± 0.8% | 0.384 ± 0.6% | 0.414 ± 0.4% | 0.427 ± 0.3% | 0.430 ± 0.2% |
| 16 | 1600 | 160 | 0 | 0.346 ± 0.0% | 0.412 ± 1.0% | 0.416 ± 0.5% | 0.429 ± 0.6% | 0.440 ± 0.5% | 0.447 ± 0.4% | 0.447 ± 0.6% | 0.443 ± 0.3% | 0.479 ± 0.5% | 0.492 ± 0.2% | 0.498 ± 0.3% |
| 24 | 2400 | 240 | 0 | 0.471 ± 0.0% | 0.538 ± 0.5% | 0.537 ± 0.5% | 0.552 ± 0.3% | 0.563 ± 0.3% | 0.568 ± 0.3% | 0.567 ± 0.3% | 0.553 ± 0.4% | 0.590 ± 0.2% | 0.609 ± 0.2% | 0.616 ± 0.1% |
| 32 | 3200 | 320 | 0 | 0.584 ± 0.0% | 0.643 ± 0.1% | 0.642 ± 0.2% | 0.656 ± 0.2% | 0.666 ± 0.0% | 0.672 ± 0.3% | 0.668 ± 0.2% | 0.648 ± 0.4% | 0.683 ± 0.1% | 0.709 ± 0.1% | 0.718 ± 0.0% |
| 48 | 4800 | 480 | 0 | 0.758 ± 0.0% | 0.816 ± 0.1% | 0.818 ± 0.1% | 0.829 ± 0.0% | 0.836 ± 0.1% | 0.841 ± 0.1% | 0.839 ± 0.2% | 0.807 ± 0.1% | 0.842 ± 0.1% | 0.873 ± 0.0% | 0.887 ± 0.0% |
| 64 | 6400 | 640 | 0 | 0.908 ± 0.0% | 0.963 ± 0.1% | 0.963 ± 0.0% | 0.978 ± 0.1% | 0.985 ± 0.0% | 0.990 ± 0.0% | 0.987 ± 0.1% | 0.946 ± 0.1% | 0.980 ± 0.1% | 1.011 ± 0.1% | 1.032 ± 0.0% |
| Geomean: | 0.165 ± 0.0% | 0.254 ± 3.9% | 0.278 ± 3.3% | 0.282 ± 3.6% | 0.298 ± 5.3% | 0.325 ± 2.6% | 0.330 ± 2.0% | 0.342 ± 1.2% | 0.363 ± 0.8% | 0.374 ± 0.6% | 0.379 ± 0.5% |