Benchmark:
CTMC-v1 |
Short name:
RTU_plus
Description:
Reference:
Last submitted:
June 02, 2022 (2 years ago)
Published:
September 07, 2021 at 17:27:04 CET
Submissions:
1
Project page / code:
n/a
Open source:
No
Hardware:
R9-5900X RTX3090
Runtime:
38.5 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | TRA | MT | ML | FP | FN | Rcll | Prcn | FAF | ID Sw. | Frag |
| CTMC-v1 | 50.6 | 56.7 | 52.51 | 428 (33.3) | 174 (13.6) | 158,592 | 309,014 | 67.5 | 80.2 | 2.2 | 2,118 (0.0) | 10,453 (0.0) |
Detailed performance:
| Sequence | MOTA | IDF1 | TRA | MT | ML | FP | FN | Rcll | Prcn | FAF | ID Sw. | Frag |
| 3T3-run02 | 32.2 | 46.5 | 44.16 | 9 | 4 | 6,405 | 11,126 | 57.2 | 69.9 | 3.0 | 75 | 348 |
| 3T3-run04 | 55.4 | 60.0 | 58.70 | 13 | 1 | 3,754 | 5,358 | 73.9 | 80.2 | 1.7 | 56 | 262 |
| 3T3-run06 | 54.2 | 66.7 | 56.17 | 20 | 4 | 2,499 | 4,371 | 70.9 | 81.0 | 1.5 | 13 | 104 |
| 3T3-run08 | 68.0 | 62.5 | 68.27 | 6 | 1 | 561 | 566 | 84.1 | 84.2 | 0.4 | 9 | 24 |
| A-10-run02 | 70.6 | 70.2 | 65.82 | 3 | 0 | 972 | 1,664 | 81.5 | 88.3 | 0.4 | 7 | 103 |
| A-10-run04 | 3.0 | 66.1 | 65.48 | 1 | 0 | 1,097 | 67 | 94.4 | 50.8 | 0.9 | 0 | 13 |
| A-10-run06 | 40.6 | 56.1 | 48.28 | 3 | 0 | 1,752 | 3,204 | 61.9 | 74.8 | 0.9 | 36 | 63 |
| A-549-run02 | 46.8 | 51.7 | 55.20 | 24 | 2 | 12,813 | 13,987 | 72.3 | 74.1 | 5.6 | 117 | 660 |
| A-549-run04 | 59.3 | 61.1 | 61.42 | 21 | 3 | 6,292 | 7,150 | 78.4 | 80.5 | 3.3 | 59 | 351 |
| APM-run02 | 41.6 | 40.4 | 41.28 | 1 | 3 | 1,839 | 7,829 | 53.0 | 82.8 | 0.9 | 65 | 167 |
| APM-run04 | 28.6 | 37.6 | 33.78 | 1 | 8 | 1,971 | 8,243 | 42.7 | 75.7 | 0.9 | 59 | 132 |
| APM-run06 | 14.8 | 31.6 | 27.87 | 2 | 11 | 5,321 | 15,159 | 37.3 | 62.9 | 2.2 | 105 | 245 |
| BPAE-run02 | 50.5 | 64.3 | 55.57 | 21 | 4 | 10,429 | 14,442 | 71.3 | 77.5 | 4.8 | 55 | 565 |
| BPAE-run04 | 61.2 | 70.3 | 61.42 | 11 | 3 | 3,903 | 6,297 | 76.1 | 83.7 | 2.0 | 17 | 181 |
| BPAE-run06 | 61.8 | 58.6 | 55.63 | 8 | 5 | 2,052 | 7,614 | 70.1 | 89.7 | 1.0 | 62 | 219 |
| CRE-BAG2-run02 | 37.7 | 43.6 | 45.42 | 20 | 26 | 19,266 | 40,379 | 58.1 | 74.4 | 7.6 | 330 | 1,428 |
| CRE-BAG2-run04 | 39.5 | 52.1 | 52.76 | 21 | 4 | 4,470 | 5,275 | 67.4 | 70.9 | 2.4 | 44 | 203 |
| CV-1-run02 | 31.6 | 66.1 | 49.19 | 2 | 1 | 308 | 293 | 66.7 | 65.5 | 1.1 | 0 | 0 |
| CV-1-run04 | 49.4 | 26.4 | 55.27 | 0 | 0 | 235 | 279 | 73.0 | 76.2 | 0.2 | 9 | 13 |
| LLC-MK2-run02b | 87.6 | 87.1 | 76.18 | 13 | 0 | 559 | 544 | 93.9 | 93.8 | 0.7 | 5 | 48 |
| LLC-MK2-run04 | 63.9 | 68.9 | 62.93 | 3 | 0 | 1,133 | 1,182 | 81.7 | 82.3 | 0.6 | 12 | 51 |
| LLC-MK2-run06 | 41.0 | 56.2 | 51.37 | 10 | 6 | 5,246 | 7,039 | 66.3 | 72.5 | 3.1 | 28 | 274 |
| MDBK-run02 | 83.5 | 86.9 | 71.85 | 2 | 0 | 27 | 133 | 86.4 | 96.9 | 0.0 | 1 | 2 |
| MDBK-run04 | 68.0 | 71.3 | 63.18 | 23 | 4 | 4,125 | 8,720 | 78.3 | 88.4 | 2.0 | 60 | 391 |
| MDBK-run06 | 64.4 | 66.1 | 59.55 | 17 | 8 | 2,966 | 6,555 | 75.6 | 87.3 | 1.7 | 68 | 311 |
| MDBK-run08 | 57.0 | 66.1 | 58.07 | 15 | 2 | 3,580 | 6,441 | 72.4 | 82.5 | 1.8 | 29 | 233 |
| MDBK-run10 | 66.6 | 73.4 | 61.50 | 32 | 10 | 5,645 | 10,467 | 78.4 | 87.0 | 2.4 | 73 | 526 |
| MDOK-run02 | 33.2 | 38.6 | 36.71 | 2 | 1 | 899 | 3,376 | 47.3 | 77.2 | 0.4 | 11 | 15 |
| MDOK-run04 | -11.9 | 1.2 | 0.00 | 0 | 2 | 356 | 2,764 | 1.0 | 7.3 | 0.2 | 3 | 8 |
| MDOK-run06 | 54.8 | 78.3 | 65.18 | 3 | 1 | 1,553 | 1,054 | 81.7 | 75.2 | 0.7 | 0 | 0 |
| MDOK-run08 | 5.7 | 33.0 | 27.39 | 3 | 7 | 5,090 | 9,904 | 37.8 | 54.2 | 2.9 | 25 | 125 |
| OK-run02 | 50.0 | 52.6 | 52.64 | 15 | 6 | 5,196 | 10,519 | 66.8 | 80.3 | 2.5 | 103 | 433 |
| OK-run04 | 47.0 | 58.1 | 48.20 | 7 | 5 | 892 | 2,445 | 61.3 | 81.3 | 1.0 | 15 | 90 |
| OK-run06 | 45.2 | 49.5 | 46.55 | 12 | 4 | 4,093 | 11,960 | 59.4 | 81.1 | 2.1 | 108 | 391 |
| PL1Ut-run02 | 35.8 | 42.8 | 39.91 | 9 | 11 | 4,080 | 11,675 | 52.7 | 76.1 | 3.0 | 74 | 325 |
| PL1Ut-run04 | 44.7 | 45.4 | 42.31 | 2 | 2 | 1,377 | 6,399 | 54.7 | 84.9 | 0.7 | 45 | 135 |
| RK-13-run02 | 71.0 | 78.9 | 65.12 | 14 | 2 | 1,906 | 2,714 | 83.0 | 87.4 | 1.8 | 16 | 201 |
| U2O-S-run02 | 56.0 | 51.5 | 53.40 | 30 | 13 | 17,365 | 43,249 | 68.7 | 84.6 | 3.9 | 285 | 1,426 |
| U2O-S-run04 | 64.7 | 72.3 | 64.28 | 29 | 10 | 6,565 | 8,571 | 80.1 | 84.0 | 3.1 | 39 | 387 |
Raw data: