Benchmark:
CTMC-v1 |
Short name:
Test_CTMC
Description:
Reference:
Last submitted:
May 20, 2021 (3 years ago)
Published:
February 10, 2021 at 17:54:32 CET
Submissions:
2
Project page / code:
n/a
Open source:
No
Hardware:
Quadro rtx
Runtime:
48,072.7 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | TRA | MT | ML | FP | FN | Rcll | Prcn | FAF | ID Sw. | Frag |
| CTMC-v1 | 35.1 | 50.5 | 51.95 | 427 (33.3) | 126 (9.8) | 299,941 | 312,368 | 67.1 | 68.0 | 4.2 | 4,318 (0.0) | 25,992 (0.0) |
Detailed performance:
| Sequence | MOTA | IDF1 | TRA | MT | ML | FP | FN | Rcll | Prcn | FAF | ID Sw. | Frag |
| 3T3-run02 | 16.5 | 46.9 | 50.53 | 13 | 1 | 12,669 | 8,869 | 65.9 | 57.5 | 5.9 | 169 | 795 |
| 3T3-run04 | 35.9 | 55.8 | 56.73 | 15 | 1 | 7,381 | 5,693 | 72.3 | 66.8 | 3.4 | 111 | 625 |
| 3T3-run06 | 43.8 | 67.8 | 59.49 | 19 | 4 | 4,637 | 3,782 | 74.9 | 70.8 | 2.8 | 42 | 278 |
| 3T3-run08 | 41.6 | 59.8 | 67.27 | 6 | 1 | 1,547 | 518 | 85.4 | 66.2 | 1.1 | 9 | 88 |
| A-10-run02 | 20.1 | 52.4 | 47.23 | 3 | 0 | 4,125 | 3,049 | 66.1 | 59.1 | 1.9 | 16 | 331 |
| A-10-run04 | -8.0 | 64.8 | 68.31 | 1 | 0 | 1,287 | 9 | 99.3 | 48.1 | 1.1 | 0 | 8 |
| A-10-run06 | -66.2 | 24.4 | 33.41 | 1 | 1 | 9,733 | 4,156 | 50.6 | 30.4 | 5.1 | 88 | 357 |
| A-549-run02 | 32.7 | 45.7 | 52.40 | 17 | 0 | 17,343 | 16,386 | 67.6 | 66.3 | 7.6 | 290 | 2,009 |
| A-549-run04 | 38.9 | 56.3 | 56.43 | 15 | 3 | 11,421 | 8,769 | 73.5 | 68.1 | 6.1 | 73 | 879 |
| APM-run02 | -0.9 | 31.9 | 40.89 | 1 | 1 | 9,200 | 7,482 | 55.1 | 50.0 | 4.4 | 140 | 614 |
| APM-run04 | -7.6 | 31.0 | 33.54 | 3 | 4 | 7,717 | 7,648 | 46.9 | 46.7 | 3.6 | 120 | 588 |
| APM-run06 | -83.7 | 18.5 | 21.52 | 5 | 10 | 29,332 | 14,814 | 38.7 | 24.2 | 12.3 | 269 | 896 |
| BPAE-run02 | 44.2 | 59.8 | 55.39 | 18 | 8 | 13,211 | 14,749 | 70.7 | 73.0 | 6.1 | 140 | 1,138 |
| BPAE-run04 | 38.7 | 50.4 | 52.89 | 9 | 3 | 7,816 | 8,243 | 68.7 | 69.8 | 4.1 | 84 | 592 |
| BPAE-run06 | 21.4 | 38.2 | 46.80 | 8 | 5 | 10,015 | 9,872 | 61.3 | 60.9 | 4.7 | 138 | 884 |
| CRE-BAG2-run02 | 30.1 | 42.4 | 47.55 | 27 | 18 | 27,785 | 39,102 | 59.4 | 67.3 | 10.9 | 471 | 2,545 |
| CRE-BAG2-run04 | 21.7 | 55.6 | 58.57 | 25 | 2 | 8,527 | 4,067 | 74.8 | 58.7 | 4.7 | 65 | 366 |
| CV-1-run02 | 22.2 | 61.3 | 51.61 | 2 | 0 | 462 | 203 | 76.9 | 59.4 | 1.6 | 19 | 21 |
| CV-1-run04 | -49.3 | 42.4 | 60.32 | 1 | 0 | 1,288 | 202 | 80.4 | 39.2 | 1.2 | 52 | 73 |
| LLC-MK2-run02b | 80.0 | 88.1 | 75.09 | 14 | 0 | 1,209 | 567 | 93.7 | 87.4 | 1.4 | 10 | 48 |
| LLC-MK2-run04 | 68.9 | 81.8 | 76.45 | 4 | 0 | 1,654 | 311 | 95.2 | 78.8 | 0.9 | 39 | 53 |
| LLC-MK2-run06 | 22.8 | 51.6 | 49.29 | 9 | 3 | 8,331 | 7,753 | 62.8 | 61.2 | 4.9 | 35 | 450 |
| MDBK-run02 | 84.6 | 89.3 | 73.24 | 2 | 0 | 35 | 115 | 88.2 | 96.1 | 0.1 | 0 | 1 |
| MDBK-run04 | 62.5 | 62.2 | 61.69 | 20 | 2 | 5,330 | 9,672 | 76.0 | 85.2 | 2.6 | 110 | 844 |
| MDBK-run06 | 63.3 | 66.3 | 62.29 | 20 | 7 | 3,731 | 6,063 | 77.5 | 84.8 | 2.2 | 93 | 587 |
| MDBK-run08 | 58.0 | 67.5 | 61.13 | 18 | 2 | 4,152 | 5,612 | 76.0 | 81.1 | 2.1 | 54 | 443 |
| MDBK-run10 | 57.8 | 64.2 | 60.68 | 29 | 4 | 8,630 | 11,679 | 75.9 | 81.0 | 3.6 | 135 | 1,259 |
| MDOK-run02 | -50.3 | 26.1 | 25.57 | 1 | 0 | 5,716 | 3,811 | 40.6 | 31.3 | 2.9 | 111 | 264 |
| MDOK-run04 | -134.6 | 6.9 | 0.00 | 0 | 1 | 4,112 | 2,396 | 14.2 | 8.8 | 2.5 | 41 | 90 |
| MDOK-run06 | 32.7 | 70.9 | 64.77 | 3 | 1 | 2,931 | 940 | 83.7 | 62.2 | 1.2 | 14 | 42 |
| MDOK-run08 | -2.6 | 26.6 | 34.31 | 4 | 4 | 8,162 | 8,043 | 49.5 | 49.1 | 4.6 | 129 | 456 |
| OK-run02 | 43.1 | 46.7 | 56.55 | 19 | 5 | 8,580 | 9,271 | 70.7 | 72.3 | 4.1 | 168 | 861 |
| OK-run04 | 31.0 | 47.1 | 52.22 | 6 | 2 | 2,227 | 2,096 | 66.8 | 65.5 | 2.5 | 38 | 167 |
| OK-run06 | 26.4 | 38.2 | 46.04 | 6 | 4 | 9,574 | 11,937 | 59.5 | 64.7 | 5.0 | 202 | 1,130 |
| PL1Ut-run02 | 19.2 | 37.1 | 39.61 | 10 | 11 | 7,727 | 11,996 | 51.4 | 62.1 | 5.7 | 200 | 991 |
| PL1Ut-run04 | 31.4 | 36.7 | 44.75 | 3 | 0 | 3,772 | 5,804 | 59.0 | 68.8 | 1.8 | 118 | 532 |
| RK-13-run02 | 64.2 | 73.8 | 62.94 | 12 | 0 | 2,649 | 3,045 | 80.9 | 83.0 | 2.5 | 23 | 320 |
| U2O-S-run02 | 53.4 | 48.3 | 52.72 | 27 | 10 | 18,359 | 45,606 | 67.0 | 83.5 | 4.1 | 449 | 3,674 |
| U2O-S-run04 | 63.6 | 74.5 | 65.70 | 31 | 8 | 7,564 | 8,038 | 81.3 | 82.2 | 3.6 | 53 | 693 |
Raw data: