Benchmark:
CTMC-v1 |
Short name:
DMNet
Description:
Reference:
Last submitted:
June 05, 2021 (3 years ago)
Published:
June 08, 2021 at 00:43:29 CET
Submissions:
2
Project page / code:
n/a
Open source:
No
Hardware:
Intel(R) Xeon(R) W-2195 CPU @ 2.30GHz, 36 Cores, Quadro RTX 8000
Runtime:
25.8 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | TRA | MT | ML | FP | FN | Rcll | Prcn | FAF | ID Sw. | Frag |
| CTMC-v1 | 39.0 | 41.0 | 36.95 | 219 (17.1) | 317 (24.7) | 109,689 | 466,667 | 50.9 | 81.5 | 1.5 | 3,142 (0.0) | 20,829 (0.0) |
Detailed performance:
| Sequence | MOTA | IDF1 | TRA | MT | ML | FP | FN | Rcll | Prcn | FAF | ID Sw. | Frag |
| 3T3-run02 | 30.8 | 34.7 | 32.94 | 6 | 9 | 2,868 | 15,007 | 42.2 | 79.3 | 1.3 | 107 | 555 |
| 3T3-run04 | 49.0 | 48.0 | 46.81 | 9 | 4 | 2,187 | 8,220 | 60.0 | 85.0 | 1.0 | 81 | 560 |
| 3T3-run06 | 51.2 | 60.8 | 47.32 | 11 | 8 | 1,480 | 5,834 | 61.2 | 86.2 | 0.9 | 23 | 303 |
| 3T3-run08 | 66.1 | 61.8 | 57.44 | 2 | 2 | 246 | 939 | 73.6 | 91.4 | 0.2 | 18 | 104 |
| A-10-run02 | 49.9 | 51.5 | 50.24 | 1 | 1 | 1,291 | 3,199 | 64.5 | 81.8 | 0.6 | 23 | 247 |
| A-10-run04 | 2.7 | 2.4 | 2.04 | 0 | 1 | 0 | 1,166 | 2.8 | 100.0 | 0.0 | 2 | 0 |
| A-10-run06 | 35.7 | 40.2 | 34.54 | 2 | 1 | 666 | 4,722 | 43.9 | 84.7 | 0.4 | 24 | 195 |
| A-549-run02 | 24.8 | 26.3 | 29.21 | 8 | 12 | 6,978 | 30,810 | 39.1 | 73.9 | 3.1 | 207 | 1,473 |
| A-549-run04 | 59.4 | 52.8 | 54.45 | 14 | 3 | 3,616 | 9,743 | 70.6 | 86.6 | 1.9 | 97 | 730 |
| APM-run02 | 21.9 | 24.0 | 21.89 | 0 | 11 | 1,025 | 11,930 | 28.4 | 82.2 | 0.5 | 70 | 374 |
| APM-run04 | 15.1 | 21.7 | 17.65 | 1 | 13 | 1,122 | 11,036 | 23.3 | 75.0 | 0.5 | 58 | 299 |
| APM-run06 | 8.2 | 17.6 | 13.26 | 0 | 23 | 2,212 | 19,884 | 17.7 | 66.0 | 0.9 | 86 | 523 |
| BPAE-run02 | 43.6 | 37.1 | 39.74 | 6 | 11 | 3,709 | 24,544 | 51.3 | 87.5 | 1.7 | 182 | 1,308 |
| BPAE-run04 | 31.1 | 25.9 | 28.60 | 1 | 9 | 1,469 | 16,567 | 37.1 | 86.9 | 0.8 | 107 | 673 |
| BPAE-run06 | 33.9 | 26.9 | 30.59 | 2 | 15 | 1,394 | 15,326 | 39.8 | 87.9 | 0.7 | 119 | 628 |
| CRE-BAG2-run02 | 29.7 | 34.8 | 37.33 | 15 | 45 | 17,795 | 49,469 | 48.6 | 72.5 | 7.0 | 399 | 2,091 |
| CRE-BAG2-run04 | 40.8 | 47.6 | 49.00 | 12 | 6 | 3,254 | 6,254 | 61.3 | 75.3 | 1.8 | 65 | 365 |
| CV-1-run02 | -6.7 | 28.5 | 14.87 | 0 | 1 | 246 | 692 | 21.3 | 43.2 | 0.8 | 0 | 7 |
| CV-1-run04 | -10.6 | 0.0 | 0.00 | 0 | 1 | 109 | 1,033 | 0.0 | 0.0 | 0.1 | 0 | 0 |
| LLC-MK2-run02b | 84.3 | 81.4 | 72.27 | 13 | 0 | 497 | 894 | 90.0 | 94.2 | 0.6 | 11 | 82 |
| LLC-MK2-run04 | 63.6 | 64.2 | 56.93 | 2 | 1 | 434 | 1,909 | 70.4 | 91.3 | 0.2 | 8 | 80 |
| LLC-MK2-run06 | 29.9 | 45.8 | 41.32 | 8 | 8 | 5,178 | 9,404 | 54.9 | 68.9 | 3.0 | 41 | 372 |
| MDBK-run02 | 64.0 | 65.6 | 51.65 | 2 | 0 | 24 | 324 | 66.8 | 96.4 | 0.0 | 3 | 19 |
| MDBK-run04 | 55.4 | 55.0 | 52.65 | 17 | 5 | 4,873 | 12,978 | 67.8 | 84.9 | 2.4 | 126 | 682 |
| MDBK-run06 | 47.7 | 52.9 | 46.97 | 11 | 8 | 3,202 | 10,783 | 59.9 | 83.4 | 1.9 | 77 | 541 |
| MDBK-run08 | 45.9 | 52.3 | 47.18 | 10 | 3 | 3,128 | 9,452 | 59.6 | 81.7 | 1.6 | 67 | 444 |
| MDBK-run10 | 53.4 | 57.9 | 52.43 | 12 | 9 | 6,581 | 15,815 | 67.3 | 83.2 | 2.7 | 134 | 1,031 |
| MDOK-run02 | 20.8 | 27.9 | 19.39 | 1 | 2 | 225 | 4,844 | 24.5 | 87.5 | 0.1 | 10 | 51 |
| MDOK-run04 | -8.8 | 0.9 | 0.00 | 0 | 2 | 274 | 2,761 | 1.1 | 10.2 | 0.2 | 2 | 0 |
| MDOK-run06 | 59.3 | 79.3 | 65.50 | 3 | 1 | 1,292 | 1,054 | 81.7 | 78.5 | 0.5 | 1 | 0 |
| MDOK-run08 | 5.1 | 16.5 | 12.46 | 1 | 13 | 1,906 | 13,187 | 17.2 | 58.9 | 1.1 | 25 | 187 |
| OK-run02 | 43.1 | 37.8 | 44.57 | 5 | 10 | 4,447 | 13,416 | 57.6 | 80.4 | 2.1 | 129 | 781 |
| OK-run04 | 44.5 | 42.3 | 44.38 | 4 | 2 | 707 | 2,770 | 56.2 | 83.4 | 0.8 | 28 | 140 |
| OK-run06 | 33.7 | 36.3 | 35.41 | 4 | 8 | 3,275 | 16,139 | 45.3 | 80.3 | 1.7 | 125 | 797 |
| PL1Ut-run02 | 20.2 | 27.6 | 23.10 | 2 | 18 | 2,613 | 16,987 | 31.1 | 74.6 | 1.9 | 91 | 643 |
| PL1Ut-run04 | 20.5 | 25.4 | 22.69 | 1 | 7 | 1,393 | 9,791 | 30.8 | 75.7 | 0.7 | 51 | 315 |
| RK-13-run02 | 58.6 | 61.9 | 50.83 | 6 | 5 | 1,038 | 5,539 | 65.3 | 91.0 | 1.0 | 35 | 354 |
| U2O-S-run02 | 40.0 | 33.0 | 37.99 | 7 | 27 | 12,618 | 69,930 | 49.4 | 84.4 | 2.8 | 406 | 3,079 |
| U2O-S-run04 | 61.1 | 57.4 | 55.24 | 20 | 12 | 4,317 | 12,315 | 71.4 | 87.7 | 2.0 | 104 | 796 |
Raw data: