Benchmark:
MOT17 |
Short name:
DMAN
Detector:
Public
Description:
n/a
Reference:
J. Zhu, H. Yang, N. Liu, M. Kim, W. Zhang, M. Yang. Online Multi-Object Tracking with Dual Matching Attention Networks. In ECCV, 2018.
Last submitted:
November 14, 2017 (7 years ago)
Published:
September 11, 2018 at 07:16:29 CET
Submissions:
1
Project page / code:
Open source:
Yes
Hardware:
2.4 GHZ, 1 Core
Runtime:
0.3 Hz
Benchmark performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17 | 48.2 | 55.7 | 42.5 | 454 (19.3) | 902 (38.3) | 26,218 | 263,608 | 53.3 | 92.0 | 46.1 | 39.4 | 49.9 | 72.9 | 42.0 | 72.5 | 79.0 | 1.5 | 2,194 (41.2) | 5,378 (100.9) |
Detailed performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17-01-DPM | 36.7 | 48.4 | 33.6 | 5 | 11 | 199 | 3,869 | 40.0 | 92.8 | 40.3 | 28.0 | 48.4 | 61.9 | 29.2 | 67.8 | 75.0 | 0.4 | 13 | 72 |
MOT17-01-FRCNN | 28.5 | 49.5 | 40.0 | 8 | 7 | 1,477 | 3,115 | 51.7 | 69.3 | 47.6 | 33.9 | 54.9 | 69.4 | 41.8 | 56.1 | 78.3 | 3.3 | 18 | 50 |
MOT17-01-SDP | 42.2 | 56.0 | 41.1 | 8 | 6 | 1,008 | 2,691 | 58.3 | 78.9 | 44.1 | 38.4 | 50.2 | 68.2 | 45.0 | 60.8 | 77.2 | 2.2 | 30 | 115 |
MOT17-03-DPM | 53.4 | 59.3 | 43.3 | 37 | 30 | 4,382 | 44,167 | 57.8 | 93.2 | 44.7 | 42.2 | 47.5 | 72.4 | 44.7 | 72.1 | 77.6 | 2.9 | 193 | 841 |
MOT17-03-FRCNN | 57.7 | 62.3 | 47.0 | 43 | 25 | 3,286 | 40,743 | 61.1 | 95.1 | 48.6 | 45.9 | 51.7 | 75.7 | 48.5 | 75.5 | 79.7 | 2.2 | 213 | 501 |
MOT17-03-SDP | 67.3 | 66.6 | 51.5 | 65 | 20 | 2,735 | 31,209 | 70.2 | 96.4 | 50.5 | 52.8 | 54.1 | 74.4 | 55.8 | 76.6 | 80.2 | 1.8 | 266 | 736 |
MOT17-06-DPM | 46.9 | 55.1 | 40.5 | 38 | 103 | 537 | 5,594 | 52.5 | 92.0 | 44.2 | 37.4 | 50.4 | 66.3 | 39.7 | 69.5 | 76.4 | 0.4 | 131 | 236 |
MOT17-06-FRCNN | 51.2 | 58.1 | 44.2 | 54 | 68 | 788 | 4,794 | 59.3 | 89.9 | 44.5 | 44.3 | 52.9 | 67.3 | 47.9 | 72.6 | 79.7 | 0.7 | 169 | 251 |
MOT17-06-SDP | 54.0 | 55.4 | 42.3 | 64 | 67 | 760 | 4,475 | 62.0 | 90.6 | 41.0 | 44.0 | 51.8 | 60.2 | 48.0 | 70.0 | 78.4 | 0.6 | 188 | 227 |
MOT17-07-DPM | 41.4 | 50.3 | 36.5 | 8 | 24 | 568 | 9,272 | 45.1 | 93.1 | 41.3 | 32.4 | 43.6 | 73.5 | 34.0 | 70.2 | 76.5 | 1.1 | 60 | 145 |
MOT17-07-FRCNN | 34.0 | 42.8 | 33.7 | 4 | 19 | 1,316 | 9,727 | 42.4 | 84.5 | 37.0 | 31.5 | 39.9 | 71.1 | 34.1 | 67.8 | 77.9 | 2.6 | 113 | 341 |
MOT17-07-SDP | 42.1 | 47.4 | 37.1 | 10 | 19 | 1,091 | 8,591 | 49.1 | 88.4 | 38.3 | 36.2 | 41.2 | 69.5 | 39.1 | 70.3 | 78.9 | 2.2 | 98 | 220 |
MOT17-08-DPM | 25.8 | 37.5 | 32.5 | 14 | 38 | 695 | 14,913 | 29.4 | 89.9 | 45.6 | 23.3 | 49.4 | 73.0 | 24.3 | 74.2 | 81.0 | 1.1 | 56 | 106 |
MOT17-08-FRCNN | 24.7 | 34.8 | 30.8 | 9 | 41 | 350 | 15,491 | 26.7 | 94.2 | 44.6 | 21.3 | 47.5 | 77.6 | 22.0 | 77.6 | 82.5 | 0.6 | 65 | 111 |
MOT17-08-SDP | 27.5 | 35.1 | 30.0 | 11 | 37 | 542 | 14,660 | 30.6 | 92.3 | 37.6 | 24.0 | 42.0 | 68.8 | 25.0 | 75.4 | 81.3 | 0.9 | 104 | 170 |
MOT17-12-DPM | 41.0 | 55.8 | 41.4 | 17 | 48 | 331 | 4,764 | 45.0 | 92.2 | 51.0 | 33.6 | 54.8 | 74.1 | 35.6 | 72.8 | 79.6 | 0.4 | 16 | 38 |
MOT17-12-FRCNN | 38.3 | 54.6 | 41.5 | 14 | 47 | 484 | 4,857 | 44.0 | 88.7 | 52.0 | 33.3 | 55.9 | 76.1 | 35.7 | 72.1 | 80.9 | 0.5 | 9 | 49 |
MOT17-12-SDP | 42.4 | 59.2 | 45.0 | 18 | 46 | 329 | 4,645 | 46.4 | 92.4 | 57.2 | 35.4 | 61.3 | 77.5 | 37.5 | 74.8 | 81.4 | 0.4 | 16 | 37 |
MOT17-14-DPM | 23.6 | 38.1 | 27.5 | 9 | 97 | 1,063 | 12,984 | 29.8 | 83.8 | 35.2 | 21.6 | 37.5 | 69.9 | 23.0 | 64.7 | 76.4 | 1.4 | 66 | 168 |
MOT17-14-FRCNN | 18.8 | 36.9 | 27.4 | 8 | 81 | 2,554 | 12,268 | 33.6 | 70.9 | 31.7 | 24.2 | 35.5 | 61.6 | 27.0 | 57.0 | 74.3 | 3.4 | 181 | 491 |
MOT17-14-SDP | 31.3 | 43.0 | 30.8 | 10 | 68 | 1,723 | 10,779 | 41.7 | 81.7 | 33.0 | 28.9 | 36.5 | 63.4 | 31.8 | 62.4 | 76.1 | 2.3 | 189 | 473 |
Raw data: