Benchmark:
MOT17 |
Short name:
HDTR_17
Detector:
Public
Description:
n/a
Reference:
M. Babaee, A. Athar, G. Rigoll. Multiple People Tracking Using Hierarchical Deep Tracklet Re-identification. In arXiv preprint arXiv:1811.04091, 2018.
Last submitted:
October 23, 2018 (6 years ago)
Published:
October 04, 2018 at 13:04:05 CET
Submissions:
4
Project page / code:
n/a
Open source:
No
Hardware:
Nvidia TITAN-X, 4 Core
Runtime:
1.8 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17 | 54.1 | 48.4 | 46.8 | 549 (23.3) | 819 (34.8) | 18,002 | 238,818 | 57.7 | 94.8 | 48.9 | 44.9 | 54.3 | 74.1 | 47.6 | 78.2 | 82.6 | 1.0 | 1,895 (32.9) | 2,693 (46.7) |
Detailed performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17-01-DPM | 49.1 | 41.0 | 48.3 | 7 | 8 | 47 | 3,224 | 50.0 | 98.6 | 58.2 | 40.1 | 60.4 | 83.9 | 41.3 | 81.4 | 83.0 | 0.1 | 11 | 16 |
| MOT17-01-FRCNN | 55.3 | 48.8 | 52.0 | 10 | 8 | 332 | 2,532 | 60.7 | 92.2 | 59.0 | 46.0 | 62.9 | 75.0 | 49.6 | 75.3 | 81.7 | 0.7 | 16 | 16 |
| MOT17-01-SDP | 66.2 | 51.4 | 56.0 | 14 | 4 | 203 | 1,963 | 69.6 | 95.7 | 59.4 | 53.0 | 63.9 | 72.6 | 56.2 | 77.4 | 81.2 | 0.5 | 15 | 20 |
| MOT17-03-DPM | 62.5 | 52.0 | 51.4 | 45 | 25 | 1,160 | 37,903 | 63.8 | 98.3 | 52.1 | 50.8 | 55.2 | 79.3 | 52.9 | 81.5 | 83.4 | 0.8 | 193 | 272 |
| MOT17-03-FRCNN | 65.1 | 57.5 | 52.7 | 53 | 23 | 1,353 | 35,070 | 66.5 | 98.1 | 53.0 | 52.5 | 56.1 | 79.1 | 54.9 | 81.0 | 83.1 | 0.9 | 129 | 219 |
| MOT17-03-SDP | 67.8 | 56.3 | 52.6 | 63 | 20 | 2,262 | 31,267 | 70.1 | 97.0 | 50.8 | 54.6 | 55.6 | 75.2 | 57.6 | 79.6 | 82.5 | 1.5 | 178 | 318 |
| MOT17-06-DPM | 43.8 | 35.3 | 37.6 | 55 | 94 | 1,379 | 5,155 | 56.3 | 82.8 | 33.3 | 42.6 | 57.5 | 45.8 | 48.1 | 70.8 | 82.6 | 1.2 | 90 | 130 |
| MOT17-06-FRCNN | 50.0 | 37.9 | 39.4 | 70 | 65 | 1,368 | 4,426 | 62.4 | 84.3 | 33.5 | 46.4 | 58.8 | 45.7 | 52.6 | 71.0 | 82.3 | 1.1 | 100 | 160 |
| MOT17-06-SDP | 47.1 | 34.6 | 37.7 | 72 | 73 | 1,732 | 4,398 | 62.7 | 81.0 | 31.0 | 45.9 | 59.7 | 41.5 | 53.2 | 68.8 | 82.1 | 1.5 | 102 | 145 |
| MOT17-07-DPM | 45.3 | 41.6 | 39.2 | 10 | 21 | 783 | 8,346 | 50.6 | 91.6 | 39.4 | 39.0 | 42.9 | 72.4 | 41.7 | 75.4 | 81.9 | 1.6 | 104 | 143 |
| MOT17-07-FRCNN | 45.9 | 42.7 | 38.8 | 7 | 14 | 833 | 8,189 | 51.5 | 91.3 | 38.0 | 39.8 | 42.0 | 70.6 | 42.5 | 75.3 | 81.7 | 1.7 | 114 | 144 |
| MOT17-07-SDP | 48.4 | 43.8 | 40.8 | 13 | 15 | 1,017 | 7,579 | 55.1 | 90.2 | 40.0 | 41.8 | 44.1 | 71.2 | 45.2 | 74.0 | 81.5 | 2.0 | 114 | 131 |
| MOT17-08-DPM | 30.1 | 31.4 | 36.4 | 11 | 37 | 141 | 14,584 | 31.0 | 97.9 | 52.0 | 25.5 | 55.6 | 80.9 | 26.0 | 82.3 | 84.2 | 0.2 | 44 | 72 |
| MOT17-08-FRCNN | 28.8 | 31.7 | 36.3 | 11 | 37 | 332 | 14,673 | 30.5 | 95.1 | 52.8 | 25.0 | 56.3 | 81.2 | 25.7 | 80.1 | 84.3 | 0.5 | 41 | 69 |
| MOT17-08-SDP | 30.7 | 32.4 | 36.7 | 12 | 38 | 131 | 14,454 | 31.6 | 98.1 | 52.2 | 25.9 | 55.7 | 80.8 | 26.5 | 82.2 | 84.0 | 0.2 | 51 | 80 |
| MOT17-12-DPM | 41.2 | 48.7 | 43.0 | 13 | 46 | 200 | 4,842 | 44.1 | 95.0 | 52.9 | 35.0 | 56.5 | 75.2 | 36.6 | 78.8 | 82.8 | 0.2 | 53 | 46 |
| MOT17-12-FRCNN | 40.3 | 49.6 | 42.9 | 13 | 45 | 280 | 4,835 | 44.2 | 93.2 | 52.8 | 34.9 | 56.4 | 75.2 | 36.7 | 77.3 | 82.2 | 0.3 | 60 | 41 |
| MOT17-12-SDP | 42.3 | 48.9 | 43.2 | 15 | 42 | 285 | 4,655 | 46.3 | 93.4 | 51.5 | 36.3 | 56.1 | 72.2 | 38.2 | 77.1 | 82.2 | 0.3 | 61 | 53 |
| MOT17-14-DPM | 33.9 | 33.6 | 31.9 | 13 | 80 | 609 | 11,470 | 37.9 | 92.0 | 35.4 | 28.8 | 40.4 | 65.7 | 30.4 | 73.7 | 80.9 | 0.8 | 134 | 161 |
| MOT17-14-FRCNN | 36.1 | 37.1 | 35.0 | 19 | 64 | 1,669 | 10,012 | 45.8 | 83.5 | 37.6 | 32.7 | 43.8 | 63.2 | 36.4 | 66.3 | 79.5 | 2.2 | 137 | 227 |
| MOT17-14-SDP | 39.0 | 38.6 | 37.0 | 23 | 60 | 1,886 | 9,241 | 50.0 | 83.1 | 39.3 | 35.1 | 47.0 | 61.8 | 39.5 | 65.6 | 79.5 | 2.5 | 148 | 230 |
Raw data: