Benchmark:
MOT17 | MOT16 | MOT15 | MOT20 | MOTSynth-MOT-CVPR22 |
Short name:
Tracktor++v2
Detector:
Public
Description:
The problem of tracking multiple objects in a video sequence poses several challenging tasks. For tracking-by- detection these include object re-identification, motion prediction and dealing with occlusions. We present a tracker that accomplishes tracking without specifically targeting any of these tasks, in particular, we perform no training or optimization on tracking data. To this end, we exploit the bounding box regression of an object detector to predict the position of an object in the next frame, thereby converting a detector into a Tracktor. We demonstrate the extensibility of our Tracktor and provide a new state-of-the-art on three multi-object tracking benchmarks by extending it with a straightforward re-identification and camera motion compensation. This benchmark submission presents the results of our extended Tracktor++ multi-object tracker.
Reference:
P. Bergmann, T. Meinhardt, L. Leal-Taixé. Tracking without bells and whistles. In ICCV, 2019.
Last submitted:
November 27, 2019 (4 years ago)
Published:
March 17, 2020 at 17:34:00 CET
Submissions:
1
Project page / code:
Open source:
Yes
Hardware:
Titan X
Runtime:
1.5 Hz
Benchmark performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17 | 56.3 | 55.1 | 44.8 | 498 (21.1) | 831 (35.3) | 8,866 | 235,449 | 58.3 | 97.4 | 45.1 | 44.9 | 48.3 | 78.4 | 47.0 | 78.6 | 81.8 | 0.5 | 1,987 (34.1) | 3,763 (64.6) |
Detailed performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17-01-DPM | 41.9 | 36.2 | 32.9 | 5 | 11 | 23 | 3,701 | 42.6 | 99.2 | 32.9 | 33.1 | 37.0 | 68.7 | 34.0 | 79.1 | 81.2 | 0.1 | 25 | 35 |
MOT17-01-FRCNN | 43.8 | 39.2 | 34.3 | 6 | 10 | 108 | 3,491 | 45.9 | 96.5 | 33.9 | 34.9 | 38.6 | 67.0 | 36.3 | 76.4 | 80.7 | 0.2 | 27 | 48 |
MOT17-01-SDP | 43.8 | 38.2 | 34.1 | 6 | 10 | 112 | 3,479 | 46.1 | 96.4 | 33.4 | 35.0 | 38.1 | 67.0 | 36.5 | 76.3 | 80.6 | 0.2 | 31 | 53 |
MOT17-03-DPM | 67.9 | 61.5 | 49.8 | 60 | 18 | 1,568 | 31,848 | 69.6 | 97.9 | 46.9 | 53.2 | 49.8 | 79.5 | 56.0 | 78.8 | 81.8 | 1.0 | 169 | 251 |
MOT17-03-FRCNN | 68.8 | 61.3 | 49.5 | 57 | 17 | 1,635 | 30,908 | 70.5 | 97.8 | 45.9 | 53.8 | 48.9 | 78.4 | 56.6 | 78.6 | 81.6 | 1.1 | 155 | 251 |
MOT17-03-SDP | 73.3 | 65.5 | 53.0 | 70 | 16 | 2,534 | 25,251 | 75.9 | 96.9 | 49.5 | 57.1 | 53.3 | 77.7 | 60.7 | 77.5 | 81.0 | 1.7 | 199 | 442 |
MOT17-06-DPM | 54.3 | 56.0 | 44.5 | 48 | 85 | 142 | 5,163 | 56.2 | 97.9 | 44.5 | 44.6 | 49.8 | 76.2 | 46.4 | 80.8 | 83.0 | 0.1 | 82 | 155 |
MOT17-06-FRCNN | 58.2 | 57.9 | 45.9 | 55 | 61 | 235 | 4,586 | 61.1 | 96.8 | 44.3 | 47.7 | 49.8 | 74.5 | 50.1 | 79.4 | 82.5 | 0.2 | 101 | 222 |
MOT17-06-SDP | 58.4 | 58.1 | 46.6 | 61 | 64 | 286 | 4,514 | 61.7 | 96.2 | 45.4 | 48.0 | 50.9 | 74.6 | 50.6 | 78.9 | 82.5 | 0.2 | 101 | 223 |
MOT17-07-DPM | 42.3 | 44.5 | 35.5 | 5 | 21 | 98 | 9,560 | 43.4 | 98.7 | 37.3 | 34.1 | 38.9 | 80.7 | 35.1 | 79.8 | 82.1 | 0.2 | 92 | 208 |
MOT17-07-FRCNN | 42.2 | 44.1 | 35.4 | 6 | 23 | 214 | 9,446 | 44.1 | 97.2 | 36.9 | 34.3 | 38.4 | 80.9 | 35.6 | 78.5 | 81.9 | 0.4 | 99 | 224 |
MOT17-07-SDP | 44.5 | 45.9 | 36.7 | 8 | 18 | 232 | 9,033 | 46.5 | 97.1 | 37.7 | 36.1 | 39.7 | 79.4 | 37.5 | 78.3 | 81.7 | 0.5 | 109 | 279 |
MOT17-08-DPM | 26.7 | 29.9 | 27.8 | 8 | 39 | 76 | 15,325 | 27.5 | 98.7 | 34.0 | 22.9 | 35.7 | 83.6 | 23.3 | 83.9 | 85.2 | 0.1 | 78 | 106 |
MOT17-08-FRCNN | 26.3 | 30.5 | 28.4 | 8 | 40 | 105 | 15,401 | 27.1 | 98.2 | 35.8 | 22.6 | 37.7 | 83.3 | 23.0 | 83.4 | 85.1 | 0.2 | 67 | 97 |
MOT17-08-SDP | 27.5 | 31.0 | 28.5 | 10 | 38 | 148 | 15,086 | 28.6 | 97.6 | 34.5 | 23.7 | 37.1 | 81.3 | 24.2 | 82.6 | 84.6 | 0.2 | 85 | 127 |
MOT17-12-DPM | 46.3 | 55.1 | 45.1 | 17 | 43 | 30 | 4,594 | 47.0 | 99.3 | 53.2 | 38.4 | 57.2 | 79.5 | 39.5 | 83.5 | 84.7 | 0.0 | 29 | 52 |
MOT17-12-FRCNN | 45.0 | 54.7 | 44.7 | 15 | 45 | 32 | 4,713 | 45.6 | 99.2 | 53.9 | 37.2 | 58.2 | 78.9 | 38.3 | 83.3 | 84.6 | 0.0 | 20 | 35 |
MOT17-12-SDP | 45.9 | 55.3 | 45.2 | 17 | 44 | 125 | 4,533 | 47.7 | 97.1 | 53.4 | 38.4 | 57.8 | 78.0 | 40.0 | 81.4 | 84.3 | 0.1 | 27 | 51 |
MOT17-14-DPM | 32.5 | 40.0 | 29.8 | 11 | 81 | 191 | 12,143 | 34.3 | 97.1 | 34.1 | 26.2 | 35.8 | 76.6 | 27.0 | 76.5 | 80.4 | 0.3 | 144 | 235 |
MOT17-14-FRCNN | 34.0 | 41.7 | 30.9 | 13 | 75 | 473 | 11,553 | 37.5 | 93.6 | 34.4 | 28.1 | 36.5 | 74.3 | 29.4 | 73.5 | 79.6 | 0.6 | 167 | 309 |
MOT17-14-SDP | 36.2 | 42.7 | 32.0 | 12 | 72 | 499 | 11,121 | 39.8 | 93.7 | 34.9 | 29.6 | 37.2 | 74.9 | 31.1 | 73.1 | 79.5 | 0.7 | 180 | 360 |
Raw data: