Benchmark:
MOT17 |
Short name:
TT17
Detector:
Public
Description:
Long-term Tracking with Deep Tracklet Association
Reference:
Y. Zhang, H. Sheng, Y. Wu, S. Wang, W. Lyu, W. Ke, Z. Xiong. Long-term Tracking with Deep Tracklet Association. In IEEE Transactions on Image Processing, 2020.
Last submitted:
October 16, 2019 (4 years ago)
Published:
October 16, 2019 at 07:23:46 CET
Submissions:
3
Project page / code:
Open source:
No
Hardware:
4.5 GHz, 1 Core
Runtime:
2.5 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17 | 54.9 | 63.1 | 48.4 | 575 (24.4) | 897 (38.1) | 20,236 | 233,295 | 58.7 | 94.2 | 53.2 | 44.3 | 56.7 | 78.2 | 47.0 | 75.5 | 80.3 | 1.1 | 1,088 (18.6) | 2,392 (40.8) |
Detailed performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17-01-DPM | 46.5 | 61.8 | 45.9 | 7 | 11 | 154 | 3,296 | 48.9 | 95.3 | 59.5 | 35.4 | 62.7 | 74.0 | 36.8 | 71.8 | 76.4 | 0.3 | 2 | 31 |
| MOT17-01-FRCNN | 42.7 | 62.2 | 49.1 | 10 | 9 | 854 | 2,834 | 56.1 | 80.9 | 62.3 | 38.7 | 67.4 | 76.7 | 44.7 | 64.5 | 79.7 | 1.9 | 6 | 29 |
| MOT17-01-SDP | 50.3 | 66.5 | 50.0 | 11 | 5 | 1,069 | 2,119 | 67.1 | 80.2 | 58.1 | 43.2 | 62.1 | 74.2 | 51.7 | 61.8 | 78.4 | 2.4 | 20 | 44 |
| MOT17-03-DPM | 60.4 | 67.5 | 49.7 | 46 | 24 | 2,680 | 38,596 | 63.1 | 96.1 | 52.2 | 47.7 | 54.8 | 79.3 | 50.0 | 76.1 | 79.6 | 1.8 | 137 | 343 |
| MOT17-03-FRCNN | 61.7 | 68.6 | 51.5 | 50 | 27 | 2,383 | 37,551 | 64.1 | 96.6 | 54.7 | 48.9 | 57.5 | 80.8 | 51.4 | 77.4 | 80.5 | 1.6 | 108 | 204 |
| MOT17-03-SDP | 76.2 | 73.5 | 58.1 | 81 | 17 | 2,489 | 22,257 | 78.7 | 97.1 | 56.0 | 60.5 | 58.4 | 80.1 | 63.8 | 78.7 | 81.5 | 1.7 | 171 | 323 |
| MOT17-06-DPM | 49.4 | 60.1 | 45.5 | 52 | 114 | 426 | 5,504 | 53.3 | 93.6 | 53.1 | 39.2 | 63.8 | 68.8 | 41.5 | 72.9 | 78.8 | 0.4 | 38 | 68 |
| MOT17-06-FRCNN | 55.2 | 62.3 | 49.5 | 70 | 76 | 834 | 4,403 | 62.6 | 89.8 | 51.9 | 47.3 | 64.3 | 67.7 | 51.6 | 74.1 | 81.4 | 0.7 | 46 | 110 |
| MOT17-06-SDP | 58.3 | 64.9 | 50.4 | 85 | 71 | 881 | 3,966 | 66.3 | 89.9 | 52.3 | 48.8 | 64.4 | 68.0 | 53.6 | 72.6 | 80.6 | 0.7 | 62 | 104 |
| MOT17-07-DPM | 45.2 | 52.9 | 39.8 | 7 | 24 | 602 | 8,606 | 49.1 | 93.2 | 43.8 | 36.5 | 46.4 | 77.2 | 38.3 | 72.9 | 78.2 | 1.2 | 48 | 113 |
| MOT17-07-FRCNN | 37.3 | 47.1 | 36.5 | 7 | 17 | 1,026 | 9,513 | 43.7 | 87.8 | 41.6 | 32.5 | 44.9 | 74.1 | 34.9 | 70.1 | 78.5 | 2.1 | 60 | 154 |
| MOT17-07-SDP | 49.9 | 57.2 | 43.8 | 14 | 17 | 833 | 7,566 | 55.2 | 91.8 | 46.5 | 41.4 | 49.7 | 77.3 | 44.3 | 73.7 | 80.2 | 1.7 | 58 | 116 |
| MOT17-08-DPM | 34.1 | 48.9 | 40.6 | 17 | 35 | 855 | 13,025 | 38.3 | 90.5 | 55.7 | 29.7 | 59.2 | 78.9 | 31.4 | 74.1 | 81.3 | 1.4 | 41 | 53 |
| MOT17-08-FRCNN | 30.9 | 43.1 | 37.4 | 13 | 37 | 665 | 13,910 | 34.2 | 91.6 | 52.8 | 26.6 | 58.6 | 73.4 | 27.9 | 74.7 | 81.2 | 1.1 | 32 | 61 |
| MOT17-08-SDP | 38.1 | 50.7 | 42.8 | 22 | 34 | 930 | 12,091 | 42.8 | 90.7 | 55.7 | 33.1 | 60.6 | 75.8 | 35.1 | 74.4 | 81.1 | 1.5 | 59 | 88 |
| MOT17-12-DPM | 45.3 | 60.3 | 45.2 | 18 | 42 | 323 | 4,406 | 49.2 | 93.0 | 55.2 | 37.0 | 59.4 | 75.3 | 39.1 | 74.0 | 79.9 | 0.4 | 8 | 26 |
| MOT17-12-FRCNN | 40.4 | 54.8 | 42.7 | 13 | 48 | 303 | 4,850 | 44.0 | 92.6 | 53.6 | 34.1 | 57.9 | 76.1 | 36.0 | 75.7 | 81.4 | 0.3 | 11 | 23 |
| MOT17-12-SDP | 46.1 | 60.3 | 47.1 | 16 | 41 | 498 | 4,156 | 52.0 | 90.1 | 56.3 | 39.5 | 59.9 | 77.9 | 42.7 | 73.9 | 82.0 | 0.6 | 15 | 38 |
| MOT17-14-DPM | 30.7 | 45.0 | 32.3 | 11 | 99 | 167 | 12,625 | 31.7 | 97.2 | 43.6 | 24.1 | 45.4 | 78.5 | 24.7 | 75.9 | 79.4 | 0.2 | 22 | 57 |
| MOT17-14-FRCNN | 27.6 | 43.7 | 32.2 | 10 | 82 | 1,374 | 11,941 | 35.4 | 82.6 | 40.0 | 26.2 | 43.5 | 70.2 | 28.0 | 65.4 | 75.7 | 1.8 | 59 | 203 |
| MOT17-14-SDP | 40.2 | 52.1 | 37.1 | 15 | 67 | 890 | 10,080 | 45.5 | 90.4 | 42.8 | 32.6 | 45.8 | 74.7 | 34.8 | 69.3 | 77.8 | 1.2 | 85 | 204 |
Raw data: