Benchmark:
MOT17 |
Short name:
OTCD_1_17
Detector:
Public
Description:
n/a
Reference:
Q. Liu, B. Liu, Y. Wu, W. Li, N. Yu. Real-Time Online Multi-Object Tracking in Compressed Domain. In IEEE Access, 2019.
Last submitted:
November 19, 2019 (5 years ago)
Published:
July 14, 2019 at 15:05:11 CET
Submissions:
2
Project page / code:
Open source:
Yes
Hardware:
2.6GHz CPU, TITAN Xp GPU
Runtime:
15.5 Hz
Benchmark performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17 | 48.6 | 47.9 | 38.4 | 382 (16.2) | 970 (41.2) | 18,499 | 268,204 | 52.5 | 94.1 | 37.6 | 39.6 | 40.4 | 73.8 | 41.8 | 74.9 | 80.0 | 1.0 | 3,502 (66.7) | 5,588 (106.5) |
Detailed performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17-01-DPM | 30.9 | 32.8 | 26.3 | 3 | 12 | 169 | 4,260 | 34.0 | 92.8 | 28.1 | 24.6 | 30.9 | 65.2 | 25.6 | 70.1 | 76.7 | 0.4 | 29 | 77 |
MOT17-01-FRCNN | 31.9 | 35.5 | 33.2 | 6 | 10 | 1,031 | 3,321 | 48.5 | 75.2 | 32.6 | 34.1 | 35.4 | 73.1 | 39.8 | 61.7 | 79.2 | 2.3 | 40 | 60 |
MOT17-01-SDP | 44.4 | 38.8 | 32.5 | 7 | 5 | 417 | 3,121 | 51.6 | 88.9 | 29.2 | 36.4 | 32.8 | 67.5 | 39.6 | 68.2 | 78.2 | 0.9 | 48 | 102 |
MOT17-03-DPM | 54.7 | 51.4 | 39.0 | 34 | 25 | 2,825 | 44,305 | 57.7 | 95.5 | 35.6 | 43.0 | 37.9 | 73.4 | 45.2 | 74.8 | 79.0 | 1.9 | 277 | 930 |
MOT17-03-FRCNN | 59.8 | 57.0 | 45.0 | 42 | 25 | 2,986 | 38,814 | 62.9 | 95.7 | 42.3 | 48.3 | 45.4 | 76.4 | 50.9 | 77.3 | 80.8 | 2.0 | 234 | 462 |
MOT17-03-SDP | 71.4 | 56.8 | 46.7 | 61 | 16 | 1,059 | 28,493 | 72.8 | 98.6 | 39.4 | 55.5 | 41.8 | 75.4 | 58.0 | 78.6 | 81.0 | 0.7 | 417 | 1,084 |
MOT17-06-DPM | 37.9 | 47.0 | 35.2 | 24 | 121 | 552 | 6,655 | 43.5 | 90.3 | 39.8 | 31.4 | 45.5 | 66.4 | 33.4 | 69.3 | 77.7 | 0.5 | 106 | 120 |
MOT17-06-FRCNN | 49.1 | 51.7 | 41.3 | 50 | 68 | 761 | 5,008 | 57.5 | 89.9 | 39.4 | 43.5 | 45.2 | 69.6 | 47.2 | 73.7 | 81.1 | 0.6 | 228 | 218 |
MOT17-06-SDP | 49.7 | 51.8 | 39.7 | 51 | 84 | 561 | 5,175 | 56.1 | 92.2 | 38.2 | 41.3 | 43.3 | 68.4 | 44.3 | 72.9 | 80.1 | 0.5 | 197 | 146 |
MOT17-07-DPM | 34.0 | 38.5 | 29.2 | 4 | 28 | 676 | 10,375 | 38.6 | 90.6 | 30.3 | 28.3 | 32.3 | 70.5 | 29.8 | 70.0 | 77.5 | 1.4 | 100 | 241 |
MOT17-07-FRCNN | 32.9 | 37.2 | 30.7 | 4 | 20 | 1,115 | 10,056 | 40.5 | 86.0 | 32.4 | 29.9 | 34.9 | 71.8 | 32.2 | 68.4 | 78.3 | 2.2 | 157 | 271 |
MOT17-07-SDP | 42.4 | 43.1 | 34.1 | 7 | 22 | 488 | 9,121 | 46.0 | 94.1 | 34.0 | 34.4 | 35.9 | 72.9 | 36.2 | 73.9 | 79.7 | 1.0 | 119 | 209 |
MOT17-08-DPM | 25.1 | 28.2 | 25.0 | 7 | 40 | 362 | 15,374 | 27.2 | 94.1 | 29.0 | 21.6 | 31.0 | 75.2 | 22.2 | 76.7 | 81.1 | 0.6 | 85 | 132 |
MOT17-08-FRCNN | 24.1 | 28.1 | 26.1 | 6 | 38 | 655 | 15,301 | 27.6 | 89.9 | 31.5 | 21.8 | 34.7 | 74.4 | 22.7 | 74.1 | 81.8 | 1.0 | 83 | 109 |
MOT17-08-SDP | 28.8 | 30.0 | 27.2 | 10 | 38 | 251 | 14,668 | 30.6 | 96.3 | 30.8 | 24.1 | 33.1 | 75.5 | 24.8 | 78.1 | 81.7 | 0.4 | 130 | 188 |
MOT17-12-DPM | 40.5 | 51.4 | 39.7 | 13 | 47 | 375 | 4,760 | 45.1 | 91.2 | 46.6 | 33.8 | 51.2 | 72.0 | 35.7 | 72.3 | 78.9 | 0.4 | 24 | 67 |
MOT17-12-FRCNN | 38.8 | 53.4 | 41.6 | 15 | 47 | 466 | 4,812 | 44.5 | 89.2 | 50.6 | 34.3 | 54.5 | 76.5 | 36.6 | 73.4 | 81.0 | 0.5 | 22 | 42 |
MOT17-12-SDP | 43.7 | 55.0 | 43.4 | 18 | 44 | 211 | 4,652 | 46.3 | 95.0 | 52.7 | 35.8 | 56.1 | 77.0 | 37.5 | 77.0 | 81.8 | 0.2 | 18 | 37 |
MOT17-14-DPM | 16.3 | 22.1 | 17.5 | 4 | 118 | 556 | 14,770 | 20.1 | 87.0 | 20.5 | 15.0 | 22.3 | 61.3 | 15.5 | 67.1 | 76.8 | 0.7 | 139 | 205 |
MOT17-14-FRCNN | 17.6 | 27.2 | 21.6 | 11 | 76 | 2,255 | 12,233 | 33.8 | 73.5 | 20.2 | 24.1 | 22.4 | 56.3 | 26.7 | 58.0 | 74.4 | 3.0 | 750 | 587 |
MOT17-14-SDP | 24.5 | 30.7 | 22.2 | 5 | 86 | 728 | 12,930 | 30.0 | 88.4 | 23.0 | 21.6 | 25.0 | 66.1 | 22.8 | 67.0 | 77.1 | 1.0 | 299 | 301 |
Raw data: