Benchmark:
MOT17 |
Short name:
DASOT17
Detector:
Public
Description:
n/a
Reference:
Q. Chu, W. Ouyang, B. Liu, F. Zhu, N. Yu. DASOT: A Unified Framework Integrating Data Association and Single Object Tracking for Online Multi-Object Tracking. In Proceedings of the AAAI Conference on Artificial Intelligence, 2020.
Last submitted:
November 21, 2019 (5 years ago)
Published:
May 13, 2020 at 10:23:17 CET
Submissions:
2
Project page / code:
n/a
Open source:
No
Hardware:
2.6GHZ 1 Core; TITAN Xp
Runtime:
9.1 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17 | 49.5 | 51.8 | 41.5 | 481 (20.4) | 814 (34.6) | 33,640 | 247,370 | 56.2 | 90.4 | 41.7 | 41.6 | 44.4 | 75.6 | 44.9 | 72.3 | 79.9 | 1.9 | 4,142 (73.8) | 6,852 (122.0) |
Detailed performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17-01-DPM | 38.2 | 38.7 | 31.2 | 4 | 10 | 222 | 3,701 | 42.6 | 92.5 | 32.8 | 30.0 | 34.7 | 73.1 | 31.6 | 68.6 | 76.1 | 0.5 | 65 | 92 |
| MOT17-01-FRCNN | 26.7 | 34.2 | 32.6 | 8 | 8 | 1,516 | 3,175 | 50.8 | 68.4 | 31.9 | 33.6 | 34.2 | 76.2 | 41.7 | 56.1 | 79.0 | 3.4 | 37 | 53 |
| MOT17-01-SDP | 29.1 | 38.9 | 35.0 | 10 | 3 | 2,111 | 2,365 | 63.3 | 65.9 | 33.4 | 37.3 | 36.7 | 71.6 | 49.9 | 51.9 | 77.6 | 4.7 | 95 | 149 |
| MOT17-03-DPM | 52.6 | 54.2 | 41.4 | 40 | 26 | 6,333 | 42,933 | 59.0 | 90.7 | 39.7 | 43.4 | 41.9 | 75.1 | 46.8 | 71.9 | 79.1 | 4.2 | 308 | 740 |
| MOT17-03-FRCNN | 59.8 | 55.7 | 44.6 | 43 | 25 | 2,559 | 39,244 | 62.5 | 96.2 | 41.6 | 48.2 | 44.4 | 75.5 | 50.6 | 77.9 | 81.0 | 1.7 | 246 | 530 |
| MOT17-03-SDP | 73.3 | 65.4 | 53.0 | 73 | 15 | 2,733 | 24,604 | 76.5 | 96.7 | 48.5 | 58.2 | 51.7 | 75.5 | 61.6 | 77.9 | 81.0 | 1.8 | 582 | 1,329 |
| MOT17-06-DPM | 47.5 | 54.2 | 40.5 | 38 | 99 | 377 | 5,588 | 52.6 | 94.3 | 44.2 | 37.5 | 46.8 | 76.6 | 39.7 | 71.1 | 77.4 | 0.3 | 226 | 264 |
| MOT17-06-FRCNN | 55.3 | 58.8 | 45.6 | 51 | 61 | 488 | 4,609 | 60.9 | 93.6 | 45.5 | 46.0 | 49.8 | 78.1 | 49.0 | 75.3 | 80.5 | 0.4 | 169 | 205 |
| MOT17-06-SDP | 55.0 | 59.1 | 45.9 | 69 | 66 | 810 | 4,190 | 64.4 | 90.4 | 46.1 | 46.1 | 49.1 | 77.4 | 50.5 | 70.9 | 79.3 | 0.7 | 305 | 296 |
| MOT17-07-DPM | 41.4 | 43.7 | 33.0 | 5 | 22 | 633 | 9,143 | 45.9 | 92.4 | 32.7 | 33.7 | 34.6 | 71.9 | 35.4 | 71.4 | 77.5 | 1.3 | 131 | 255 |
| MOT17-07-FRCNN | 34.3 | 42.5 | 33.6 | 8 | 14 | 1,930 | 9,002 | 46.7 | 80.3 | 34.8 | 33.4 | 37.1 | 70.7 | 37.4 | 64.3 | 77.6 | 3.9 | 165 | 294 |
| MOT17-07-SDP | 46.4 | 45.8 | 36.8 | 16 | 11 | 1,579 | 7,202 | 57.4 | 86.0 | 33.8 | 40.5 | 35.9 | 72.8 | 45.2 | 67.8 | 79.0 | 3.2 | 269 | 398 |
| MOT17-08-DPM | 25.3 | 28.8 | 25.6 | 7 | 40 | 425 | 15,229 | 27.9 | 93.3 | 29.7 | 22.2 | 30.9 | 77.5 | 22.9 | 76.6 | 81.7 | 0.7 | 134 | 165 |
| MOT17-08-FRCNN | 23.2 | 29.8 | 27.6 | 9 | 37 | 924 | 15,227 | 27.9 | 86.5 | 34.6 | 22.1 | 36.3 | 81.4 | 23.4 | 72.3 | 82.3 | 1.5 | 76 | 108 |
| MOT17-08-SDP | 29.8 | 33.1 | 29.7 | 11 | 31 | 1,091 | 13,431 | 36.4 | 87.6 | 31.7 | 28.2 | 33.3 | 78.6 | 30.0 | 72.2 | 80.9 | 1.7 | 313 | 356 |
| MOT17-12-DPM | 43.6 | 54.5 | 41.5 | 16 | 41 | 275 | 4,560 | 47.4 | 93.7 | 48.5 | 35.6 | 51.1 | 77.9 | 37.5 | 74.2 | 80.3 | 0.3 | 54 | 78 |
| MOT17-12-FRCNN | 37.1 | 52.7 | 41.3 | 15 | 42 | 858 | 4,547 | 47.5 | 82.8 | 49.6 | 34.7 | 52.7 | 78.5 | 38.8 | 67.5 | 81.0 | 1.0 | 45 | 69 |
| MOT17-12-SDP | 36.5 | 54.9 | 44.0 | 22 | 34 | 1,422 | 3,965 | 54.3 | 76.8 | 52.1 | 37.5 | 55.1 | 78.5 | 44.3 | 62.7 | 80.9 | 1.6 | 119 | 161 |
| MOT17-14-DPM | 24.1 | 34.9 | 25.4 | 8 | 102 | 477 | 13,448 | 27.2 | 91.3 | 32.1 | 20.3 | 33.9 | 74.3 | 21.0 | 70.4 | 77.7 | 0.6 | 96 | 203 |
| MOT17-14-FRCNN | 17.0 | 35.6 | 28.0 | 12 | 74 | 3,418 | 11,644 | 37.0 | 66.7 | 31.5 | 25.6 | 34.2 | 68.1 | 29.8 | 53.7 | 74.6 | 4.6 | 288 | 485 |
| MOT17-14-SDP | 27.3 | 43.3 | 32.0 | 16 | 53 | 3,459 | 9,563 | 48.3 | 72.1 | 33.1 | 31.4 | 34.9 | 72.5 | 37.2 | 55.6 | 75.5 | 4.6 | 419 | 622 |
Raw data: