Benchmark:
MOT17 |
Short name:
eTC17
Detector:
Public
Description:
n/a
Reference:
G. Wang, Y. Wang, H. Zhang, R. Gu, J. Hwang. Exploit the connectivity: Multi-object tracking with trackletnet. In Proceedings of the 27th ACM International Conference on Multimedia, 2019.
Last submitted:
March 19, 2019 (5 years ago)
Published:
October 18, 2018 at 06:21:52 CET
Submissions:
3
Project page / code:
Open source:
No
Hardware:
2.6GHZ, 4 core
Runtime:
0.7 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17 | 51.9 | 58.1 | 44.9 | 544 (23.1) | 836 (35.5) | 36,164 | 232,783 | 58.7 | 90.2 | 47.0 | 43.3 | 51.7 | 72.1 | 46.9 | 72.0 | 79.4 | 2.0 | 2,288 (38.9) | 3,071 (52.3) |
Detailed performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17-01-DPM | 37.1 | 46.7 | 35.4 | 4 | 11 | 192 | 3,850 | 40.3 | 93.1 | 43.0 | 29.3 | 48.3 | 72.1 | 30.5 | 70.6 | 76.6 | 0.4 | 18 | 39 |
| MOT17-01-FRCNN | 28.6 | 52.3 | 42.7 | 8 | 7 | 1,654 | 2,938 | 54.4 | 68.0 | 52.0 | 35.3 | 56.1 | 76.8 | 44.5 | 55.6 | 78.9 | 3.7 | 14 | 27 |
| MOT17-01-SDP | 49.8 | 54.6 | 43.1 | 9 | 5 | 884 | 2,308 | 64.2 | 82.4 | 43.2 | 43.3 | 49.1 | 72.7 | 50.4 | 64.7 | 79.1 | 2.0 | 44 | 42 |
| MOT17-03-DPM | 56.5 | 63.1 | 46.9 | 46 | 30 | 6,785 | 38,548 | 63.2 | 90.7 | 47.7 | 46.4 | 52.4 | 70.8 | 50.0 | 71.8 | 78.1 | 4.5 | 152 | 273 |
| MOT17-03-FRCNN | 61.3 | 62.8 | 47.6 | 46 | 23 | 3,475 | 36,890 | 64.8 | 95.1 | 46.9 | 48.8 | 51.5 | 70.8 | 51.7 | 76.0 | 80.1 | 2.3 | 194 | 406 |
| MOT17-03-SDP | 74.4 | 69.5 | 54.8 | 89 | 13 | 6,744 | 19,776 | 81.1 | 92.6 | 51.1 | 59.1 | 56.2 | 71.6 | 64.7 | 73.9 | 80.0 | 4.5 | 274 | 355 |
| MOT17-06-DPM | 47.7 | 55.9 | 41.3 | 42 | 100 | 427 | 5,641 | 52.1 | 93.5 | 45.1 | 38.1 | 49.5 | 73.8 | 40.2 | 72.1 | 77.9 | 0.4 | 90 | 120 |
| MOT17-06-FRCNN | 53.2 | 59.9 | 47.4 | 67 | 59 | 1,079 | 4,296 | 63.5 | 87.4 | 47.9 | 47.2 | 56.2 | 70.7 | 52.3 | 71.9 | 80.7 | 0.9 | 136 | 168 |
| MOT17-06-SDP | 53.2 | 60.9 | 47.3 | 82 | 65 | 1,442 | 3,912 | 66.8 | 84.5 | 48.1 | 46.8 | 58.9 | 66.7 | 53.3 | 67.5 | 79.2 | 1.2 | 156 | 179 |
| MOT17-07-DPM | 41.7 | 47.3 | 35.7 | 8 | 23 | 750 | 8,991 | 46.8 | 91.3 | 37.5 | 34.3 | 39.5 | 76.7 | 36.4 | 71.1 | 78.4 | 1.5 | 101 | 120 |
| MOT17-07-FRCNN | 35.4 | 42.4 | 33.7 | 4 | 20 | 965 | 9,828 | 41.8 | 88.0 | 37.1 | 31.4 | 39.2 | 76.8 | 33.6 | 70.6 | 79.0 | 1.9 | 124 | 192 |
| MOT17-07-SDP | 49.1 | 48.7 | 39.1 | 16 | 16 | 895 | 7,581 | 55.1 | 91.2 | 37.5 | 41.1 | 39.5 | 78.1 | 44.3 | 73.3 | 80.6 | 1.8 | 127 | 136 |
| MOT17-08-DPM | 30.4 | 43.4 | 36.8 | 15 | 35 | 1,272 | 13,350 | 36.8 | 85.9 | 48.2 | 28.2 | 51.3 | 77.6 | 30.3 | 70.8 | 81.2 | 2.0 | 88 | 87 |
| MOT17-08-FRCNN | 28.2 | 38.9 | 34.7 | 14 | 41 | 226 | 14,902 | 29.5 | 96.5 | 50.7 | 23.8 | 53.7 | 80.4 | 24.4 | 79.9 | 82.8 | 0.4 | 40 | 52 |
| MOT17-08-SDP | 31.4 | 43.4 | 36.3 | 19 | 27 | 2,657 | 11,672 | 44.7 | 78.1 | 40.6 | 33.0 | 46.7 | 64.1 | 37.2 | 65.1 | 79.5 | 4.3 | 162 | 177 |
| MOT17-12-DPM | 42.4 | 54.4 | 41.5 | 14 | 42 | 298 | 4,667 | 46.2 | 93.1 | 48.9 | 35.4 | 51.3 | 78.7 | 37.2 | 75.0 | 80.6 | 0.3 | 28 | 29 |
| MOT17-12-FRCNN | 38.9 | 53.6 | 41.1 | 12 | 45 | 570 | 4,698 | 45.8 | 87.4 | 49.1 | 34.7 | 52.1 | 78.5 | 37.6 | 71.8 | 81.6 | 0.6 | 28 | 33 |
| MOT17-12-SDP | 38.6 | 57.2 | 44.3 | 18 | 38 | 1,031 | 4,251 | 51.0 | 81.1 | 53.1 | 37.2 | 59.1 | 75.6 | 42.3 | 67.2 | 81.6 | 1.1 | 42 | 47 |
| MOT17-14-DPM | 25.9 | 39.6 | 28.4 | 9 | 97 | 815 | 12,799 | 30.8 | 87.5 | 35.6 | 22.8 | 37.8 | 74.1 | 24.1 | 68.4 | 78.0 | 1.1 | 73 | 90 |
| MOT17-14-FRCNN | 20.7 | 36.8 | 27.7 | 7 | 75 | 2,264 | 12,177 | 34.1 | 73.6 | 31.2 | 25.1 | 34.2 | 66.1 | 27.7 | 59.8 | 75.3 | 3.0 | 217 | 276 |
| MOT17-14-SDP | 37.1 | 50.6 | 36.1 | 15 | 64 | 1,739 | 9,708 | 47.5 | 83.5 | 39.3 | 33.6 | 43.1 | 69.9 | 37.0 | 65.1 | 77.0 | 2.3 | 180 | 223 |
Raw data: