Benchmark:
MOT17 |
Short name:
CMT
Detector:
Public
Description:
n/a
Reference:
#Submission: TIP-21190-2019
Last submitted:
April 25, 2019 (4 years ago)
Published:
October 31, 2018 at 09:29:00 CET
Submissions:
3
Project page / code:
n/a
Open source:
No
Hardware:
i9-8950HK, 2.9 GHZ, 8 Core
Runtime:
6.5 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17 | 51.8 | 60.7 | 46.9 | 462 (19.6) | 1,009 (42.8) | 29,528 | 240,960 | 57.3 | 91.6 | 51.6 | 42.8 | 55.5 | 77.1 | 46.0 | 73.6 | 80.3 | 1.7 | 1,217 (21.2) | 2,008 (35.0) |
Detailed performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17-01-DPM | 41.6 | 55.6 | 41.3 | 5 | 13 | 143 | 3,622 | 43.8 | 95.2 | 53.9 | 31.6 | 60.0 | 70.9 | 32.9 | 71.3 | 76.4 | 0.3 | 3 | 15 |
| MOT17-01-FRCNN | 22.5 | 57.6 | 46.0 | 10 | 8 | 2,101 | 2,890 | 55.2 | 62.9 | 62.7 | 34.0 | 67.0 | 75.8 | 45.1 | 51.5 | 78.5 | 4.7 | 5 | 17 |
| MOT17-01-SDP | 41.4 | 65.9 | 49.6 | 9 | 7 | 1,580 | 2,186 | 66.1 | 73.0 | 61.5 | 40.2 | 64.8 | 77.4 | 51.2 | 56.5 | 78.5 | 3.5 | 11 | 26 |
| MOT17-03-DPM | 59.5 | 64.8 | 48.1 | 42 | 25 | 4,255 | 37,954 | 63.7 | 94.0 | 49.3 | 47.3 | 51.9 | 78.6 | 50.4 | 74.3 | 79.6 | 2.8 | 152 | 280 |
| MOT17-03-FRCNN | 61.5 | 68.5 | 51.7 | 47 | 27 | 3,153 | 37,019 | 64.6 | 95.5 | 55.2 | 48.8 | 58.0 | 80.6 | 51.7 | 76.4 | 80.5 | 2.1 | 130 | 177 |
| MOT17-03-SDP | 75.1 | 71.6 | 56.6 | 83 | 13 | 3,443 | 22,360 | 78.6 | 96.0 | 54.0 | 59.6 | 56.4 | 80.2 | 63.6 | 77.6 | 81.5 | 2.3 | 240 | 294 |
| MOT17-06-DPM | 43.7 | 52.3 | 40.3 | 38 | 119 | 718 | 5,885 | 50.1 | 89.1 | 44.6 | 36.7 | 60.0 | 59.9 | 39.5 | 70.4 | 78.7 | 0.6 | 34 | 64 |
| MOT17-06-FRCNN | 45.4 | 52.4 | 41.8 | 39 | 97 | 1,007 | 5,360 | 54.5 | 86.4 | 42.4 | 41.4 | 58.6 | 59.9 | 45.5 | 72.1 | 81.5 | 0.8 | 64 | 96 |
| MOT17-06-SDP | 47.5 | 55.9 | 43.5 | 57 | 106 | 928 | 5,202 | 55.9 | 87.6 | 46.1 | 41.3 | 61.1 | 62.1 | 45.3 | 71.1 | 80.4 | 0.8 | 52 | 80 |
| MOT17-07-DPM | 38.5 | 51.5 | 38.1 | 5 | 28 | 948 | 9,387 | 44.4 | 88.8 | 44.5 | 32.9 | 47.7 | 72.5 | 35.1 | 70.1 | 77.9 | 1.9 | 59 | 113 |
| MOT17-07-FRCNN | 33.6 | 47.6 | 36.8 | 6 | 24 | 1,153 | 10,010 | 40.7 | 85.7 | 45.3 | 30.3 | 49.9 | 71.6 | 32.7 | 68.7 | 78.4 | 2.3 | 50 | 139 |
| MOT17-07-SDP | 41.6 | 54.1 | 41.7 | 11 | 23 | 1,116 | 8,692 | 48.5 | 88.0 | 47.7 | 36.5 | 51.7 | 73.7 | 39.4 | 71.5 | 80.0 | 2.2 | 52 | 107 |
| MOT17-08-DPM | 30.1 | 48.6 | 41.2 | 16 | 33 | 2,119 | 12,589 | 40.4 | 80.1 | 55.1 | 30.9 | 60.4 | 72.0 | 34.0 | 67.6 | 80.4 | 3.4 | 59 | 84 |
| MOT17-08-FRCNN | 27.4 | 41.7 | 37.0 | 18 | 39 | 1,231 | 14,060 | 33.4 | 85.2 | 53.3 | 25.7 | 61.2 | 69.6 | 27.6 | 70.2 | 81.2 | 2.0 | 37 | 57 |
| MOT17-08-SDP | 34.6 | 48.5 | 41.5 | 18 | 37 | 720 | 13,049 | 38.2 | 91.8 | 57.0 | 30.3 | 61.5 | 77.5 | 31.8 | 76.3 | 82.4 | 1.2 | 40 | 63 |
| MOT17-12-DPM | 39.4 | 53.9 | 40.5 | 10 | 50 | 514 | 4,719 | 45.6 | 88.5 | 48.9 | 33.7 | 52.5 | 74.8 | 36.3 | 70.5 | 80.0 | 0.6 | 18 | 26 |
| MOT17-12-FRCNN | 38.1 | 53.5 | 42.2 | 13 | 52 | 578 | 4,769 | 45.0 | 87.1 | 52.2 | 34.3 | 56.7 | 76.3 | 37.1 | 71.8 | 81.2 | 0.6 | 14 | 21 |
| MOT17-12-SDP | 44.2 | 58.7 | 45.0 | 16 | 45 | 472 | 4,337 | 50.0 | 90.2 | 53.6 | 37.9 | 57.9 | 78.3 | 41.0 | 73.9 | 82.6 | 0.5 | 24 | 25 |
| MOT17-14-DPM | 28.7 | 40.3 | 29.5 | 7 | 95 | 240 | 12,909 | 30.2 | 95.9 | 38.1 | 23.0 | 40.3 | 73.5 | 23.7 | 75.3 | 79.6 | 0.3 | 37 | 48 |
| MOT17-14-FRCNN | 20.8 | 38.4 | 28.9 | 6 | 89 | 1,921 | 12,642 | 31.6 | 75.3 | 36.4 | 23.3 | 40.4 | 66.1 | 25.5 | 60.7 | 75.8 | 2.6 | 77 | 161 |
| MOT17-14-SDP | 32.0 | 47.9 | 33.9 | 6 | 79 | 1,188 | 11,319 | 38.8 | 85.8 | 41.6 | 27.8 | 44.6 | 73.2 | 30.1 | 66.6 | 78.0 | 1.6 | 59 | 115 |
Raw data: