Benchmark:
MOT17 |
Short name:
EDA_GNN_17
Detector:
Public
Description:
n/a
Reference:
Paper ID 2713
Last submitted:
November 16, 2018 (6 years ago)
Published:
November 16, 2018 at 09:23:41 CET
Submissions:
1
Project page / code:
n/a
Open source:
No
Hardware:
NVIDIA TITAN XP
Runtime:
39.3 Hz
Benchmark performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17 | 45.5 | 40.5 | 33.6 | 368 (15.6) | 955 (40.6) | 25,685 | 277,663 | 50.8 | 91.8 | 30.3 | 37.8 | 32.2 | 72.9 | 40.3 | 72.8 | 79.5 | 1.4 | 4,091 (80.5) | 5,579 (109.8) |
Detailed performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17-01-DPM | 23.7 | 25.4 | 19.8 | 2 | 13 | 133 | 4,749 | 26.4 | 92.7 | 20.5 | 19.2 | 24.6 | 53.9 | 19.8 | 69.6 | 76.8 | 0.3 | 38 | 57 |
MOT17-01-FRCNN | 27.0 | 36.9 | 33.5 | 6 | 8 | 1,438 | 3,234 | 49.9 | 69.1 | 34.2 | 33.3 | 37.9 | 69.0 | 40.9 | 56.6 | 78.8 | 3.2 | 38 | 58 |
MOT17-01-SDP | 40.0 | 31.5 | 26.4 | 7 | 5 | 898 | 2,859 | 55.7 | 80.0 | 19.0 | 37.2 | 21.7 | 58.2 | 43.0 | 61.8 | 77.3 | 2.0 | 113 | 140 |
MOT17-03-DPM | 42.8 | 32.9 | 26.9 | 19 | 35 | 5,148 | 54,250 | 48.2 | 90.7 | 20.8 | 35.3 | 21.4 | 75.6 | 37.7 | 71.0 | 78.7 | 3.4 | 503 | 610 |
MOT17-03-FRCNN | 58.1 | 51.3 | 41.1 | 39 | 26 | 2,053 | 41,484 | 60.4 | 96.9 | 37.0 | 46.3 | 39.2 | 76.3 | 48.4 | 77.7 | 80.8 | 1.4 | 275 | 462 |
MOT17-03-SDP | 70.0 | 50.1 | 42.0 | 66 | 17 | 3,090 | 27,770 | 73.5 | 96.1 | 32.3 | 55.0 | 34.5 | 71.4 | 58.2 | 76.2 | 79.8 | 2.1 | 560 | 1,024 |
MOT17-06-DPM | 37.9 | 38.0 | 29.1 | 15 | 125 | 316 | 6,852 | 41.9 | 94.0 | 28.0 | 30.4 | 29.1 | 75.3 | 31.8 | 71.5 | 78.0 | 0.3 | 149 | 132 |
MOT17-06-FRCNN | 53.3 | 53.4 | 42.6 | 48 | 68 | 544 | 4,772 | 59.5 | 92.8 | 40.1 | 45.4 | 42.3 | 79.1 | 48.5 | 75.6 | 81.1 | 0.5 | 187 | 217 |
MOT17-06-SDP | 54.7 | 50.5 | 39.5 | 59 | 71 | 564 | 4,581 | 61.1 | 92.7 | 35.0 | 44.7 | 37.9 | 73.5 | 48.0 | 72.9 | 79.7 | 0.5 | 195 | 190 |
MOT17-07-DPM | 29.2 | 25.6 | 20.8 | 4 | 32 | 626 | 11,198 | 33.7 | 90.1 | 17.8 | 24.7 | 18.7 | 68.5 | 25.9 | 69.2 | 77.4 | 1.3 | 135 | 181 |
MOT17-07-FRCNN | 32.3 | 35.8 | 30.1 | 5 | 14 | 1,600 | 9,575 | 43.3 | 82.1 | 29.9 | 31.3 | 32.6 | 65.0 | 34.5 | 65.3 | 77.4 | 3.2 | 263 | 408 |
MOT17-07-SDP | 43.4 | 33.8 | 27.7 | 11 | 20 | 891 | 8,375 | 50.4 | 90.5 | 21.0 | 36.8 | 22.7 | 62.2 | 39.5 | 70.9 | 78.8 | 1.8 | 288 | 325 |
MOT17-08-DPM | 21.3 | 22.4 | 20.2 | 5 | 43 | 746 | 15,744 | 25.5 | 87.8 | 20.4 | 20.1 | 21.3 | 74.3 | 21.0 | 72.5 | 80.9 | 1.2 | 131 | 104 |
MOT17-08-FRCNN | 22.9 | 29.0 | 26.6 | 8 | 37 | 866 | 15,339 | 27.4 | 87.0 | 33.1 | 21.5 | 34.7 | 81.0 | 22.7 | 72.1 | 81.9 | 1.4 | 87 | 108 |
MOT17-08-SDP | 28.8 | 27.9 | 25.6 | 10 | 35 | 440 | 14,424 | 31.7 | 93.8 | 26.8 | 24.7 | 28.4 | 74.2 | 25.6 | 75.9 | 81.1 | 0.7 | 167 | 200 |
MOT17-12-DPM | 34.9 | 36.7 | 30.7 | 9 | 52 | 441 | 5,147 | 40.6 | 88.9 | 31.2 | 30.3 | 32.6 | 75.6 | 32.3 | 70.7 | 79.8 | 0.5 | 55 | 40 |
MOT17-12-FRCNN | 38.7 | 50.3 | 39.4 | 14 | 45 | 443 | 4,835 | 44.2 | 89.6 | 46.4 | 33.6 | 48.9 | 78.1 | 36.0 | 72.9 | 81.1 | 0.5 | 37 | 52 |
MOT17-12-SDP | 42.2 | 50.2 | 40.8 | 19 | 44 | 475 | 4,490 | 48.2 | 89.8 | 46.0 | 36.3 | 48.9 | 75.5 | 39.1 | 72.8 | 81.3 | 0.5 | 42 | 47 |
MOT17-14-DPM | 15.8 | 21.3 | 16.7 | 4 | 122 | 350 | 15,113 | 18.2 | 90.6 | 20.5 | 13.6 | 21.6 | 68.4 | 14.0 | 69.4 | 77.5 | 0.5 | 102 | 136 |
MOT17-14-FRCNN | 16.7 | 30.4 | 24.4 | 10 | 77 | 3,141 | 11,839 | 35.9 | 67.9 | 24.7 | 25.1 | 27.8 | 56.1 | 28.8 | 54.3 | 74.1 | 4.2 | 408 | 626 |
MOT17-14-SDP | 30.6 | 33.0 | 24.8 | 8 | 66 | 1,482 | 11,033 | 40.3 | 83.4 | 21.9 | 28.4 | 23.8 | 61.7 | 30.9 | 64.0 | 76.4 | 2.0 | 318 | 462 |
Raw data: