Benchmark:
MOT17 |
Short name:
STMA
Detector:
Public
Description:
Reference:
WHY, @BUAA
Last submitted:
November 17, 2020 (3 years ago)
Published:
December 07, 2020 at 11:11:13 CET
Submissions:
1
Project page / code:
n/a
Open source:
No
Hardware:
RTX 2080ti
Runtime:
1.2 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17 | 58.8 | 61.6 | 48.4 | 617 (26.2) | 763 (32.4) | 17,564 | 213,561 | 62.1 | 95.2 | 49.8 | 47.3 | 56.0 | 72.6 | 50.1 | 76.8 | 81.2 | 1.0 | 1,446 (23.3) | 3,430 (55.2) |
Detailed performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17-01-DPM | 43.5 | 48.6 | 39.9 | 6 | 11 | 77 | 3,556 | 44.9 | 97.4 | 46.6 | 34.3 | 51.8 | 73.7 | 35.5 | 77.2 | 80.5 | 0.2 | 12 | 36 |
| MOT17-01-FRCNN | 45.8 | 50.1 | 41.2 | 6 | 10 | 180 | 3,305 | 48.8 | 94.6 | 46.6 | 36.6 | 51.8 | 73.6 | 38.5 | 74.7 | 80.2 | 0.4 | 11 | 48 |
| MOT17-01-SDP | 46.1 | 50.0 | 41.4 | 6 | 10 | 181 | 3,284 | 49.1 | 94.6 | 46.6 | 36.9 | 52.1 | 75.4 | 38.8 | 74.7 | 80.1 | 0.4 | 14 | 46 |
| MOT17-03-DPM | 69.9 | 68.8 | 53.6 | 72 | 18 | 3,604 | 27,813 | 73.4 | 95.5 | 51.9 | 55.7 | 57.5 | 73.7 | 59.4 | 77.2 | 81.2 | 2.4 | 137 | 323 |
| MOT17-03-FRCNN | 71.5 | 70.8 | 54.6 | 69 | 17 | 2,740 | 26,935 | 74.3 | 96.6 | 53.4 | 56.1 | 58.9 | 74.2 | 59.6 | 77.5 | 81.0 | 1.8 | 114 | 278 |
| MOT17-03-SDP | 75.4 | 72.4 | 56.6 | 87 | 14 | 4,550 | 21,053 | 79.9 | 94.8 | 54.2 | 59.5 | 60.7 | 72.1 | 64.0 | 76.0 | 80.6 | 3.0 | 167 | 502 |
| MOT17-06-DPM | 55.7 | 60.8 | 47.9 | 61 | 78 | 438 | 4,709 | 60.0 | 94.2 | 49.6 | 46.5 | 63.4 | 64.5 | 49.4 | 77.5 | 82.3 | 0.4 | 68 | 153 |
| MOT17-06-FRCNN | 60.4 | 62.0 | 49.3 | 70 | 56 | 566 | 4,035 | 65.8 | 93.2 | 48.6 | 50.2 | 63.4 | 62.1 | 54.0 | 76.5 | 82.1 | 0.5 | 71 | 180 |
| MOT17-06-SDP | 60.4 | 60.4 | 48.7 | 81 | 59 | 605 | 3,998 | 66.1 | 92.8 | 47.5 | 50.3 | 65.4 | 59.7 | 54.2 | 76.1 | 82.0 | 0.5 | 64 | 171 |
| MOT17-07-DPM | 46.0 | 47.8 | 37.2 | 8 | 20 | 260 | 8,798 | 47.9 | 96.9 | 37.9 | 36.7 | 40.9 | 74.3 | 38.3 | 77.5 | 81.2 | 0.5 | 72 | 152 |
| MOT17-07-FRCNN | 46.1 | 47.9 | 37.5 | 10 | 17 | 456 | 8,566 | 49.3 | 94.8 | 37.7 | 37.6 | 40.3 | 74.2 | 39.5 | 76.1 | 80.9 | 0.9 | 80 | 176 |
| MOT17-07-SDP | 49.0 | 48.7 | 38.2 | 10 | 16 | 498 | 8,034 | 52.4 | 94.7 | 37.3 | 39.5 | 41.1 | 70.9 | 41.8 | 75.4 | 80.7 | 1.0 | 81 | 204 |
| MOT17-08-DPM | 29.2 | 34.4 | 31.0 | 9 | 35 | 196 | 14,704 | 30.4 | 97.0 | 38.4 | 25.1 | 42.0 | 76.4 | 25.7 | 82.2 | 84.4 | 0.3 | 60 | 101 |
| MOT17-08-FRCNN | 28.3 | 33.8 | 30.8 | 12 | 38 | 257 | 14,840 | 29.7 | 96.1 | 38.6 | 24.7 | 43.4 | 76.2 | 25.3 | 81.8 | 84.3 | 0.4 | 46 | 95 |
| MOT17-08-SDP | 29.8 | 34.7 | 31.0 | 12 | 35 | 263 | 14,504 | 31.3 | 96.2 | 37.5 | 25.7 | 42.7 | 73.7 | 26.4 | 81.1 | 83.9 | 0.4 | 68 | 122 |
| MOT17-12-DPM | 48.8 | 54.4 | 45.5 | 18 | 36 | 142 | 4,271 | 50.7 | 96.9 | 50.9 | 40.8 | 59.0 | 71.7 | 42.5 | 81.1 | 83.7 | 0.2 | 23 | 41 |
| MOT17-12-FRCNN | 46.4 | 53.4 | 44.5 | 16 | 43 | 145 | 4,487 | 48.2 | 96.6 | 51.0 | 39.0 | 59.4 | 70.1 | 40.5 | 81.2 | 83.7 | 0.2 | 17 | 30 |
| MOT17-12-SDP | 47.7 | 56.6 | 46.5 | 19 | 42 | 219 | 4,295 | 50.4 | 95.2 | 53.6 | 40.5 | 59.9 | 73.0 | 42.4 | 80.1 | 83.6 | 0.2 | 15 | 35 |
| MOT17-14-DPM | 36.1 | 46.5 | 32.9 | 14 | 72 | 453 | 11,256 | 39.1 | 94.1 | 37.2 | 29.2 | 40.6 | 70.1 | 30.6 | 73.6 | 79.5 | 0.6 | 93 | 201 |
| MOT17-14-FRCNN | 35.8 | 46.9 | 33.6 | 15 | 71 | 846 | 10,911 | 41.0 | 90.0 | 37.9 | 30.1 | 40.8 | 71.0 | 32.0 | 70.4 | 79.0 | 1.1 | 110 | 250 |
| MOT17-14-SDP | 39.3 | 49.4 | 35.5 | 16 | 65 | 888 | 10,207 | 44.8 | 90.3 | 38.9 | 32.6 | 43.3 | 67.7 | 34.9 | 70.4 | 79.0 | 1.2 | 123 | 286 |
Raw data: