Benchmark:
MOT17 |
Short name:
OAIE
Detector:
Public
Description:
Reference:
Last submitted:
October 16, 2024 (1 month ago)
Published:
September 04, 2024 at 20:37:06 CET
Submissions:
3
Project page / code:
n/a
Open source:
No
Hardware:
L4_GPU
Runtime:
25.4 Hz
Benchmark performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17 | 78.9 | 78.5 | 63.2 | 1,178 (50.0) | 371 (15.8) | 21,979 | 94,439 | 83.3 | 95.5 | 62.9 | 63.7 | 69.1 | 76.1 | 68.7 | 78.8 | 83.2 | 1.2 | 2,422 (0.0) | 3,712 (0.0) |
Detailed performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17-01-DPM | 61.5 | 66.7 | 53.6 | 12 | 5 | 536 | 1,933 | 70.0 | 89.4 | 55.4 | 52.1 | 60.8 | 79.2 | 58.1 | 74.2 | 83.4 | 1.2 | 12 | 59 |
MOT17-01-FRCNN | 61.9 | 67.8 | 54.5 | 10 | 5 | 414 | 2,033 | 68.5 | 91.4 | 57.3 | 51.9 | 63.4 | 78.0 | 56.9 | 76.0 | 83.6 | 0.9 | 9 | 51 |
MOT17-01-SDP | 61.5 | 66.7 | 53.6 | 12 | 5 | 536 | 1,933 | 70.0 | 89.4 | 55.4 | 52.1 | 60.8 | 79.2 | 58.1 | 74.2 | 83.4 | 1.2 | 12 | 59 |
MOT17-03-DPM | 92.3 | 91.4 | 72.6 | 143 | 0 | 3,496 | 4,498 | 95.7 | 96.6 | 72.3 | 73.2 | 77.5 | 80.4 | 78.7 | 79.5 | 83.0 | 2.3 | 68 | 249 |
MOT17-03-FRCNN | 92.3 | 91.4 | 72.6 | 143 | 0 | 3,496 | 4,498 | 95.7 | 96.6 | 72.3 | 73.2 | 77.5 | 80.4 | 78.7 | 79.5 | 83.0 | 2.3 | 68 | 249 |
MOT17-03-SDP | 92.3 | 91.4 | 72.6 | 143 | 0 | 3,496 | 4,498 | 95.7 | 96.6 | 72.3 | 73.2 | 77.5 | 80.4 | 78.7 | 79.5 | 83.0 | 2.3 | 68 | 249 |
MOT17-06-DPM | 62.7 | 56.8 | 47.2 | 100 | 52 | 711 | 3,459 | 70.6 | 92.1 | 41.9 | 53.6 | 59.3 | 55.4 | 58.7 | 76.6 | 83.6 | 0.6 | 220 | 195 |
MOT17-06-FRCNN | 61.9 | 55.0 | 45.9 | 90 | 56 | 626 | 3,654 | 69.0 | 92.9 | 40.2 | 52.8 | 58.2 | 54.3 | 57.5 | 77.3 | 83.8 | 0.5 | 204 | 176 |
MOT17-06-SDP | 62.7 | 56.8 | 47.2 | 100 | 52 | 711 | 3,459 | 70.6 | 92.1 | 41.9 | 53.6 | 59.3 | 55.4 | 58.7 | 76.6 | 83.6 | 0.6 | 220 | 195 |
MOT17-07-DPM | 72.6 | 58.7 | 48.9 | 32 | 5 | 425 | 4,113 | 75.7 | 96.8 | 41.2 | 58.3 | 46.3 | 68.3 | 62.2 | 79.6 | 83.3 | 0.9 | 88 | 151 |
MOT17-07-FRCNN | 72.6 | 58.7 | 48.9 | 32 | 5 | 425 | 4,113 | 75.7 | 96.8 | 41.2 | 58.3 | 46.3 | 68.3 | 62.2 | 79.6 | 83.3 | 0.9 | 88 | 151 |
MOT17-07-SDP | 72.6 | 58.7 | 48.9 | 32 | 5 | 425 | 4,113 | 75.7 | 96.8 | 41.2 | 58.3 | 46.3 | 68.3 | 62.2 | 79.6 | 83.3 | 0.9 | 88 | 151 |
MOT17-08-DPM | 61.1 | 54.0 | 46.2 | 32 | 8 | 998 | 7,049 | 66.6 | 93.4 | 42.3 | 51.4 | 50.1 | 64.1 | 55.5 | 77.8 | 83.4 | 1.6 | 163 | 318 |
MOT17-08-FRCNN | 61.1 | 54.0 | 46.2 | 32 | 8 | 998 | 7,049 | 66.6 | 93.4 | 42.3 | 51.4 | 50.1 | 64.1 | 55.5 | 77.8 | 83.4 | 1.6 | 163 | 318 |
MOT17-08-SDP | 61.1 | 54.0 | 46.2 | 32 | 8 | 998 | 7,049 | 66.6 | 93.4 | 42.3 | 51.4 | 50.1 | 64.1 | 55.5 | 77.8 | 83.4 | 1.6 | 163 | 318 |
MOT17-12-DPM | 63.6 | 67.3 | 57.0 | 46 | 13 | 1,214 | 1,900 | 78.1 | 84.8 | 57.8 | 56.4 | 68.5 | 71.0 | 66.5 | 72.2 | 85.2 | 1.3 | 37 | 84 |
MOT17-12-FRCNN | 69.0 | 68.2 | 57.7 | 40 | 18 | 293 | 2,372 | 72.6 | 95.6 | 57.5 | 58.2 | 68.0 | 71.1 | 62.2 | 81.9 | 85.8 | 0.3 | 25 | 56 |
MOT17-12-SDP | 63.6 | 67.3 | 57.0 | 46 | 13 | 1,214 | 1,900 | 78.1 | 84.8 | 57.8 | 56.4 | 68.5 | 71.0 | 66.5 | 72.2 | 85.2 | 1.3 | 37 | 84 |
MOT17-14-DPM | 53.8 | 65.4 | 46.7 | 38 | 35 | 354 | 8,013 | 56.6 | 96.7 | 49.9 | 44.0 | 53.1 | 79.1 | 46.2 | 78.9 | 82.7 | 0.5 | 170 | 193 |
MOT17-14-FRCNN | 49.2 | 60.7 | 43.1 | 25 | 43 | 259 | 8,790 | 52.4 | 97.4 | 45.8 | 40.9 | 48.9 | 75.6 | 42.7 | 79.3 | 82.7 | 0.3 | 349 | 213 |
MOT17-14-SDP | 53.8 | 65.4 | 46.7 | 38 | 35 | 354 | 8,013 | 56.6 | 96.7 | 49.9 | 44.0 | 53.1 | 79.1 | 46.2 | 78.9 | 82.7 | 0.5 | 170 | 193 |
Raw data: