Benchmark:
MOT17 |
Short name:
PermaTrack
Detector:
Public
Description:
Reference:
P. Tokmakov, J. Li, W. Burgard, A. Gaidon. Learning to Track with Object Permanence. In ICCV, 2021.
Last submitted:
May 07, 2021 (3 years ago)
Published:
May 07, 2021 at 04:53:20 CET
Submissions:
4
Project page / code:
n/a
Open source:
No
Hardware:
1 Tesla V100
Runtime:
11.9 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17 | 73.1 | 67.2 | 54.2 | 996 (42.3) | 450 (19.1) | 24,577 | 123,508 | 78.1 | 94.7 | 51.2 | 58.0 | 59.6 | 67.9 | 62.8 | 76.1 | 81.6 | 1.4 | 3,571 (0.0) | 5,826 (0.0) |
Detailed performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17-01-DPM | 50.4 | 48.1 | 38.9 | 10 | 8 | 712 | 2,461 | 61.8 | 84.9 | 36.0 | 42.3 | 44.2 | 57.8 | 48.4 | 66.5 | 80.2 | 1.6 | 27 | 50 |
| MOT17-01-FRCNN | 49.8 | 48.5 | 39.0 | 11 | 8 | 789 | 2,418 | 62.5 | 83.6 | 36.3 | 42.0 | 43.7 | 59.5 | 48.7 | 65.2 | 80.1 | 1.8 | 30 | 56 |
| MOT17-01-SDP | 50.7 | 48.3 | 39.2 | 12 | 8 | 824 | 2,321 | 64.0 | 83.4 | 36.0 | 42.8 | 43.3 | 59.6 | 49.9 | 65.0 | 79.9 | 1.8 | 32 | 60 |
| MOT17-03-DPM | 87.8 | 78.9 | 62.3 | 128 | 5 | 1,936 | 10,645 | 89.8 | 98.0 | 57.6 | 67.8 | 66.7 | 71.3 | 71.9 | 78.4 | 81.4 | 1.3 | 164 | 395 |
| MOT17-03-FRCNN | 88.1 | 80.2 | 63.0 | 128 | 5 | 1,913 | 10,365 | 90.1 | 98.0 | 58.7 | 68.0 | 66.9 | 72.4 | 72.1 | 78.4 | 81.4 | 1.3 | 161 | 377 |
| MOT17-03-SDP | 88.5 | 80.3 | 63.5 | 128 | 4 | 2,021 | 9,830 | 90.6 | 97.9 | 59.4 | 68.3 | 66.9 | 73.6 | 72.5 | 78.3 | 81.3 | 1.3 | 150 | 377 |
| MOT17-06-DPM | 60.1 | 45.6 | 38.1 | 80 | 52 | 591 | 3,922 | 66.7 | 93.0 | 29.9 | 49.4 | 50.3 | 43.1 | 53.5 | 74.6 | 81.2 | 0.5 | 194 | 279 |
| MOT17-06-FRCNN | 61.0 | 47.5 | 39.2 | 82 | 45 | 684 | 3,695 | 68.6 | 92.2 | 31.1 | 50.1 | 49.9 | 44.6 | 54.8 | 73.7 | 81.1 | 0.6 | 216 | 298 |
| MOT17-06-SDP | 60.8 | 47.2 | 39.1 | 82 | 47 | 676 | 3,738 | 68.3 | 92.2 | 31.0 | 50.0 | 49.9 | 44.5 | 54.6 | 73.8 | 81.1 | 0.6 | 202 | 290 |
| MOT17-07-DPM | 59.8 | 48.6 | 40.8 | 22 | 4 | 2,041 | 4,520 | 73.2 | 85.8 | 34.4 | 49.8 | 40.1 | 58.7 | 57.8 | 67.7 | 80.1 | 4.1 | 228 | 368 |
| MOT17-07-FRCNN | 59.4 | 49.2 | 41.3 | 25 | 4 | 1,993 | 4,638 | 72.5 | 86.0 | 35.4 | 49.4 | 40.7 | 61.1 | 57.2 | 67.8 | 80.1 | 4.0 | 231 | 367 |
| MOT17-07-SDP | 60.0 | 47.9 | 40.8 | 25 | 4 | 2,103 | 4,421 | 73.8 | 85.6 | 34.1 | 50.1 | 39.7 | 59.3 | 58.3 | 67.5 | 80.1 | 4.2 | 226 | 373 |
| MOT17-08-DPM | 50.4 | 45.5 | 39.6 | 24 | 15 | 806 | 9,499 | 55.0 | 93.5 | 37.3 | 42.8 | 44.1 | 59.9 | 45.8 | 77.8 | 83.6 | 1.3 | 180 | 251 |
| MOT17-08-FRCNN | 49.0 | 45.5 | 39.6 | 23 | 15 | 785 | 9,807 | 53.6 | 93.5 | 38.1 | 41.8 | 45.0 | 61.2 | 44.7 | 78.0 | 83.8 | 1.3 | 178 | 259 |
| MOT17-08-SDP | 50.8 | 46.0 | 39.7 | 24 | 15 | 848 | 9,365 | 55.7 | 93.3 | 37.2 | 43.2 | 44.0 | 60.8 | 46.3 | 77.6 | 83.5 | 1.4 | 186 | 266 |
| MOT17-12-DPM | 50.6 | 58.1 | 49.8 | 27 | 30 | 1,120 | 3,117 | 64.0 | 83.2 | 52.7 | 47.1 | 62.5 | 70.5 | 54.8 | 71.2 | 85.6 | 1.2 | 41 | 74 |
| MOT17-12-FRCNN | 54.4 | 59.7 | 50.7 | 27 | 32 | 721 | 3,190 | 63.2 | 88.4 | 53.0 | 48.6 | 62.9 | 70.2 | 54.1 | 75.7 | 85.7 | 0.8 | 38 | 67 |
| MOT17-12-SDP | 52.6 | 59.0 | 50.3 | 27 | 29 | 968 | 3,098 | 64.3 | 85.2 | 52.7 | 48.1 | 62.7 | 69.9 | 55.0 | 72.9 | 85.5 | 1.1 | 41 | 77 |
| MOT17-14-DPM | 52.0 | 51.9 | 40.1 | 35 | 39 | 847 | 7,697 | 58.4 | 92.7 | 37.3 | 43.4 | 42.8 | 61.3 | 46.8 | 74.4 | 81.4 | 1.1 | 321 | 491 |
| MOT17-14-FRCNN | 51.5 | 51.5 | 40.0 | 37 | 41 | 1,125 | 7,485 | 59.5 | 90.7 | 36.9 | 43.7 | 42.4 | 60.8 | 47.8 | 72.8 | 81.3 | 1.5 | 362 | 517 |
| MOT17-14-SDP | 52.9 | 52.4 | 40.9 | 39 | 40 | 1,074 | 7,276 | 60.6 | 91.3 | 37.7 | 44.6 | 43.1 | 61.5 | 48.7 | 73.2 | 81.3 | 1.4 | 363 | 534 |
Raw data: