Benchmark:
MOT15 |
Short name:
SAS_MOT15
Detector:
Public
Description:
n/a
Reference:
A. Maksai, P. Fua. Eliminating Exposure Bias and Metric Mismatch in Multiple Object Tracking. In CVPR, 2019.
Last submitted:
May 03, 2018 (5 years ago)
Published:
May 14, 2019 at 21:14:35 CET
Submissions:
1
Project page / code:
n/a
Open source:
No
Hardware:
2.5 GHZ, 1 Core
Runtime:
8.9 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT15 | 22.2 | 27.2 | 21.7 | 22 (3.1) | 444 (61.6) | 5,591 | 41,531 | 32.4 | 78.1 | 21.1 | 22.5 | 26.3 | 52.1 | 24.6 | 59.3 | 74.8 | 1.0 | 700 (21.6) | 1,240 (38.3) |
Detailed performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| ADL-Rundle-1 | 14.7 | 26.8 | 22.9 | 4 | 8 | 2,592 | 5,203 | 44.1 | 61.3 | 20.1 | 26.9 | 26.1 | 50.1 | 34.3 | 47.7 | 75.2 | 5.2 | 143 | 254 |
| ADL-Rundle-3 | 32.3 | 34.0 | 25.8 | 4 | 14 | 875 | 5,891 | 42.1 | 83.0 | 23.0 | 29.2 | 26.5 | 58.1 | 32.0 | 63.2 | 76.1 | 1.4 | 120 | 130 |
| AVG-TownCentre | 9.2 | 11.7 | 12.6 | 0 | 178 | 195 | 6,277 | 12.2 | 81.7 | 17.9 | 9.0 | 28.6 | 34.0 | 9.2 | 61.8 | 73.7 | 0.4 | 19 | 53 |
| ETH-Crossing | 15.2 | 22.3 | 18.4 | 0 | 20 | 13 | 834 | 16.8 | 92.9 | 26.4 | 12.9 | 27.4 | 70.9 | 13.1 | 72.0 | 77.2 | 0.1 | 4 | 6 |
| ETH-Jelmoli | 38.3 | 41.9 | 30.1 | 6 | 15 | 320 | 1,209 | 52.3 | 80.6 | 25.9 | 35.1 | 37.3 | 47.1 | 39.8 | 61.3 | 75.8 | 0.7 | 37 | 61 |
| ETH-Linthescher | 15.7 | 19.5 | 17.5 | 3 | 155 | 129 | 7,360 | 17.6 | 92.4 | 23.5 | 13.0 | 29.5 | 56.4 | 13.3 | 69.8 | 76.9 | 0.1 | 36 | 52 |
| KITTI-16 | 34.9 | 43.9 | 30.4 | 0 | 3 | 130 | 951 | 44.1 | 85.2 | 30.9 | 29.9 | 34.7 | 60.9 | 32.7 | 63.2 | 75.7 | 0.6 | 26 | 46 |
| KITTI-19 | 18.7 | 32.8 | 23.5 | 2 | 24 | 691 | 3,590 | 32.8 | 71.7 | 23.8 | 23.7 | 28.6 | 50.0 | 25.7 | 56.1 | 70.5 | 0.7 | 65 | 233 |
| PETS09-S2L2 | 27.2 | 22.1 | 15.5 | 0 | 14 | 528 | 6,292 | 34.7 | 86.4 | 9.9 | 24.3 | 11.7 | 45.2 | 25.6 | 63.7 | 73.2 | 1.2 | 198 | 310 |
| TUD-Crossing | 59.2 | 50.3 | 35.3 | 3 | 2 | 25 | 401 | 63.6 | 96.6 | 28.1 | 44.5 | 36.2 | 55.0 | 47.3 | 71.8 | 77.3 | 0.1 | 24 | 40 |
| Venice-1 | 20.1 | 25.6 | 20.3 | 0 | 11 | 93 | 3,523 | 22.8 | 91.8 | 24.9 | 16.6 | 28.0 | 58.4 | 17.1 | 68.8 | 76.4 | 0.2 | 28 | 55 |
Raw data: