Benchmark:
MOT15 |
Short name:
TBX
Detector:
Public
Description:
We present a novel formulation of the multiple object tracking problem which integrates low and mid-level features. In particular, we formulate the tracking problem as a quadratic program coupling detections and dense point trajectories. Due to the computational complexity of the initial QP, we propose an approximation by two auxiliary problems, a temporal and spatial association, where the temporal subproblem can be efficiently solved by a linear program and the spatial association by a clustering algorithm. The objective function of the QP is used in order to find the optimal number of clusters, where each cluster ideally represents one person. Evaluation is provided for multiple scenarios, showing the superiority of our method with respect to classic tracking-by-detection methods and also other methods that greedily integrate low-level features.
Reference:
R. Henschel, L. Leal-Taixé, B. Rosenhahn, K. Schindler. Tracking with multi-level features. In arXiv:1607.07304, 2016.
Last submitted:
March 14, 2016 (8 years ago)
Published:
November 06, 2015 at 23:40:14 CET
Submissions:
2
Project page / code:
Open source:
No
Hardware:
3.50GHz, 1 Core
Runtime:
0.1 Hz
Benchmark performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT15 | 27.5 | 33.8 | 26.3 | 75 (10.4) | 330 (45.8) | 7,968 | 35,810 | 41.7 | 76.3 | 25.0 | 28.3 | 30.1 | 56.9 | 31.8 | 58.2 | 74.4 | 1.4 | 759 (18.2) | 1,528 (36.6) |
Detailed performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
ADL-Rundle-1 | 16.9 | 37.1 | 27.9 | 5 | 11 | 2,593 | 5,089 | 45.3 | 61.9 | 29.4 | 27.2 | 32.9 | 65.9 | 34.8 | 47.6 | 75.8 | 5.2 | 52 | 123 |
ADL-Rundle-3 | 29.1 | 28.8 | 22.2 | 4 | 11 | 1,289 | 5,837 | 42.6 | 77.1 | 17.2 | 29.4 | 17.8 | 70.7 | 33.1 | 59.8 | 75.8 | 2.1 | 85 | 69 |
AVG-TownCentre | 29.1 | 30.5 | 25.8 | 37 | 81 | 915 | 3,956 | 44.7 | 77.7 | 22.1 | 30.7 | 37.6 | 31.6 | 34.1 | 59.3 | 73.1 | 2.0 | 199 | 378 |
ETH-Crossing | 20.1 | 25.6 | 20.8 | 1 | 19 | 35 | 760 | 24.2 | 87.4 | 24.5 | 17.8 | 25.6 | 75.3 | 18.6 | 67.0 | 77.3 | 0.2 | 6 | 7 |
ETH-Jelmoli | 46.7 | 58.8 | 39.2 | 6 | 17 | 115 | 1,220 | 51.9 | 92.0 | 41.3 | 37.3 | 47.0 | 65.1 | 39.5 | 70.0 | 76.8 | 0.3 | 16 | 71 |
ETH-Linthescher | 16.1 | 24.2 | 22.0 | 4 | 160 | 131 | 7,345 | 17.7 | 92.4 | 35.9 | 13.5 | 39.6 | 70.4 | 13.8 | 72.0 | 78.0 | 0.1 | 12 | 43 |
KITTI-16 | 40.2 | 43.3 | 30.7 | 0 | 2 | 190 | 795 | 53.3 | 82.7 | 27.1 | 34.9 | 33.0 | 46.3 | 39.5 | 61.3 | 75.3 | 0.9 | 32 | 66 |
KITTI-19 | 23.4 | 43.8 | 31.2 | 7 | 16 | 1,046 | 2,998 | 43.9 | 69.2 | 32.4 | 30.4 | 38.7 | 53.4 | 34.4 | 54.2 | 70.7 | 1.0 | 51 | 233 |
PETS09-S2L2 | 41.8 | 33.2 | 24.9 | 4 | 2 | 1,391 | 3,949 | 59.0 | 80.4 | 16.1 | 38.9 | 20.3 | 41.9 | 43.9 | 59.8 | 72.8 | 3.2 | 269 | 496 |
TUD-Crossing | 58.3 | 56.9 | 42.9 | 7 | 1 | 150 | 282 | 74.4 | 84.5 | 38.7 | 47.7 | 42.8 | 65.4 | 55.4 | 63.0 | 75.9 | 0.7 | 28 | 25 |
Venice-1 | 18.9 | 21.6 | 17.3 | 0 | 10 | 113 | 3,579 | 21.6 | 89.7 | 19.1 | 15.9 | 19.6 | 73.4 | 16.4 | 68.2 | 76.5 | 0.3 | 9 | 17 |
Raw data: