TBX: Tracking-by-X


Video not available.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Benchmark:

MOT15 |

Short name:

TBX

Detector:

Public

Description:

We present a novel formulation of the multiple object tracking problem which integrates low and mid-level features. In particular, we formulate the tracking problem as a quadratic program coupling detections and dense point trajectories. Due to the computational complexity of the initial QP, we propose an approximation by two auxiliary problems, a temporal and spatial association, where the temporal subproblem can be efficiently solved by a linear program and the spatial association by a clustering algorithm. The objective function of the QP is used in order to find the optimal number of clusters, where each cluster ideally represents one person. Evaluation is provided for multiple scenarios, showing the superiority of our method with respect to classic tracking-by-detection methods and also other methods that greedily integrate low-level features.

Reference:

R. Henschel, L. Leal-Taixé, B. Rosenhahn, K. Schindler. Tracking with multi-level features. In arXiv:1607.07304, 2016.

Last submitted:

March 14, 2016 (8 years ago)

Published:

November 06, 2015 at 23:40:14 CET

Submissions:

2

Project page / code:

Open source:

No

Hardware:

3.50GHz, 1 Core

Runtime:

0.1 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT1527.533.826.375 (10.4)330 (45.8)7,96835,81041.776.325.028.330.156.931.858.274.41.4759 (18.2)1,528 (36.6)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
ADL-Rundle-116.937.127.95112,5935,08945.361.929.427.232.965.934.847.675.85.252123
ADL-Rundle-329.128.822.24111,2895,83742.677.117.229.417.870.733.159.875.82.18569
AVG-TownCentre29.130.525.837819153,95644.777.722.130.737.631.634.159.373.12.0199378
ETH-Crossing20.125.620.81193576024.287.424.517.825.675.318.667.077.30.267
ETH-Jelmoli46.758.839.26171151,22051.992.041.337.347.065.139.570.076.80.31671
ETH-Linthescher16.124.222.041601317,34517.792.435.913.539.670.413.872.078.00.11243
KITTI-1640.243.330.70219079553.382.727.134.933.046.339.561.375.30.93266
KITTI-1923.443.831.27161,0462,99843.969.232.430.438.753.434.454.270.71.051233
PETS09-S2L241.833.224.9421,3913,94959.080.416.138.920.341.943.959.872.83.2269496
TUD-Crossing58.356.942.97115028274.484.538.747.742.865.455.463.075.90.72825
Venice-118.921.617.30101133,57921.689.719.115.919.673.416.468.276.50.3917

Raw data: