HybridDAT: A Hybrid Data Association Framework for Robust Online Multi-Object Tracking

TUD-Crossing


Benchmark:

Short name:

HybridDAT

Detector:

Public

Description:

Global optimization algorithms have shown impressive performance in data-association based multi-object tracking, but handling online data remains a difficult hurdle to overcome. In this paper, we present a hybrid data association framework with a min-cost multi-commodity network flow for robust online
multi-object tracking.We build local target-specific models interleaved with global optimization of the optimal data association over multiple video frames. More specifically, in the mincost multi-commodity network flow, the target-specific similarities are online learned to enforce the local consistency for reducing the complexity of the global data association. Meanwhile, the
global data association taking multiple video frames into account alleviates irrecoverable errors caused by the local data association between adjacent frames. To ensure the efficiency of online tracking, we give an efficient near-optimal solution to the proposed min-cost multi-commodity flow problem, and provide the empirical proof of its sub-optimality. The comprehensive experiments on real data demonstrate the superior tracking performance of our approach in various challenging situations.

Reference:

M. Yang, Y. Jia. A Hybrid Data Association Framework for Robust Online Multi-Object Tracking. In IEEE Transactions on Image Processing, 2016.

Last submitted:

May 30, 2016 (4 years ago)

Published:

August 24, 2017 at 14:20:15 CET

Submissions:

2

Project page / code:

n/a

Open source:

No

Hardware:

3.4 GHZ, 1 Core

Runtime:

4.6 Hz

Benchmark performance:

Sequence MOTA IDF1 MOTP MT ML FP FN Recall Precision FAF ID Sw. Frag
2D MOT 201535.047.772.682 (11.4)304 (42.2)8,45531,14049.378.21.5358 (7.3)1,267 (25.7)

Detailed performance:

Sequence MOTA IDF1 MOTP MT ML FP FN Recall Precision FAF ID Sw. Frag
ADL-Rundle-130.648.872.4922,8273,58261.566.95.752162
ADL-Rundle-334.143.878.4681,5605,08949.976.52.54982
AVG-TownCentre29.244.469.021985324,46537.583.51.261246
ETH-Crossing24.141.474.72162973127.190.40.1113
ETH-Jelmoli41.856.973.08152731,19353.083.10.61049
ETH-Linthescher27.137.776.710139876,40928.296.70.11252
KITTI-1646.365.071.71319870658.583.40.91033
KITTI-1927.553.466.37131,3102,53552.668.21.227184
PETS09-S2L247.746.069.3548174,11257.387.11.9110349
TUD-Crossing73.370.473.6824224477.995.30.2834
Venice-137.153.674.6547802,07454.576.11.71863

Raw data: