MotiCon: Learning an image-based motion context for multi-target tracking


Video not available.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Benchmark:

MOT15 |

Short name:

MotiCon

Detector:

Public

Description:

We present a novel method for multiple people tracking that leverages a generalized model for capturing interactions among individuals.
At the core of our model lies a learned dictionary of interaction feature strings which capture relationships between the motions of targets.
These feature strings, created from low-level image features, lead to a much richer representation of the physical interactions between targets compared to hand-specified social force models that previous works have introduced for tracking. One disadvantage of using social forces is that all pedestrians must be detected in order for the forces to be applied, while our method is able to encode the effect of undetected targets, making the tracker more robust to partial occlusions.
The interaction feature strings are used in a Random Forest framework to track targets according to the features surrounding them.

Reference:

L. Leal-Taixé, M. Fenzi, A. Kuznetsova, B. Rosenhahn, S. Savarese. Learning an image-based motion context for multiple people tracking. In CVPR, 2014.

Last submitted:

April 07, 2015 (9 years ago)

Published:

April 07, 2015 at 21:02:03 CET

Submissions:

1

Project page / code:

Open source:

Yes

Hardware:

2.6 GHz, 1 core

Runtime:

1.4 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT1523.129.40.034 (4.7)375 (52.0)10,40435,84441.771.10.00.00.00.00.00.00.01.81,018 (24.4)1,061 (25.5)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
ADL-Rundle-11.030.40.0644,4494,62850.351.30.00.00.00.00.00.00.08.9136170
ADL-Rundle-318.122.90.0292,7555,35547.363.60.00.00.00.00.00.00.04.4217140
AVG-TownCentre11.923.00.021583535,87217.978.30.00.00.00.00.00.00.00.87475
ETH-Crossing22.829.10.01171375324.995.10.00.00.00.00.00.00.00.188
ETH-Jelmoli43.552.40.09132951,10256.682.90.00.00.00.00.00.00.00.73751
ETH-Linthescher18.324.00.03146987,12420.294.90.00.00.00.00.00.00.00.17275
KITTI-1638.839.50.00214286349.385.50.00.00.00.00.00.00.00.73648
KITTI-1933.841.70.04138872,55252.275.90.00.00.00.00.00.00.00.8100126
PETS09-S2L246.627.20.0465604,35454.890.40.00.00.00.00.00.00.01.3238264
TUD-Crossing58.246.60.0323240363.495.60.00.00.00.00.00.00.00.22632
Venice-118.226.10.0058202,83837.867.80.00.00.00.00.00.00.01.87472

Raw data: