DD_TAMA16: Online Multiple Pedestrian Tracking with Deep Temporal Appearance Matching Association

MOT16-01


Benchmark:

MOT16 |

Short name:

DD_TAMA16

Detector:

Public

Description:

In online multiple pedestrian tracking it is of great importance to construct reliable cost matrix for assigning observations to tracks. Each element of cost matrix is constructed by using similarity measure. Many previous works have proposed their own similarity calculation methods consisting of geometric model (e.g. bounding box coordinates) and appearance model. In particular, appearance model contains information with higher dimension compared to geometric model. Thanks to the recent success of deep learning based methods, handling of high dimensional appearance information becomes possible. Among many deep networks, a siamese network with triplet loss is popularly adopted as an appearance feature extractor. Since the siamese network can extract features of each input independently, it is possible to adaptively model tracks (e.g. linear
update). However, it is not suitable for multi-object setting that requires comparison with other inputs. In this paper we propose a novel track appearance modeling based on joint inference network to address this issue. The proposed method enables comparison of two inputs to be used for adaptive appearance
modeling. It contributes to disambiguating target-observation matching and consolidating the identity consistency. Intensive experimental results support effectiveness of our method. Ours has been awarded as a 3rd-highest tracker on MOTChallenge19, held in 4th BMTT workshop.

Project page / code:

n/a

Reference:

Y. Yoon, D. Kim, K. Yoon, Y. Song, M. Jeon. Online Multiple Pedestrian Tracking using Deep Temporal Appearance Matching Association. In arXiv:1907.00831, 2019.

Processing:

Online

Last submitted:

February 10, 2019 (1 year ago)

Published:

April 28, 2019 at 13:42:34 CET

Submissions:

1

Open source:

Yes

Hardware:

3.7GHZ, 1 Core, no GPU

Runtime:

6.5 Hz

Benchmark performance:

Sequence MOTA IDF1 MOTP MT ML FP FN Recall Precision FAF ID Sw. Frag
MOT1646.249.475.4107 (14.1)334 (44.0)5,12692,36749.394.60.9598 (12.1)1,127 (22.8)

Detailed performance:

Sequence MOTA IDF1 MOTP MT ML FP FN Recall Precision FAF ID Sw. Frag
MOT16-0139.044.271.85101123,76841.195.90.22048
MOT16-0354.253.575.629292,36345,32056.796.21.6248526
MOT16-0643.655.872.6351067865,64151.188.20.780162
MOT16-0739.844.673.25195439,20943.692.91.179165
MOT16-0832.935.580.192552610,64236.492.10.87071
MOT16-1242.051.476.518413144,45746.392.40.33748
MOT16-1424.935.874.6610448213,33027.991.40.664107

Raw data: