mfi_tst: Online multi-object tracking using multi-function integration and tracking simulation training

MOT16-03


Benchmark:

Short name:

mfi_tst

Detector:

Public

Description:

Recently, with the development of deep-learning, the performance of multi-object tracking algorithms based on the deep neural network has been greatly improved. However, most methods separate different functional modules into multiple networks and train them independently on specific tasks. When these network modules are used directly, they are not compatible with each other effectively, nor can they be better adapted to the multi-object tracking task, which leads to a poor tracking effect. Therefore, a network structure is designed to aggregate the regression of objects between frames and the extraction of appearance features into one model to improve the harmony between various functional modules of multi-object tracking. To improve the support for the multi-object tracking task, an end-to-end training method is also proposed to simulate the multi-object tracking process during the training and expand the training data by using the historical position of the target combined with the prediction of the motion model. A metric loss that can take advantage of the historical appearance features of the target is also used to train the extraction module of appearance features to improve the temporal correlation of extracted appearance features. Evaluation results on the MOTChallenge benchmark datasets show that the proposed approach achieves state-of-the-art performance.

Reference:

J. Y, H. Ge, J. Yang, Y. Tong, S. Su. Online multi-object tracking using multi-function integration and tracking simulation training. In Applied Intelligence, 2021.

Last submitted:

May 12, 2021 (2 years ago)

Published:

May 12, 2021 at 09:06:37 CET

Submissions:

1

Project page / code:

n/a

Open source:

No

Hardware:

2080TI

Runtime:

0.7 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT1659.958.746.9183 (24.1)234 (30.8)3,66068,92362.296.946.048.149.077.550.578.681.80.6616 (0.0)1,050 (0.0)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT16-0146.647.238.9691183,26748.996.442.136.244.875.837.874.579.20.32740
MOT16-0370.265.251.964191,63129,43271.997.948.655.751.677.658.479.581.91.1138223
MOT16-0656.058.247.557833674,61260.095.048.646.654.077.049.478.282.80.3103163
MOT16-0751.946.237.51092897,46654.396.834.241.736.176.343.677.981.30.694176
MOT16-0839.340.334.610214759,56542.993.835.434.137.379.735.778.282.80.8113153
MOT16-1251.858.446.721262343,72455.195.150.243.653.577.645.979.383.20.33776
MOT16-1437.747.634.5156754610,85741.393.339.430.742.275.632.373.079.40.7104219

Raw data: