mfi_tst: Online multi-object tracking using multi-function integration and tracking simulation training

MOT20-04


Benchmark:

Short name:

mfi_tst

Detector:

Public

Description:

Recently, with the development of deep-learning, the performance of multi-object tracking algorithms based on the deep neural network has been greatly improved. However, most methods separate different functional modules into multiple networks and train them independently on specific tasks. When these network modules are used directly, they are not compatible with each other effectively, nor can they be better adapted to the multi-object tracking task, which leads to a poor tracking effect. Therefore, a network structure is designed to aggregate the regression of objects between frames and the extraction of appearance features into one model to improve the harmony between various functional modules of multi-object tracking. To improve the support for the multi-object tracking task, an end-to-end training method is also proposed to simulate the multi-object tracking process during the training and expand the training data by using the historical position of the target combined with the prediction of the motion model. A metric loss that can take advantage of the historical appearance features of the target is also used to train the extraction module of appearance features to improve the temporal correlation of extracted appearance features. Evaluation results on the MOTChallenge benchmark datasets show that the proposed approach achieves state-of-the-art performance.

Reference:

J. Y, H. Ge, J. Yang, Y. Tong, S. Su. Online multi-object tracking using multi-function integration and tracking simulation training. In Applied Intelligence, 2021.

Last submitted:

May 18, 2021 (6 months ago)

Published:

May 12, 2021 at 09:06:05 CET

Submissions:

2

Project page / code:

n/a

Open source:

No

Hardware:

2080TI

Runtime:

0.5 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT2059.359.147.1511 (41.1)215 (17.3)36,150172,78266.690.546.248.450.073.953.172.279.98.11,919 (0.0)3,743 (0.0)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT20-0480.171.857.4400497,15546,90582.996.952.563.056.776.867.178.481.93.45761,054
MOT20-0636.541.832.5538814,81468,81448.281.231.833.634.666.837.563.276.314.77291,483
MOT20-0755.252.339.936103,22111,39865.687.137.044.741.066.349.165.274.65.5217504
MOT20-0826.439.130.0226810,96045,66541.174.432.228.134.967.632.258.477.013.6397702

Raw data: