mfi_tst: Online multi-object tracking using multi-function integration and tracking simulation training

PETS09-S2L2


Benchmark:

Short name:

mfi_tst

Detector:

Public

Description:

Recently, with the development of deep-learning, the performance of multi-object tracking algorithms based on the deep neural network has been greatly improved. However, most methods separate different functional modules into multiple networks and train them independently on specific tasks. When these network modules are used directly, they are not compatible with each other effectively, nor can they be better adapted to the multi-object tracking task, which leads to a poor tracking effect. Therefore, a network structure is designed to aggregate the regression of objects between frames and the extraction of appearance features into one model to improve the harmony between various functional modules of multi-object tracking. To improve the support for the multi-object tracking task, an end-to-end training method is also proposed to simulate the multi-object tracking process during the training and expand the training data by using the historical position of the target combined with the prediction of the motion model. A metric loss that can take advantage of the historical appearance features of the target is also used to train the extraction module of appearance features to improve the temporal correlation of extracted appearance features. Evaluation results on the MOTChallenge benchmark datasets show that the proposed approach achieves state-of-the-art performance.

Reference:

J. Y, H. Ge, J. Yang, Y. Tong, S. Su. Online multi-object tracking using multi-function integration and tracking simulation training. In Applied Intelligence, 2021.

Last submitted:

May 12, 2021 (2 years ago)

Published:

May 12, 2021 at 09:06:44 CET

Submissions:

1

Project page / code:

n/a

Open source:

No

Hardware:

2080TI

Runtime:

0.7 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT1549.252.441.5210 (29.1)176 (24.4)8,70721,59464.982.140.343.444.274.250.764.279.01.5912 (0.0)1,397 (0.0)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
ADL-Rundle-131.247.539.21833,4762,86869.264.940.238.744.469.554.050.778.07.061145
ADL-Rundle-342.446.639.41151,7684,00760.677.737.342.340.277.750.664.982.82.882111
AVG-TownCentre56.663.044.876325022,26768.390.744.345.949.669.950.466.976.01.1331372
ETH-Crossing47.655.042.5595146353.891.442.143.045.082.946.378.585.30.21216
ETH-Jelmoli57.669.551.3181236269872.583.653.349.860.575.658.667.581.40.81540
ETH-Linthescher51.657.645.9371003043,96755.694.249.043.153.378.045.677.482.40.35298
KITTI-1656.372.947.04118453968.386.349.145.252.368.150.063.273.90.92054
KITTI-1951.761.042.417107301,79266.582.942.243.247.366.549.461.674.80.757158
PETS09-S2L259.734.929.8925063,14067.492.818.647.919.869.351.971.478.21.2244357
TUD-Crossing75.575.553.7906919282.693.051.256.459.863.762.370.177.50.3914
Venice-146.453.342.2627551,66163.679.444.840.247.577.348.160.177.81.72932

Raw data: