IQHAT: Identity-Quantity Harmonic Multi-Object Tracking

MOT16-01


Benchmark:

Short name:

IQHAT

Detector:

Public

Description:

The data association problem of multi-object tracking (MOT) aims to assign IDentity (ID) labels to detections and infer a complete trajectory for each target. Most existing methods assume that each detection corresponds to a unique target and thus cannot handle situations when multiple targets occur in a single detection due to detection failure in crowded scenes. To relax this strong assumption for practical applications, we formulate the MOT as a Maximizing An Identity-Quantity Posterior (MAIQP) problem on the basis of associating each detection with an identity and a quantity characteristic and then provide solutions to tackle two key problems arising. Firstly, a local target quantification module is introduced to count the number of targets within one detection. Secondly, we propose an identity-quantity harmony mechanism to reconcile the two characteristics. On this basis, we develop a novel Identity-Quantity HArmonic Tracking (IQHAT) framework that allows assigning multiple ID labels to detections containing several targets. Through extensive experimental evaluations on five benchmark datasets, we demonstrate the superiority of the proposed method.

Reference:

Y. He, X. Wei, X. Hong, W. Ke, Y. Gong. Identity-Quantity Harmonic Multi-Object Tracking. In IEEE Transactions on Image Processing, 2022.

Last submitted:

January 07, 2022 (2 years ago)

Published:

March 04, 2022 at 02:57:31 CET

Submissions:

1

Project page / code:

n/a

Open source:

No

Hardware:

TITIAN X

Runtime:

8.1 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT1658.662.449.3198 (26.1)277 (36.5)4,07471,02661.096.551.947.056.977.049.578.281.70.7370 (0.0)636 (0.0)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT16-0150.364.049.7810613,11451.398.264.338.570.976.540.176.680.20.1211
MOT16-0368.967.953.865182,14430,23771.197.253.354.657.877.357.578.781.71.4108200
MOT16-0654.658.946.873879924,16563.988.147.346.664.660.151.771.380.50.876112
MOT16-0745.849.238.28162198,55647.697.339.637.041.880.038.478.581.50.479159
MOT16-0842.553.344.715251919,39843.897.555.835.859.082.637.182.484.70.33640
MOT16-1247.658.745.615431044,22149.197.553.639.056.979.940.580.382.90.12035
MOT16-1436.449.535.2147836311,33538.795.242.029.744.277.530.975.980.30.54979

Raw data: