IQHAT: Identity-Quantity Harmonic Multi-Object Tracking


Video not available.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Benchmark:

Short name:

IQHAT

Detector:

Public

Description:

The data association problem of multi-object tracking (MOT) aims to assign IDentity (ID) labels to detections and infer a complete trajectory for each target. Most existing methods assume that each detection corresponds to a unique target and thus cannot handle situations when multiple targets occur in a single detection due to detection failure in crowded scenes. To relax this strong assumption for practical applications, we formulate the MOT as a Maximizing An Identity-Quantity Posterior (MAIQP) problem on the basis of associating each detection with an identity and a quantity characteristic and then provide solutions to tackle two key problems arising. Firstly, a local target quantification module is introduced to count the number of targets within one detection. Secondly, we propose an identity-quantity harmony mechanism to reconcile the two characteristics. On this basis, we develop a novel Identity-Quantity HArmonic Tracking (IQHAT) framework that allows assigning multiple ID labels to detections containing several targets. Through extensive experimental evaluations on five benchmark datasets, we demonstrate the superiority of the proposed method.

Reference:

Y. He, X. Wei, X. Hong, W. Ke, Y. Gong. Identity-Quantity Harmonic Multi-Object Tracking. In IEEE Transactions on Image Processing, 2022.

Last submitted:

January 07, 2022 (2 years ago)

Published:

March 04, 2022 at 02:55:52 CET

Submissions:

1

Project page / code:

n/a

Open source:

No

Hardware:

TITIAN X

Runtime:

7.5 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT2057.157.745.7507 (40.8)249 (20.0)32,247187,93763.791.144.746.950.168.851.173.180.57.21,875 (0.0)2,543 (0.0)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT20-0476.870.555.0379497,92055,12579.996.550.260.556.569.964.577.981.63.8550635
MOT20-0631.037.029.1419417,25673,44844.777.527.630.930.663.635.160.876.817.19161,383
MOT20-0771.561.550.37053,2755,91782.189.243.758.448.071.865.971.680.25.6247341
MOT20-0825.935.628.6171013,79653,44731.086.435.123.439.165.924.969.279.54.7162184

Raw data: