IQHAT: Identity-Quantity Harmonic Multi-Object Tracking

MOT17-01-DPM


Benchmark:

Short name:

IQHAT

Detector:

Public

Description:

The data association problem of multi-object tracking (MOT) aims to assign IDentity (ID) labels to detections and infer a complete trajectory for each target. Most existing methods assume that each detection corresponds to a unique target and thus cannot handle situations when multiple targets occur in a single detection due to detection failure in crowded scenes. To relax this strong assumption for practical applications, we formulate the MOT as a Maximizing An Identity-Quantity Posterior (MAIQP) problem on the basis of associating each detection with an identity and a quantity characteristic and then provide solutions to tackle two key problems arising. Firstly, a local target quantification module is introduced to count the number of targets within one detection. Secondly, we propose an identity-quantity harmony mechanism to reconcile the two characteristics. On this basis, we develop a novel Identity-Quantity HArmonic Tracking (IQHAT) framework that allows assigning multiple ID labels to detections containing several targets. Through extensive experimental evaluations on five benchmark datasets, we demonstrate the superiority of the proposed method.

Reference:

Y. He, X. Wei, X. Hong, W. Ke, Y. Gong. Identity-Quantity Harmonic Multi-Object Tracking. In IEEE Transactions on Image Processing, 2022.

Last submitted:

January 07, 2022 (8 months ago)

Published:

March 04, 2022 at 02:57:40 CET

Submissions:

1

Project page / code:

n/a

Open source:

No

Hardware:

TITIAN X

Runtime:

8.1 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT1758.461.849.0568 (24.1)829 (35.2)15,013218,27461.395.851.446.956.675.149.577.481.50.81,261 (0.0)2,251 (0.0)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT17-01-DPM48.152.143.3811803,25549.597.650.137.753.872.439.076.980.10.21518
MOT17-01-FRCNN49.364.149.510102912,97054.092.363.039.069.975.142.071.979.70.6615
MOT17-01-SDP47.958.346.29103373,01053.391.154.639.361.075.742.372.280.00.71626
MOT17-03-DPM69.168.053.965181,98630,19871.297.453.354.757.877.557.678.881.81.3109183
MOT17-03-FRCNN70.269.654.262171,85429,28172.097.653.555.357.078.958.278.881.81.2103182
MOT17-03-SDP75.971.356.883152,51322,58678.497.054.659.560.075.563.178.081.31.7126227
MOT17-06-DPM53.560.146.046942345,19455.996.649.343.258.769.445.278.081.50.250136
MOT17-06-FRCNN56.860.146.252693404,67860.395.446.745.958.766.148.576.781.10.376178
MOT17-06-SDP56.661.447.054734144,62360.894.548.246.159.866.948.976.181.00.379179
MOT17-07-DPM45.550.239.08185398,59949.193.940.737.644.672.239.675.780.61.168120
MOT17-07-FRCNN44.849.638.79186848,58549.292.440.537.244.072.639.674.380.51.463114
MOT17-07-SDP47.650.839.711147987,97452.891.839.939.944.370.942.674.080.21.676136
MOT17-08-DPM32.241.937.8173847813,79134.793.951.128.157.770.829.379.183.80.84757
MOT17-08-FRCNN31.141.837.0163762113,89634.292.150.027.557.869.728.877.583.41.04354
MOT17-08-SDP32.540.936.6183680613,40136.690.546.229.256.364.030.876.383.01.35460
MOT17-12-DPM46.255.745.11845434,60346.999.053.538.157.778.339.282.884.20.02030
MOT17-12-FRCNN44.955.444.81646484,71345.698.854.636.858.978.538.082.384.00.11528
MOT17-12-SDP45.855.845.318481364,54247.696.853.938.158.676.139.780.883.90.21932
MOT17-14-DPM34.545.532.9127560811,42638.292.138.228.642.767.930.072.579.30.876121
MOT17-14-FRCNN34.946.434.117721,10610,83041.487.439.429.943.966.532.368.178.51.596167
MOT17-14-SDP38.848.935.719651,09710,11945.388.439.532.544.765.835.268.778.51.5104188

Raw data: