MMSMOT: Multi-to-multi local matching for multi-object tracking


Video not available.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Benchmark:

MOT17 | MOT20 |

Short name:

MMSMOT

Detector:

Public

Description:

we proposes utilizing Principal Component Analysis (PCA) on the target ROI to decompose target features, expressing the identical feature of targets by collectively representing the principal component features of the ROI region, and utilizing these principal component features to form local features, the identical features are then trained through a classification task. Furthermore, in the template matching process, we introduce a local features matching algorithm for targets and trajectories. This algorithm adopts a multi-to-multi matching style, aiming to associate every detailed part of the ROI feature. The detections for training our model base on the public mot17 and mot20 benchmarck by SDP detector.

Reference:

Last submitted:

January 26, 2024 (3 months ago)

Published:

February 11, 2024 at 16:44:50 CET

Submissions:

2

Project page / code:

n/a

Open source:

No

Hardware:

1.5GHz, 1 Core

Runtime:

44.2 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT1769.872.758.9807 (34.3)588 (25.0)31,341135,63376.093.260.757.464.979.862.576.782.81.83,513 (0.0)4,638 (0.0)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT17-01-DPM49.357.345.7857022,51761.084.947.544.352.378.550.269.982.21.64985
MOT17-01-FRCNN49.357.345.7857022,51761.084.947.544.352.378.550.269.982.21.64985
MOT17-01-SDP49.357.345.7857022,51761.084.947.544.352.378.550.269.982.21.64985
MOT17-03-DPM88.885.669.713706,2255,36594.994.168.071.772.681.078.878.183.34.2130364
MOT17-03-FRCNN88.885.669.713706,2255,36594.994.168.071.772.681.078.878.183.34.2130364
MOT17-03-SDP88.885.669.713706,2255,36594.994.168.071.772.681.078.878.183.34.2130364
MOT17-06-DPM56.155.845.153682724,61960.896.344.846.248.078.648.877.281.40.2280306
MOT17-06-FRCNN56.155.845.153682724,61960.896.344.846.248.078.648.877.281.40.2280306
MOT17-06-SDP56.155.845.153682724,61960.896.344.846.248.078.648.877.281.40.2280306
MOT17-07-DPM56.050.541.71851,2046,08164.090.037.247.240.172.852.173.282.12.4147210
MOT17-07-FRCNN56.050.541.71851,2046,08164.090.037.247.240.172.852.173.282.12.4147210
MOT17-07-SDP56.050.541.71851,2046,08164.090.037.247.240.172.852.173.282.12.4147210
MOT17-08-DPM30.438.833.4113619214,45831.697.244.125.546.582.226.280.683.30.358110
MOT17-08-FRCNN30.438.833.4113619214,45831.697.244.125.546.582.226.280.683.30.358110
MOT17-08-SDP30.438.833.4113619214,45831.697.244.125.546.582.226.280.683.30.358110
MOT17-12-DPM56.565.551.125254113,33261.692.855.947.059.580.250.576.282.60.52860
MOT17-12-FRCNN56.565.551.125254113,33261.692.855.947.059.580.250.576.282.60.52860
MOT17-12-SDP56.565.551.125254113,33261.692.855.947.059.580.250.576.282.60.52860
MOT17-14-DPM41.855.038.717571,4418,83952.287.041.336.643.773.840.567.579.31.9479411
MOT17-14-FRCNN41.855.038.717571,4418,83952.287.041.336.643.773.840.567.579.31.9479411
MOT17-14-SDP41.855.038.717571,4418,83952.287.041.336.643.773.840.567.579.31.9479411

Raw data: