BBT: Bounding box based tracking enhanced by track-projection re-identification

MOT17-03-DPM


Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Benchmark:

MOT20 | MOT17 |

Short name:

BBT

Detector:

Public

Description:

Tracker uses only bounding boxes, no visual information.
Bounding boxes are associated frame-to-frame maximizing the IOU metric.
Re-identification phase projects discovered tracks to past/future tracks within a time window of 50 frames and quantifies the track matching score.
Fragmented tracks with high matching score are linked together, missing bounding boxes interpolated.
The proposed tracker is extremely fast compared to visual-based methods, and more accurate than (similar-to-our-work method) IOU17 thanks to the re-identification phase,
The proposed tracker is used to discover inter-person relationships in videos.

Reference:

MTAP-D-20-01870 Tracking Subjects and Detecting Relationships in Crowded City Videos (under review)

Last submitted:

May 19, 2020 (4 years ago)

Published:

October 15, 2020 at 16:00:36 CET

Submissions:

2

Open source:

Yes

Hardware:

Intel(R) Xeon(R) CPU E5-2620, 1 core

Runtime:

121.6 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT1747.850.040.0449 (19.1)936 (39.7)35,552255,11854.889.740.340.045.366.843.371.079.22.03,676 (67.1)4,949 (90.3)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT17-01-DPM22.931.425.13141894,76926.189.933.818.738.166.219.567.376.80.41628
MOT17-01-FRCNN26.345.239.5971,7442,99053.666.545.734.349.571.043.754.278.63.91948
MOT17-01-SDP41.549.338.81041,6002,11367.273.137.840.041.467.250.955.477.03.65888
MOT17-03-DPM44.340.231.622375,16652,73349.691.027.936.029.671.238.670.778.73.4355561
MOT17-03-FRCNN61.160.547.347243,35037,22164.495.346.648.552.866.651.476.080.12.2130333
MOT17-03-SDP77.771.154.890123,81919,31081.695.750.260.056.167.564.475.580.02.5213637
MOT17-06-DPM35.641.431.5241248256,61243.986.232.331.040.058.933.766.277.40.7151123
MOT17-06-FRCNN49.051.440.849828005,03957.289.438.643.546.563.147.173.681.00.7175189
MOT17-06-SDP51.352.040.663887864,77359.589.938.343.345.563.847.271.479.80.7184164
MOT17-07-DPM30.031.424.943183010,90035.587.824.225.725.672.027.367.577.21.799146
MOT17-07-FRCNN33.236.930.25141,7149,34944.781.529.532.032.466.735.464.577.23.4223399
MOT17-07-SDP47.441.934.714161,0597,67254.689.730.939.232.870.942.670.078.62.1147267
MOT17-08-DPM21.528.425.68411,23215,27627.782.630.421.634.663.823.068.680.12.08496
MOT17-08-FRCNN25.536.932.913341,82313,83734.580.042.125.949.962.128.465.879.72.968109
MOT17-08-SDP30.739.633.921272,87411,59745.176.836.432.245.553.336.662.478.14.6166220
MOT17-12-DPM34.742.634.410525675,06041.686.438.630.841.470.933.369.179.90.63543
MOT17-12-FRCNN37.150.639.813437634,65646.384.046.234.452.670.137.968.980.50.82953
MOT17-12-SDP40.650.740.720409524,16352.082.644.337.452.067.242.367.281.01.13252
MOT17-14-DPM15.420.416.7212036815,09218.390.220.213.921.362.914.370.378.20.5185154
MOT17-14-FRCNN16.529.724.310702,96111,75236.469.423.825.726.554.229.255.774.23.9722675
MOT17-14-SDP30.136.127.512562,13010,20444.879.525.430.328.258.734.160.575.92.8585564

Raw data: