LITE: The Lightweight Integrated Tracking-Feature Extraction (LITE)


Video not available.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Benchmark:

MOT20 |

Short name:

LITE

Detector:

Public

Description:

The Lightweight Integrated Tracking-Feature Extraction (LITE)
paradigm is introduced as a novel multi-object tracking (MOT) approach. It enhances ReID-based trackers by eliminating inference, preprocessing, post-processing, and ReID model training costs. LITE uses
real-time appearance features without compromising speed. By integrating appearance feature extraction directly into the tracking pipeline using
standard CNN-based detectors such as YOLOv8m, LITE demonstrates
significant performance improvements. The simplest implementation of
LITE on top of classic DeepSORT achieves a HOTA score of 43.03% at
28.3 FPS on the MOT17 benchmark, making it twice as fast as DeepSORT on MOT17 and four times faster on the more crowded MOT20
dataset, while maintaining similar accuracy. Additionally, a new evaluation framework for tracking-by-detection approaches reveals that conventional trackers like DeepSORT remain competitive with modern stateof-the-art trackers when evaluated under fair conditions. The code will
be available post-publication at https://github.com/Jumabek/LITE

Reference:

Last submitted:

December 27, 2024 (25 days ago)

Published:

December 18, 2024 at 02:10:56 CET

Submissions:

4

Project page / code:

Open source:

Yes

Hardware:

NVIDIA GeForce RTX 3090

Runtime:

149.3 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT2043.839.732.9233 (18.8)298 (24.0)34,230251,07951.588.628.837.936.446.841.471.380.67.65,694 (0.0)13,502 (0.0)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT20-0462.249.240.1168744,61396,66564.797.532.150.340.350.552.979.782.92.22,3897,335
MOT20-0623.126.921.82611115,35684,77036.175.819.325.024.935.728.058.775.715.21,9723,514
MOT20-0749.045.235.328211,34515,18654.193.032.139.340.250.542.372.780.32.3337678
MOT20-0811.821.118.0119212,91654,45829.764.116.520.021.632.523.149.874.016.09961,975

Raw data: