LITE: The Lightweight Integrated Tracking-Feature Extraction (LITE)


Video not available.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Rendering of new sequences is currently deactivated due to heavy load.

Benchmark:

MOT20 |

Short name:

LITE

Detector:

Public

Description:

The Lightweight Integrated Tracking-Feature Extraction (LITE)
paradigm is introduced as a novel multi-object tracking (MOT) approach. It enhances ReID-based trackers by eliminating inference, preprocessing, post-processing, and ReID model training costs. LITE uses
real-time appearance features without compromising speed. By integrating appearance feature extraction directly into the tracking pipeline using
standard CNN-based detectors such as YOLOv8m, LITE demonstrates
significant performance improvements. The simplest implementation of
LITE on top of classic DeepSORT achieves a HOTA score of 43.03% at
28.3 FPS on the MOT17 benchmark, making it twice as fast as DeepSORT on MOT17 and four times faster on the more crowded MOT20
dataset, while maintaining similar accuracy. Additionally, a new evaluation framework for tracking-by-detection approaches reveals that conventional trackers like DeepSORT remain competitive with modern stateof-the-art trackers when evaluated under fair conditions. The code will
be available post-publication at https://github.com/Jumabek/LITE

Reference:

Last submitted:

new December 18, 2024 (3 days ago)

Published:

December 18, 2024 at 02:10:56 CET

Submissions:

2

Project page / code:

Open source:

Yes

Hardware:

NVIDIA GeForce RTX 3090

Runtime:

149.3 Hz

Benchmark performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT2072.770.357.8774 (62.3)151 (12.2)21,763117,81477.294.855.560.464.369.865.180.084.64.91,688 (0.0)4,307 (0.0)

Detailed performance:

Sequence MOTA IDF1 HOTA MT ML FP FN Rcll Prcn AssA DetA AssRe AssPr DetRe DetPr LocA FAF ID Sw. Frag
MOT20-0484.878.464.45281712,38328,58989.695.259.669.769.271.775.680.384.56.06392,200
MOT20-0659.859.948.7114694,31148,48463.595.147.350.354.265.453.680.384.84.36001,219
MOT20-0779.770.960.08712,1694,40686.793.054.866.563.468.373.979.385.63.7156264
MOT20-0849.053.544.345642,90036,33553.193.447.541.555.666.744.377.984.03.6293624

Raw data: