FeatureSORT: FeatureSORT: Essential Features for Effective Tracking
Video not available.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Rendering of new sequences is currently deactivated due to heavy load.
Short name:
FeatureSORT
Detector:
Public
Description:
We introduce a novel tracker designed for online multiple object tracking with a focus on using multiple feature modules each of which stands for a particular appearance information. By integrating distinct appearance features, including clothing color, style, and target direction, alongside a ReID network for robust
embedding extraction, our tracker achieves SOTA results.
Reference:
H. Hashempoor, R. Koikara, Y. Hwang. FeatureSORT: Essential Features for Effective Tracking. In , 2024.
Last submitted:
July 09, 2024 (4 months ago)
Published:
July 09, 2024 at 04:06:28 CET
Submissions:
1
Project page / code:
Open source:
Yes
Hardware:
2.1 GHZ, 8 Core
Runtime:
8.7 Hz
Benchmark performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17 | 79.6 | 77.2 | 63.0 | 1,264 (53.7) | 348 (14.8) | 29,588 | 83,132 | 85.3 | 94.2 | 62.0 | 64.4 | 68.2 | 76.0 | 70.4 | 77.7 | 83.1 | 1.7 | 2,269 (0.0) | 2,148 (0.0) |
Detailed performance:
| Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
| MOT17-01-DPM | 62.0 | 55.3 | 46.9 | 13 | 5 | 633 | 1,797 | 72.1 | 88.0 | 42.0 | 52.5 | 49.5 | 67.6 | 59.6 | 72.8 | 83.4 | 1.4 | 18 | 17 |
| MOT17-01-FRCNN | 64.7 | 63.6 | 52.1 | 11 | 5 | 366 | 1,894 | 70.6 | 92.6 | 51.0 | 53.4 | 57.3 | 74.6 | 58.4 | 76.6 | 83.5 | 0.8 | 14 | 18 |
| MOT17-01-SDP | 62.0 | 55.3 | 46.9 | 13 | 5 | 633 | 1,797 | 72.1 | 88.0 | 42.0 | 52.5 | 49.5 | 67.6 | 59.6 | 72.8 | 83.4 | 1.4 | 18 | 17 |
| MOT17-03-DPM | 93.0 | 89.7 | 72.6 | 144 | 0 | 4,098 | 3,153 | 97.0 | 96.1 | 71.6 | 73.9 | 76.9 | 80.6 | 79.9 | 79.2 | 83.1 | 2.7 | 56 | 101 |
| MOT17-03-FRCNN | 93.0 | 89.7 | 72.6 | 144 | 0 | 4,098 | 3,153 | 97.0 | 96.1 | 71.6 | 73.9 | 76.9 | 80.6 | 79.9 | 79.2 | 83.1 | 2.7 | 56 | 101 |
| MOT17-03-SDP | 93.0 | 89.7 | 72.6 | 144 | 0 | 4,098 | 3,153 | 97.0 | 96.1 | 71.6 | 73.9 | 76.9 | 80.6 | 79.9 | 79.2 | 83.1 | 2.7 | 56 | 101 |
| MOT17-06-DPM | 57.3 | 55.8 | 45.8 | 110 | 50 | 1,683 | 3,140 | 73.4 | 83.7 | 41.4 | 51.2 | 58.8 | 53.9 | 60.1 | 68.6 | 81.8 | 1.4 | 207 | 166 |
| MOT17-06-FRCNN | 58.8 | 59.2 | 48.2 | 104 | 54 | 1,295 | 3,372 | 71.4 | 86.7 | 45.5 | 51.4 | 59.6 | 60.4 | 58.6 | 71.2 | 82.0 | 1.1 | 185 | 151 |
| MOT17-06-SDP | 57.3 | 55.8 | 45.8 | 110 | 50 | 1,683 | 3,140 | 73.4 | 83.7 | 41.4 | 51.2 | 58.8 | 53.9 | 60.1 | 68.6 | 81.8 | 1.4 | 207 | 166 |
| MOT17-07-DPM | 73.3 | 57.3 | 48.4 | 32 | 2 | 599 | 3,816 | 77.4 | 95.6 | 39.6 | 59.5 | 44.1 | 69.7 | 64.1 | 79.2 | 83.6 | 1.2 | 92 | 94 |
| MOT17-07-FRCNN | 73.3 | 57.3 | 48.4 | 32 | 2 | 599 | 3,816 | 77.4 | 95.6 | 39.6 | 59.5 | 44.1 | 69.7 | 64.1 | 79.2 | 83.6 | 1.2 | 92 | 94 |
| MOT17-07-SDP | 73.3 | 57.3 | 48.4 | 32 | 2 | 599 | 3,816 | 77.4 | 95.6 | 39.6 | 59.5 | 44.1 | 69.7 | 64.1 | 79.2 | 83.6 | 1.2 | 92 | 94 |
| MOT17-08-DPM | 65.0 | 52.5 | 46.7 | 35 | 6 | 1,228 | 6,002 | 71.6 | 92.5 | 40.7 | 54.7 | 48.8 | 63.1 | 59.7 | 77.1 | 83.3 | 2.0 | 154 | 171 |
| MOT17-08-FRCNN | 65.0 | 52.5 | 46.7 | 35 | 6 | 1,228 | 6,002 | 71.6 | 92.5 | 40.7 | 54.7 | 48.8 | 63.1 | 59.7 | 77.1 | 83.3 | 2.0 | 154 | 171 |
| MOT17-08-SDP | 65.0 | 52.5 | 46.7 | 35 | 6 | 1,228 | 6,002 | 71.6 | 92.5 | 40.7 | 54.7 | 48.8 | 63.1 | 59.7 | 77.1 | 83.3 | 2.0 | 154 | 171 |
| MOT17-12-DPM | 60.6 | 67.6 | 56.0 | 52 | 12 | 1,566 | 1,813 | 79.1 | 81.4 | 57.2 | 55.2 | 67.9 | 70.4 | 67.2 | 69.2 | 84.8 | 1.7 | 38 | 50 |
| MOT17-12-FRCNN | 69.0 | 71.9 | 59.0 | 42 | 22 | 374 | 2,284 | 73.6 | 94.5 | 60.0 | 58.2 | 67.5 | 76.2 | 62.9 | 80.6 | 85.4 | 0.4 | 26 | 37 |
| MOT17-12-SDP | 60.6 | 67.6 | 56.0 | 52 | 12 | 1,566 | 1,813 | 79.1 | 81.4 | 57.2 | 55.2 | 67.9 | 70.4 | 67.2 | 69.2 | 84.8 | 1.7 | 38 | 50 |
| MOT17-14-DPM | 54.1 | 67.2 | 48.1 | 45 | 33 | 851 | 7,347 | 60.3 | 92.9 | 51.4 | 45.3 | 55.2 | 76.9 | 48.8 | 75.2 | 81.6 | 1.1 | 283 | 161 |
| MOT17-14-FRCNN | 52.2 | 65.6 | 46.5 | 34 | 43 | 312 | 8,475 | 54.1 | 97.0 | 52.0 | 41.8 | 55.1 | 80.3 | 43.7 | 78.4 | 82.1 | 0.4 | 46 | 56 |
| MOT17-14-SDP | 54.1 | 67.2 | 48.1 | 45 | 33 | 851 | 7,347 | 60.3 | 92.9 | 51.4 | 45.3 | 55.2 | 76.9 | 48.8 | 75.2 | 81.6 | 1.1 | 283 | 161 |
Raw data:
