Short name:
SPAM
Detector:
Private
Description:
Reference:
O. Cetintas, T. Meinhardt, G. Bras'o, L. Leal-Taix'e. SPAMming Labels: Efficient Annotations for the Trackers of Tomorrow. In European Conference on Computer Vision, 2024.
Last submitted:
July 18, 2024 (3 months ago)
Published:
July 18, 2024 at 14:22:29 CET
Submissions:
1
Project page / code:
n/a
Open source:
Yes
Hardware:
RTX 8000
Runtime:
22.2 Hz
Benchmark performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17 | 80.7 | 84.6 | 67.5 | 1,392 (59.1) | 273 (11.6) | 35,994 | 71,796 | 87.3 | 93.2 | 70.0 | 65.4 | 75.2 | 81.5 | 72.1 | 77.0 | 83.0 | 2.0 | 1,161 (0.0) | 1,968 (0.0) |
Detailed performance:
Sequence | MOTA | IDF1 | HOTA | MT | ML | FP | FN | Rcll | Prcn | AssA | DetA | AssRe | AssPr | DetRe | DetPr | LocA | FAF | ID Sw. | Frag |
MOT17-01-DPM | 60.6 | 73.1 | 59.2 | 16 | 4 | 1,028 | 1,503 | 76.7 | 82.8 | 66.6 | 52.7 | 72.3 | 80.5 | 63.2 | 68.2 | 82.9 | 2.3 | 8 | 32 |
MOT17-01-FRCNN | 60.6 | 73.1 | 59.2 | 16 | 4 | 1,028 | 1,503 | 76.7 | 82.8 | 66.6 | 52.7 | 72.3 | 80.5 | 63.2 | 68.2 | 82.9 | 2.3 | 8 | 32 |
MOT17-01-SDP | 60.6 | 73.1 | 59.2 | 16 | 4 | 1,028 | 1,503 | 76.7 | 82.8 | 66.6 | 52.7 | 72.3 | 80.5 | 63.2 | 68.2 | 82.9 | 2.3 | 8 | 32 |
MOT17-03-DPM | 93.0 | 93.5 | 74.9 | 143 | 0 | 3,874 | 3,412 | 96.7 | 96.3 | 76.3 | 73.8 | 80.3 | 83.2 | 79.6 | 79.3 | 82.9 | 2.6 | 42 | 111 |
MOT17-03-FRCNN | 93.0 | 93.5 | 74.9 | 143 | 0 | 3,874 | 3,412 | 96.7 | 96.3 | 76.3 | 73.8 | 80.3 | 83.2 | 79.6 | 79.3 | 82.9 | 2.6 | 42 | 111 |
MOT17-03-SDP | 93.0 | 93.5 | 74.9 | 143 | 0 | 3,874 | 3,412 | 96.7 | 96.3 | 76.3 | 73.8 | 80.3 | 83.2 | 79.6 | 79.3 | 82.9 | 2.6 | 42 | 111 |
MOT17-06-DPM | 68.1 | 71.7 | 57.9 | 125 | 42 | 1,098 | 2,627 | 77.7 | 89.3 | 58.1 | 57.9 | 75.4 | 69.1 | 65.3 | 75.0 | 83.9 | 0.9 | 38 | 82 |
MOT17-06-FRCNN | 68.1 | 71.7 | 57.9 | 125 | 42 | 1,098 | 2,627 | 77.7 | 89.3 | 58.1 | 57.9 | 75.4 | 69.1 | 65.3 | 75.0 | 83.9 | 0.9 | 38 | 82 |
MOT17-06-SDP | 68.1 | 71.7 | 57.9 | 125 | 42 | 1,098 | 2,627 | 77.7 | 89.3 | 58.1 | 57.9 | 75.4 | 69.1 | 65.3 | 75.0 | 83.9 | 0.9 | 38 | 82 |
MOT17-07-DPM | 72.9 | 80.3 | 62.4 | 39 | 3 | 1,700 | 2,809 | 83.4 | 89.2 | 64.0 | 61.0 | 69.8 | 78.5 | 69.2 | 74.1 | 82.5 | 3.4 | 69 | 112 |
MOT17-07-FRCNN | 72.9 | 80.3 | 62.4 | 39 | 3 | 1,700 | 2,809 | 83.4 | 89.2 | 64.0 | 61.0 | 69.8 | 78.5 | 69.2 | 74.1 | 82.5 | 3.4 | 69 | 112 |
MOT17-07-SDP | 72.9 | 80.3 | 62.4 | 39 | 3 | 1,700 | 2,809 | 83.4 | 89.2 | 64.0 | 61.0 | 69.8 | 78.5 | 69.2 | 74.1 | 82.5 | 3.4 | 69 | 112 |
MOT17-08-DPM | 68.1 | 67.7 | 55.4 | 36 | 7 | 1,382 | 5,232 | 75.2 | 92.0 | 54.7 | 56.8 | 59.2 | 79.6 | 62.5 | 76.5 | 83.1 | 2.2 | 118 | 151 |
MOT17-08-FRCNN | 68.1 | 67.7 | 55.4 | 36 | 7 | 1,382 | 5,232 | 75.2 | 92.0 | 54.7 | 56.8 | 59.2 | 79.6 | 62.5 | 76.5 | 83.1 | 2.2 | 118 | 151 |
MOT17-08-SDP | 68.1 | 67.7 | 55.4 | 36 | 7 | 1,382 | 5,232 | 75.2 | 92.0 | 54.7 | 56.8 | 59.2 | 79.6 | 62.5 | 76.5 | 83.1 | 2.2 | 118 | 151 |
MOT17-12-DPM | 55.9 | 74.4 | 60.6 | 55 | 9 | 2,321 | 1,472 | 83.0 | 75.6 | 67.3 | 54.6 | 75.7 | 78.8 | 71.2 | 64.8 | 85.0 | 2.6 | 27 | 56 |
MOT17-12-FRCNN | 55.9 | 74.4 | 60.6 | 55 | 9 | 2,321 | 1,472 | 83.0 | 75.6 | 67.3 | 54.6 | 75.7 | 78.8 | 71.2 | 64.8 | 85.0 | 2.6 | 27 | 56 |
MOT17-12-SDP | 55.9 | 74.4 | 60.6 | 55 | 9 | 2,321 | 1,472 | 83.0 | 75.6 | 67.3 | 54.6 | 75.7 | 78.8 | 71.2 | 64.8 | 85.0 | 2.6 | 27 | 56 |
MOT17-14-DPM | 59.1 | 69.6 | 51.3 | 50 | 26 | 595 | 6,877 | 62.8 | 95.1 | 54.9 | 48.2 | 57.4 | 83.4 | 51.3 | 77.7 | 82.6 | 0.8 | 85 | 112 |
MOT17-14-FRCNN | 59.1 | 69.6 | 51.3 | 50 | 26 | 595 | 6,877 | 62.8 | 95.1 | 54.9 | 48.2 | 57.4 | 83.4 | 51.3 | 77.7 | 82.6 | 0.8 | 85 | 112 |
MOT17-14-SDP | 59.1 | 69.6 | 51.3 | 50 | 26 | 595 | 6,877 | 62.8 | 95.1 | 54.9 | 48.2 | 57.4 | 83.4 | 51.3 | 77.7 | 82.6 | 0.8 | 85 | 112 |
Raw data: