TAO Challenge Results

Download all results for this benchmark

Click on a measure to sort the table accordingly. See below for a more detailed description.


Benchmark Statistics

TrackerTrackAP50TrackAP75TrackAP50_95TrackAP50_area_smallTrackAP50_area_mediumTrackAP50_area_largeHz
AOA
1. online method 		27.461 13.952 14.779 13.185 24.897 34.051 617.2
F. Du, B. Xu, J. Tang, Y. Zhang, F. Wang, H. Li. Detect and Represent Any Object for Tracking. In arXiv preprint arXiv: 2101.08040, 2021.
GlobalTR
2. 		20.071 10.397 10.878 9.980 16.597 25.493 278.4
X. Zhou, T. Yin, V. Koltun, P. Kr"ahenb"uhl. Global Tracking Transformers. In CVPR, 2022.
SORT_TAO
3. online method 		10.217 4.383 4.892 7.720 8.227 15.166 16.3
A. Dave, T. Khurana, P. Tokmakov, C. Schmid, D. Ramanan. TAO: A Large-Scale Benchmark for Tracking Any Object. In The European Conference on Computer Vision (ECCV), 2020.
SequencesFramesTrajectoriesBoxes
122218467972164650

Evaluation Measures

Lower is better. Higher is better.
Measure Better Perfect Description
TrackAP50 higher 1Track AP, IoU 0.5 [1]. Track AP at 3D IoU threshold of 0.5.
TrackAP75 higher 1Track AP, IoU 0.75 [1]. Track AP at 3D IoU threshold of 0.75.
TrackAP50_95 higher 1Track AP, IoU 0.5:0.95 [1]. Track AP averaged at 3D IoU thresholds of 0.5 to 0.95, with step size of 0.05.
TrackAP50_area_small higher 1Track AP, small objects [1]. Track AP at IoU threshold of 0.5 for objects with average area less than 32x32 pixels.
TrackAP50_area_medium higher 1Track AP, medium objects [1]. Track AP at IoU threshold of 0.5 for objects with average area between 32x32 and 96x96 pixels.
TrackAP50_area_large higher 1Track AP, large objects [1]. Track AP at IoU threshold of 0.5 for objects with average area over 96x96 pixels.
Hz higher Inf.Processing speed (in frames per second excluding the detector) on the benchmark. The frequency is provided by the authors and not officially evaluated by the MOTChallenge.

Legend

Symbol Description
online method This is an online (causal) method, i.e. the solution is immediately available with each incoming frame and cannot be changed at any later time.
using public detections This method used the provided detection set as input.
using private detections This method used a private detection set as input.
new This entry has been submitted or updated less than a week ago.

References:


[1] Dave, A., Khurana, T., Tokmakov, P., Schmid, C. & Ramanan, D. TAO: A Large-Scale Benchmark for Tracking Any Object. In European Conference on Computer Vision, 2020.



Contact