High-resolution multi-view benchmark
This table lists the benchmark results for the high-res multi-view scenario. The following metrics are evaluated:
- Accuracy: The fraction of the reconstruction which is closer to the ground truth than the evaluation threshold distance (*).
- Completeness: The fraction of the ground truth which is closer to the reconstruction than the evaluation threshold distance (*).
- F1 score: The harmonic mean of accuracy and completeness, used to rank methods based on both metrics.
- Time: The runtime of the method.
(*) For exact definitions, detailing how potentially incomplete ground truth is taken into account, see our paper.
The datasets are grouped into different categories, and result averages are computed for a category and method if results of the method are available for all datasets within the category. Note that the category "all" includes both the high-res multi-view and the low-res many-view scenarios.
Click a dataset result cell to show a visualization of the reconstruction. For training datasets, ground truth and accuracy / completeness visualizations are also available. The visualizations may not work with mobile browsers.
Since we plan to add additional datasets soon (~ end of September), which will likely change the ranking, the average scores are currently still hidden.
|COLMAP||75.29 1||62.95 1||63.62 1||49.96 2||47.32 1||75.50 1||75.33 2|
|Johannes L. Schönberger, Enliang Zheng, Marc Pollefeys, Jan-Michael Frahm: Pixelwise View Selection for Unstructured Multi-View Stereo. ECCV 2016|
|CMPMVS||62.97 2||51.84 3||51.98 2||56.71 1||42.87 2||70.37 2||75.91 1|
|M. Jancosek, T. Pajdla: Multi-View Reconstruction Preserving Weakly-Supported Surfaces. CVPR 2011|
|PMVS||41.88 3||53.50 2||33.33 3||35.46 3||28.90 3||54.63 3||57.88 3|
|Y. Furukawa, J. Ponce: Accurate, dense, and robust multiview stereopsis. PAMI (2010)|
|MVE||10.52 4||34.14 4||14.79 4||6.53 4||8.79 4||41.63 4||38.11 4|
|Simon Fuhrmann, Fabian Langguth, Michael Goesele: MVE - A Multi-View Reconstruction Environment. EUROGRAPHICS Workshops on Graphics and Cultural Heritage (2014)|