Low-res two-view benchmark

This table lists the benchmark results for the low-res two-view scenario. This benchmark evaluates the Middlebury stereo metrics:

The mask determines whether the metric is evaluated for all pixels with ground truth, or only for pixels which are visible in both images (non-occluded).
The coverage selector allows to limit the table to results for all pixels (dense), or a given minimum fraction of pixels.

Click one or more dataset result cells or column headers to show visualizations. Most visualizations are only available for training datasets. The visualizations may not work with mobile browsers.




Method Infoalllakes. 1llakes. 1ssand box 1lsand box 1sstora. room 1lstora. room 1sstora. room 2lstora. room 2sstora. room 2 1lstora. room 2 1sstora. room 2 2lstora. room 2 2sstora. room 3lstora. room 3stunnel 1ltunnel 1stunnel 2ltunnel 2stunnel 3ltunnel 3s
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
DN-CSS_ROBtwo views0.26
1		0.75
15		1.33
3		0.00
1		0.00
1		0.99
7		0.00
1		1.04
4		0.61
2		0.01
4		0.00
1		0.19
3		0.02
2		0.07
2		0.01
1		0.00
1		0.00
1		0.00
1		0.00
1		0.22
11		0.01
3
LaLa_ROBtwo views0.31
2		0.38
7		0.91
2		0.00
1		0.01
8		1.00
8		0.01
5		1.60
8		0.61
2		0.15
5		0.00
1		0.09
2		0.01
1		1.04
3		0.41
4		0.00
1		0.00
1		0.00
1		0.00
1		0.02
2		0.00
1
PWCDC_ROBbinarytwo views0.32
3		0.66
14		2.61
10		0.00
1		0.00
1		0.61
4		0.00
1		1.06
5		0.61
2		0.00
1		0.00
1		0.08
1		0.04
5		0.02
1		0.21
2		0.00
1		0.00
1		0.00
1		0.00
1		0.46
16		0.00
1
PSMNet_ROBtwo views0.41
4		0.54
10		1.69
6		0.00
1		0.00
1		0.92
6		0.00
1		0.27
1		0.53
1		0.00
1		0.00
1		0.25
4		0.03
3		3.43
5		0.47
5		0.00
1		0.00
1		0.00
1		0.00
1		0.05
7		0.03
6
CBMVpermissivetwo views0.57
5		0.22
2		1.61
5		0.00
1		0.00
1		0.84
5		0.78
12		2.58
14		0.61
2		0.38
7		0.00
1		1.25
6		0.63
8		2.07
4		0.38
3		0.00
1		0.00
1		0.00
1		0.00
1		0.04
6		0.08
10
Konstantinos Batsos, Changjiang Cai, Philippos Mordohai: CBMV: A Coalesced Bidirectional Matching Volume for Disparity Estimation. Computer Vision and Pattern Recognition (CVPR) 2018
PWC_ROBbinarytwo views0.62
6		0.54
10		3.22
13		0.00
1		0.00
1		0.22
1		0.00
1		2.18
13		0.61
2		0.00
1		0.20
6		0.29
5		0.03
3		3.46
6		1.22
6		0.00
1		0.00
1		0.00
1		0.00
1		0.39
15		0.01
3
SGM-Foresttwo views0.84
7		0.07
1		0.90
1		0.02
9		0.07
14		1.10
10		0.68
10		2.12
12		0.61
2		1.14
9		0.78
7		1.36
7		0.98
9		5.55
13		1.31
8		0.00
1		0.00
1		0.00
1		0.00
1		0.02
2		0.06
9
SPS-STEREOcopylefttwo views0.88
8		0.40
8		2.01
8		0.00
1		0.01
8		0.42
3		0.17
6		0.50
2		0.61
2		2.19
10		0.79
8		2.04
8		0.27
6		5.10
12		2.89
12		0.00
1		0.00
1		0.00
1		0.00
1		0.03
5		0.11
14
K. Yamaguchi, D. McAllester, R. Urtasun: Efficient Joint Segmentation, Occlusion Labeling, Stereo and Flow Estimation. ECCV 2014
SGM_ROBbinarytwo views1.54
9		0.35
5		1.60
4		0.15
14		0.17
15		1.25
11		0.77
11		1.97
11		0.88
10		4.31
11		2.46
9		4.36
11		2.37
11		6.98
16		1.78
9		0.21
16		0.23
17		0.20
17		0.23
17		0.26
12		0.31
16
Heiko Hirschmueller: Stereo processing by semiglobal matching and mutual information. TPAMI 2008, Volume 30(2), pp. 328-341
WCMA_ROBtwo views2.01
10		0.34
3		1.89
7		0.04
11		0.00
1		1.07
9		0.60
9		1.09
6		1.21
11		5.12
12		9.87
17		8.09
15		4.48
14		3.74
8		2.55
11		0.00
1		0.00
1		0.01
13		0.00
1		0.02
2		0.13
15
MSMD_ROBtwo views2.04
11		0.40
8		2.13
9		0.00
1		0.00
1		4.88
16		0.22
7		0.93
3		1.82
14		5.71
13		7.79
15		7.39
14		3.72
13		4.62
9		1.22
6		0.00
1		0.00
1		0.00
1		0.00
1		0.00
1		0.02
5
pmcnntwo views2.10
12		0.59
12		4.52
16		0.27
16		0.86
17		0.34
2		0.29
8		1.69
9		0.75
9		0.36
6		7.50
14		14.39
17		0.56
7		4.90
10		4.69
15		0.00
1		0.00
1		0.00
1		0.00
1		0.16
10		0.04
8
SGM+DAISYtwo views2.38
13		0.98
16		4.37
15		0.48
17		0.33
16		2.24
14		1.94
15		1.16
7		1.47
13		6.62
14		5.89
11		5.77
12		5.09
15		5.76
14		4.39
14		0.16
15		0.15
16		0.06
16		0.14
16		0.26
12		0.40
17
PWCKtwo views2.44
14		1.65
17		7.31
17		0.22
15		0.02
10		3.12
15		4.74
16		3.06
17		3.48
16		0.72
8		4.42
10		3.40
9		1.67
10		9.06
17		3.36
13		0.39
17		0.01
13		0.00
1		0.00
1		2.19
17		0.08
10
MeshStereopermissivetwo views2.61
15		0.65
13		2.71
12		0.02
9		0.02
10		1.55
13		0.94
13		3.02
16		1.29
12		11.21
17		7.34
13		11.54
16		2.74
12		6.34
15		2.43
10		0.00
1		0.00
1		0.00
1		0.00
1		0.28
14		0.03
6
C. Zhang, Z. Li, Y. Cheng, R. Cai, H. Chao, Y. Rui: MeshStereo: A Global Stereo Model with Mesh Alignment Regularization for View Interpolation. ICCV 2015
ELAScopylefttwo views2.75
16		0.35
5		2.67
11		0.05
12		0.04
12		6.72
17		1.83
14		2.84
15		3.38
15		8.25
16		9.14
16		3.95
10		6.15
16		3.73
7		5.70
17		0.00
1		0.04
14		0.01
13		0.01
14		0.10
8		0.08
10
A. Geiger, M. Roser, R. Urtasun: Efficient large-scale stereo matching. ACCV 2010
ELAS_ROBcopylefttwo views2.84
17		0.34
3		3.86
14		0.05
12		0.05
13		1.52
12		5.02
17		1.93
10		5.28
17		7.10
15		6.96
12		6.26
13		8.34
17		4.96
11		4.90
16		0.00
1		0.04
14		0.01
13		0.01
14		0.10
8		0.09
13
A. Geiger, M. Roser, R. Urtasun: Efficient large-scale stereo matching. ACCV 2010
MEDIAN_ROBtwo views93.37
18		98.75
18		96.05
19		90.90
18		90.53
18		85.63
18		76.45
18		92.03
18		89.53
18		95.05
18		94.99
18		96.02
18		93.85
18		90.36
18		87.21
18		98.36
18		95.79
18		99.61
18		98.77
18		98.80
18		98.72
18
AVERAGE_ROBtwo views98.45
19		99.13
19		95.46
18		100.00
19		100.00
19		93.36
19		81.95
19		100.00
19		99.97
19		100.00
19		100.00
19		100.00
19		100.00
19		99.72
19		99.40
19		100.00
19		100.00
19		100.00
19		100.00
19		100.00
19		100.00
19