Low-res two-view benchmark

This table lists the benchmark results for the low-res two-view scenario. This benchmark evaluates the Middlebury stereo metrics (for all metrics, smaller is better):

The mask determines whether the metric is evaluated for all pixels with ground truth, or only for pixels which are visible in both images (non-occluded).
The coverage selector allows to limit the table to results for all pixels (dense), or a given minimum fraction of pixels.

Methods with suffix _ROB may participate in the Robust Vision Challenge.

Click one or more dataset result cells or column headers to show visualizations. Most visualizations are only available for training datasets. The visualizations may not work with mobile browsers.




Method Infoalllakes. 1llakes. 1ssand box 1lsand box 1sstora. room 1lstora. room 1sstora. room 2lstora. room 2sstora. room 2 1lstora. room 2 1sstora. room 2 2lstora. room 2 2sstora. room 3lstora. room 3stunnel 1ltunnel 1stunnel 2ltunnel 2stunnel 3ltunnel 3s
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
DN-CSS_ROBtwo views8.17
1		2.59
8		14.14
15		6.11
7		3.22
11		6.31
1		3.53
3		22.92
3		20.59
2		16.66
2		30.05
4		9.31
1		7.95
2		13.49
1		4.78
1		0.72
19		0.00
1		0.45
14		0.00
1		0.54
8		0.09
1
MLCVtwo views9.32
2		2.22
7		12.55
11		5.22
2		1.32
1		13.79
3		1.35
1		21.14
1		23.65
3		21.91
5		31.37
7		17.14
3		7.57
1		16.00
4		10.18
6		0.22
6		0.01
2		0.03
5		0.02
7		0.40
3		0.29
4
iResNettwo views10.26
3		3.10
14		15.72
22		7.35
12		2.13
4		13.86
4		7.07
10		22.80
2		28.01
5		20.10
3		30.40
5		16.79
2		11.06
3		14.46
3		10.29
8		0.39
12		0.05
7		0.00
1		0.07
11		0.73
10		0.73
11
NOSS_ROBtwo views10.99
4		3.81
17		6.88
3		6.69
10		2.30
5		16.06
7		10.94
14		30.06
11		32.41
12		16.10
1		18.72
1		22.78
5		14.21
4		17.52
7		8.62
4		2.35
28		1.84
30		3.32
32		1.57
29		2.06
24		1.52
21
HSMtwo views11.33
5		1.80
2		7.04
5		6.13
8		3.99
14		16.16
8		6.92
9		29.69
9		19.39
1		22.95
6		26.05
2		41.08
22		15.79
8		20.25
13		8.89
5		0.02
1		0.03
5		0.01
4		0.00
1		0.15
1		0.34
6
iResNet_ROBtwo views11.71
6		1.96
5		10.77
8		6.01
6		3.68
12		15.13
6		2.34
2		31.72
13		37.58
21		26.16
9		32.77
11		25.88
8		15.34
6		16.35
5		7.94
3		0.19
4		0.01
2		0.00
1		0.00
1		0.31
2		0.12
2
CBMV_ROBtwo views11.77
7		2.89
10		6.92
4		5.20
1		2.88
8		14.12
5		4.79
5		26.69
4		29.84
7		26.17
10		31.92
9		23.61
6		20.74
19		20.20
12		10.18
6		1.78
27		1.80
29		2.17
29		1.26
27		1.61
19		0.55
9
iResNetv2_ROBtwo views12.00
8		2.91
11		13.46
12		5.82
4		3.73
13		13.15
2		6.45
8		34.15
17		36.02
17		25.25
8		33.81
14		29.79
11		14.24
5		13.61
2		6.10
2		0.21
5		0.02
4		0.12
8		0.00
1		0.82
12		0.25
3
SGM-Foresttwo views12.92
9		1.87
3		6.61
1		5.68
3		2.05
3		23.19
15		11.30
16		34.24
18		30.77
10		26.54
11		31.99
10		29.98
12		15.74
7		21.17
15		13.36
9		1.05
23		0.33
19		0.84
21		0.01
6		0.71
9		0.97
15
Johannes L. Schönberger, Sudipta Sinha, Marc Pollefeys: Learning to Fuse Proposals from Multiple Scanline Optimizations in Semi-Global Matching. ECCV 2018
DLCB_ROBtwo views13.35
10		3.00
12		9.12
7		9.43
18		5.68
22		21.80
12		10.12
12		29.19
8		29.92
8		27.71
13		31.45
8		32.37
14		19.50
16		19.02
10		16.73
13		0.22
6		0.04
6		0.38
13		0.06
10		0.49
6		0.85
12
StereoDRNet-Refinedtwo views13.36
11		2.80
9		10.82
9		7.94
16		3.10
9		18.95
9		4.45
4		28.47
7		29.65
6		29.11
15		41.47
26		24.44
7		17.64
12		23.34
16		21.66
16		0.16
2		0.07
8		0.53
17		0.32
17		0.77
11		1.64
22
CBMVpermissivetwo views13.69
12		3.63
15		8.02
6		5.93
5		2.69
6		22.57
13		12.44
17		29.81
10		31.57
11		31.20
22		33.79
13		31.04
13		17.41
11		25.28
19		14.11
10		0.71
18		0.60
26		0.60
18		0.11
12		1.11
16		1.13
16
Konstantinos Batsos, Changjiang Cai, Philippos Mordohai: CBMV: A Coalesced Bidirectional Matching Volume for Disparity Estimation. Computer Vision and Pattern Recognition (CVPR) 2018
pmcnntwo views14.59
13		3.68
16		19.78
29		6.83
11		4.51
16		21.27
11		14.67
21		27.37
5		30.54
9		27.09
12		40.19
23		38.71
20		18.53
15		17.70
8		19.27
14		0.84
20		0.09
11		0.00
1		0.00
1		0.48
4		0.31
5
StereoDRNettwo views15.30
14		4.47
20		14.35
18		10.71
23		8.69
33		25.02
19		11.03
15		39.66
27		35.62
16		29.17
16		28.81
3		34.05
16		17.80
13		18.80
9		23.77
22		0.41
13		0.30
18		0.15
9		0.14
13		1.64
20		1.42
19
DRN-Testtwo views15.88
15		3.83
18		14.70
19		9.96
20		8.02
32		28.93
23		14.65
20		42.34
30		38.25
23		28.18
14		34.31
16		29.22
10		18.35
14		20.01
11		22.68
18		0.37
9		0.41
21		0.46
15		0.28
16		1.28
17		1.34
18
DISCOtwo views16.36
16		1.88
4		16.15
24		7.78
15		4.19
15		26.92
20		10.21
13		30.31
12		44.26
28		21.35
4		33.91
15		35.80
19		22.40
20		35.65
33		33.87
35		0.18
3		0.08
9		0.04
6		0.04
8		1.71
21		0.54
8
NaN_ROBtwo views16.51
17		6.51
24		16.22
25		10.53
22		4.64
18		31.76
26		17.78
29		37.00
23		43.37
26		29.68
19		31.29
6		32.67
15		20.32
18		28.00
24		16.06
11		0.38
10		0.41
21		0.32
11		0.41
19		0.87
13		1.94
23
PSMNet_ROBtwo views16.90
18		5.45
22		14.16
16		13.77
29		7.25
30		27.65
21		32.74
35		43.21
33		37.88
22		24.00
7		32.97
12		34.55
17		16.69
9		17.41
6		23.96
24		0.38
10		0.22
14		0.93
23		2.05
31		1.83
22		0.96
14
NCCL2two views17.23
19		6.37
23		14.30
17		23.45
36		7.18
29		24.16
17		17.05
27		34.39
19		25.88
4		31.55
23		38.01
18		42.09
24		26.81
26		20.94
14		22.69
19		0.45
14		0.23
15		2.63
30		1.80
30		2.02
23		2.57
28
XPNet_ROBtwo views17.33
20		4.84
21		15.44
21		11.15
24		6.64
26		20.88
10		16.10
25		36.26
22		39.54
24		31.80
24		41.32
25		41.30
23		23.91
21		24.67
17		27.40
30		1.07
24		0.74
27		0.79
20		0.25
14		1.10
15		1.31
17
ETE_ROBtwo views17.67
21		9.48
31		17.66
26		13.60
27		4.57
17		23.03
14		21.09
32		32.49
15		35.24
15		30.49
20		38.06
19		46.18
32		24.49
22		26.40
21		24.21
25		0.46
15		0.24
16		1.14
26		0.84
24		1.52
18		2.13
26
PWCDC_ROBbinarytwo views17.80
22		9.62
32		18.38
27		17.95
32		7.74
31		24.61
18		5.56
7		34.41
20		52.79
34		29.66
18		50.20
32		20.63
4		19.69
17		29.85
26		20.87
15		6.18
32		0.26
17		0.10
7		0.05
9		5.36
32		2.00
24
MDST_ROBtwo views17.92
23		1.60
1		13.68
13		13.88
30		6.44
24		43.05
36		14.86
22		42.74
32		41.66
25		43.25
32		42.85
29		28.43
9		17.28
10		29.35
25		16.06
11		0.88
21		0.11
12		0.63
19		0.47
21		0.50
7		0.64
10
PWC_ROBbinarytwo views18.37
24		10.55
35		25.19
32		10.21
21		6.29
23		23.75
16		4.79
5		35.93
21		48.75
30		32.56
25		44.46
31		34.68
18		24.78
24		30.99
27		25.72
29		1.38
25		0.08
9		1.57
27		0.26
15		2.18
25		3.17
31
LALA_ROBtwo views19.19
25		7.15
28		15.93
23		12.96
26		5.30
21		28.30
22		23.21
33		42.51
31		36.69
18		33.45
27		40.81
24		50.96
34		24.53
23		27.92
23		25.66
28		0.60
16		0.44
23		2.04
28		1.22
26		2.54
26		1.47
20
SGM_ROBbinarytwo views19.52
26		2.12
6		6.79
2		6.59
9		1.33
2		38.20
35		15.74
24		38.13
25		34.07
14		45.71
34		41.91
27		51.41
35		38.10
33		38.77
35		27.80
32		0.61
17		0.36
20		0.51
16		0.33
18		1.03
14		0.90
13
Heiko Hirschmueller: Stereo processing by semiglobal matching and mutual information. TPAMI 2008, Volume 30(2), pp. 328-341
WCMA_ROBtwo views20.02
27		4.30
19		19.72
28		9.47
19		7.00
28		32.71
30		13.99
19		31.97
14		32.48
13		41.51
31		52.00
33		44.09
26		36.14
32		32.43
29		24.29
26		6.19
33		2.79
34		1.09
25		1.10
25		3.95
29		3.13
30
SANettwo views20.96
28		6.60
25		29.81
34		8.83
17		3.19
10		31.27
25		20.56
31		41.86
29		56.09
38		39.30
29		43.62
30		44.95
28		31.93
30		27.83
22		23.67
21		0.94
22		0.52
25		0.99
24		0.42
20		4.72
31		2.03
25
FBW_ROBtwo views21.00
29		10.23
34		22.72
30		13.71
28		6.77
27		30.49
24		16.46
26		44.58
34		43.57
27		44.25
33		39.59
21		43.27
25		26.12
25		33.96
31		21.80
17		2.58
30		1.84
30		7.14
34		2.78
33		4.00
30		4.06
32
CSANtwo views21.34
30		9.45
30		23.34
31		20.99
34		4.95
20		32.57
29		34.26
36		38.83
26		49.95
33		36.97
28		39.72
22		44.97
29		31.73
29		26.05
20		23.94
23		1.52
26		0.47
24		0.85
22		1.43
28		2.73
27		2.14
27
MeshStereopermissivetwo views22.27
31		6.87
26		11.15
10		7.69
13		4.87
19		37.70
34		13.06
18		41.64
28		36.95
19		50.92
35		53.41
34		58.12
36		41.93
35		37.73
34		27.62
31		2.52
29		2.37
33		2.99
31		2.07
32		3.09
28		2.60
29
C. Zhang, Z. Li, Y. Cheng, R. Cai, H. Chao, Y. Rui: MeshStereo: A Global Stereo Model with Mesh Alignment Regularization for View Interpolation. ICCV 2015
MSMD_ROBtwo views22.90
32		9.64
33		14.76
20		17.46
31		9.88
34		34.94
32		18.83
30		33.67
16		37.47
20		40.97
30		59.80
36		45.93
30		38.34
34		31.74
28		23.24
20		6.22
34		3.58
36		8.78
35		11.03
37		6.76
33		5.06
34
LE_ROBtwo views22.93
33		3.07
13		14.02
14		7.70
14		2.86
7		31.99
28		17.35
28		28.10
6		67.19
42		70.51
42		55.61
35		49.07
33		47.62
36		24.76
18		36.49
36		0.35
8		0.20
13		0.27
10		0.55
22		0.48
4		0.44
7
DPSNettwo views24.40
34		6.97
27		33.14
35		11.16
25		6.54
25		53.33
38		43.32
40		51.28
39		59.37
40		30.89
21		39.36
20		40.35
21		34.30
31		32.57
30		25.09
27		4.65
31		1.62
28		0.37
12		0.66
23		8.51
34		4.44
33
PDISCO_ROBtwo views24.45
35		9.24
29		29.28
33		28.68
37		19.96
37		37.14
33		15.33
23		45.04
35		54.69
36		29.24
17		42.67
28		46.07
31		28.17
27		35.35
32		30.30
34		9.92
35		2.13
32		6.90
33		3.20
34		8.74
35		6.87
35
DispFullNettwo views30.27
36		31.74
38		58.63
39		30.13
38		28.18
39		31.79
27		8.94
11		37.16
24		54.68
35		32.60
26		37.99
17		44.62
27		28.80
28		41.55
36		27.93
33		11.94
38		3.46
35		35.53
39		12.34
38		30.08
39		17.26
38
ELAScopylefttwo views33.68
37		18.95
36		36.71
37		20.64
33		13.61
35		56.43
39		35.14
37		50.03
38		49.90
31		60.58
36		63.83
40		58.64
38		53.36
37		50.73
38		44.44
38		11.03
36		6.58
37		10.02
36		7.43
36		13.58
37		11.94
37
A. Geiger, M. Roser, R. Urtasun: Efficient large-scale stereo matching. ACCV 2010
ELAS_ROBcopylefttwo views33.79
38		19.15
37		35.97
36		21.28
35		13.79
36		52.58
37		36.11
38		48.96
37		55.66
37		61.47
39		62.91
38		58.35
37		53.55
38		53.37
39		42.23
37		11.25
37		6.64
38		10.32
37		7.05
35		13.56
36		11.58
36
A. Geiger, M. Roser, R. Urtasun: Efficient large-scale stereo matching. ACCV 2010
NVStereoNet_ROBtwo views41.93
39		32.40
39		44.55
38		36.60
39		27.78
38		34.52
31		32.38
34		48.84
36		57.18
39		69.34
41		75.62
44		66.07
42		64.86
42		47.34
37		60.78
41		15.72
39		23.99
39		23.40
38		32.06
39		21.34
38		23.86
39
Nikolai Smolyanskiy, Alexey Kamenev, Stan Birchfield: On the Importance of Stereo for Accurate Depth Estimation: An Efficient Semi-Supervised Deep Neural Network Approach. Arxiv
SGM+DAISYtwo views54.67
40		56.61
40		62.73
41		40.21
40		53.22
41		61.95
41		48.59
42		55.05
40		44.62
29		61.03
38		63.68
39		60.46
40		55.62
39		60.68
41		55.34
39		56.34
40		48.56
42		50.16
40		49.63
42		52.25
40		56.76
42
SPS-STEREOcopylefttwo views55.62
41		59.14
41		64.16
42		45.05
41		53.84
42		59.88
40		44.00
41		59.53
41		49.94
32		62.33
40		61.09
37		59.80
39		56.82
40		60.06
40		57.85
40		58.41
41		48.34
41		51.07
41		49.21
41		55.41
41		56.48
41
K. Yamaguchi, D. McAllester, R. Urtasun: Efficient Joint Segmentation, Occlusion Labeling, Stereo and Flow Estimation. ECCV 2014
PWCKtwo views65.90
42		88.63
44		79.40
44		80.32
44		29.96
40		63.85
42		39.45
39		72.07
43		71.26
43		78.74
43		68.99
41		77.82
43		61.77
41		82.81
44		62.64
43		80.17
42		39.88
40		81.90
44		47.37
40		73.54
43		37.51
40
MFMNet_retwo views72.05
43		79.64
42		64.23
43		52.73
42		84.71
44		77.93
44		68.35
43		63.96
42		66.93
41		61.00
37		71.29
42		63.84
41		68.91
43		72.42
43		61.11
42		82.03
44		74.22
44		80.34
43		74.44
43		83.62
44		89.34
44
DPSimNet_ROBtwo views74.29
44		83.27
43		59.30
40		77.19
43		65.13
43		75.14
43		74.95
44		73.99
44		76.94
44		81.99
44		75.48
43		80.18
44		71.76
44		67.39
42		84.00
44		81.87
43		51.14
43		79.99
42		76.70
44		70.17
42		79.21
43
MEDIAN_ROBtwo views99.19
45		99.84
45		99.62
46		98.49
45		98.51
45		98.58
45		97.81
46		98.80
45		98.56
45		99.36
47		99.49
45		99.56
45		99.06
45		98.35
45		98.31
45		99.99
45		99.63
45		100.00
45		100.00
45		99.81
45		99.95
45
AVERAGE_ROBtwo views99.80
46		99.99
46		99.40
45		100.00
46		100.00
46		98.99
46		97.72
45		100.00
46		100.00
46		100.00
48		100.00
46		100.00
48		100.00
46		100.00
48		100.00
48		100.00
46		100.00
46		100.00
45		100.00
45		100.00
46		100.00
46
DGTPSM_ROBtwo views99.95
47		100.00
47		100.00
47		100.00
46		100.00
46		100.00
47		100.00
47		100.00
46		100.00
46		99.14
45		100.00
46		99.96
46		100.00
46		99.99
46		99.99
46		100.00
46		100.00
46		100.00
45		100.00
45		100.00
46		100.00
46
DPSMNet_ROBtwo views99.95
47		100.00
47		100.00
47		100.00
46		100.00
46		100.00
47		100.00
47		100.00
46		100.00
46		99.15
46		100.00
46		99.96
46		100.00
46		99.99
46		99.99
46		100.00
46		100.00
46		100.00
45		100.00
45		100.00
46		100.00
46
DPSMtwo views100.00
49		100.00
47		100.00
47		100.00
46		100.00
46		100.00
47		100.00
47		100.00
46		100.00
46		100.00
48		100.00
46		100.00
48		100.00
46		100.00
48		100.00
48		100.00
46		100.00
46		100.00
45		100.00
45		100.00
46		100.00
46
DPSM_ROBtwo views100.00
49		100.00
47		100.00
47		100.00
46		100.00
46		100.00
47		100.00
47		100.00
46		100.00
46		100.00
48		100.00
46		100.00
48		100.00
46		100.00
48		100.00
48		100.00
46		100.00
46		100.00
45		100.00
45		100.00
46		100.00
46