Concept

rectified pair — where it appears

Two pictures brought to coplanar image planes, so a point's match lies on the same row and the search is one-dimensional. It is produced for free by two cameras with parallel axes and shifted principal points, and produced by warping and cropping when the cameras were turned inwards instead.

Named by 8 essays across 3 fields — each of them below, with the objects they name alongside it.

025507510010203040true depth (m)depth reported from the disparity, with a 1 px reading error5.86–7.33 m13.96–26.69 m23.76–126.49 mat 40 m: +86.5 m against −16.2 munbounded past 58.5 m

Depth is a reciprocal

Two eyes measure a shift in the picture, and depth is that shift divided into a constant. So a fixed error in what is read maps to an interval in what is reported that is not centred on the answer, and at forty metres runs sixteen metres nearer and eighty-six further.

depth · Disparity
123-2-10baseline (m, log scale)range past which 1 px of disparity error is unbounded (m, log scale)65 mm → 58.5 mrange = fB/δ — 58.5 m at a 65 mm baseline900 px focal length, 1 px reading

The range a pair cannot see past

A stereo rig has a distance beyond which it cannot say "no further than", and the distance is fixed before anything is built. It is the focal length times the baseline divided by the reading precision, and for a human pair of eyes it is fifty-eight and a half metres.

depth · Disparity
vertical difference up to 30.8 px, drawn 8× overbaseline 63 mmconvergence 2.0 m

Turning the cameras inwards

A stereo pair made by rotating two cameras toward a common point puts the same world point at different heights in the two pictures — up to thirty pixels here, on a frame of four hundred. Two eyes level with each other see every point at the same height, so a pair with vertical difference is a pair of pictures of no scene at all.

screen · Stereodisplay
-0.10000.1002.5057.5010depth reported from the stepped disparity (m)height reported for each image row (m)the floor as it is35 platesspacing 3.9 cm → 1.95 mslope 1.997

Whole pixels cut space into shells

A disparity read to whole pixels can report only the depths fB/k, so a stereo pair does not measure distance on a scale — it chooses among 113 shells between half a metre and twelve, 6.7 cm apart at two metres and 1.39 m apart at ten. A level floor comes back as 35 standing plates. And a finer step and a better reading are different purchases: at a quarter pixel with a quarter pixel of matcher error the pair prints 449 depths and can tell 149 apart.

depth · Disparity
where the eyes are aimedin plan, framed to the shells drawnzero at 0.92 m, 40° aside

Vergence moves the shells and does not respace them

Turn two eyes inward and the depths a whole-pixel reading can report stop being planes and become a family of near-circles through both eyes — the twenty-pixel shell standing at 0.74 m forty degrees aside where a parallel pair puts it at 3.82. The spacing between consecutive shells is the same to 0.07 per cent across the whole field, so vergence relabels the rays and does not sharpen them, and the resolution argument for turning the eyes in does not exist.

depth · Disparity
left, rectifiedright, rectifiedrows agree to 1.1e-13 px · points to 3.1e-14 mturned 0° about the baseline

Rectification is a family, not an operation

Turn both pictures of a pair so their epipolar lines become shared rows. A turn about the line between the eyes and a focal length are left free, and every choice puts all 44 matches on common rows to a tenth of a trillionth of a pixel and every point back where it was. What the choices disagree about is the pixels — one stretches its pictures unevenly by 1.77, another by 4.86.

twoviews · Epipolar
010203051015how far each camera is turned in, degreesper centwhat the vertical disparity addslabels merged by rectifyingof those, from the warpfocal length to merge noneeach pair rectified at its own 900 px4.0% for eyes at 1.2 m

Rectifying a pair spends what its epipolar lines lean

Counted from the two disparities alone, rectifying a verged pair looks as if it throws away at least 99.7 per cent of what the pair can tell apart. That cannot be true of a warp that loses no ray, and it is not: once the place in the picture is counted, the vertical disparity adds 4.1 per cent for eyes verged at 1.2 m, and rectifying at the same focal length gives back all but 4.0 of it.

depth · Disparity
a wall at 10 m0 px−0.25 m0.25 px+0.17 m0.5 px+0.64 m0.75 px−0.64 m7 m8 m9 m10 m11 m12 m13 m14 mf = 900 px, B = 65 mm, whole pixelsshift 0.150 px puts a shell on the wall

A rectification's free shift is free only near the pair

Sliding a rectified pair's principal points apart adds a constant to every disparity, and a constant changes nothing about where points are — on paper. A whole-pixel reading is not paper. The same slide moves every depth the reading can report, and for a wall ten metres away the choice between the best shift and the worst is 1.71 metres. Near the pair it is millimetres. A matcher with half a pixel of its own error erases the choice, and pays more than the worst shift did.

depth · Disparity

Named alongside it

The objects these essays reach for when they reach for this one.

DisparityDepth uncertaintyBaselineFocal lengthinstrument limitQuantisationPrincipal pointVergenceBiasBinocular disparityCamera tiltDemonstration

All concepts