Concept

Depth uncertainty — where it appears

The interval a measured depth really lies in, which grows as the square of the distance and is not symmetric. It follows from depth being a reciprocal of what is read, so a fixed reading error maps to an interval that eventually has no far end at all.

Named by 21 essays across 7 fields — each of them below, with the objects they name alongside it.

025507510010203040true depth (m)depth reported from the disparity, with a 1 px reading error5.86–7.33 m13.96–26.69 m23.76–126.49 mat 40 m: +86.5 m against −16.2 munbounded past 58.5 m

Depth is a reciprocal

Two eyes measure a shift in the picture, and depth is that shift divided into a constant. So a fixed error in what is read maps to an interval in what is reported that is not centred on the answer, and at forty metres runs sixteen metres nearer and eighty-six further.

depth · Disparity
123-2-10baseline (m, log scale)range past which 1 px of disparity error is unbounded (m, log scale)65 mm → 58.5 mrange = fB/δ — 58.5 m at a 65 mm baseline900 px focal length, 1 px reading

The range a pair cannot see past

A stereo rig has a distance beyond which it cannot say "no further than", and the distance is fixed before anything is built. It is the focal length times the baseline divided by the reading precision, and for a human pair of eyes it is fifty-eight and a half metres.

depth · Disparity
010203040-2502550disparity on the screen — millimetreswhere the point is depicted — metres from the eyesd = 63 mm — the eyes' separationon the glassscreen at 2.0 m · eyes 63 mm apartthe ceiling is the head, and it does not move when the screen does

Two pictures on one screen

A stereoscopic display puts a point where two sightlines cross, so the depicted depth is b·D/(b−d) and the disparity that reaches infinity is exactly the separation of the reader's eyes — 63 mm, at any screen distance whatever. The depth budget is set by the width of a head and by nothing about the scene.

screen · Stereodisplay
-0.10000.1002.5057.5010depth reported from the stepped disparity (m)height reported for each image row (m)the floor as it is35 platesspacing 3.9 cm → 1.95 mslope 1.997

Whole pixels cut space into shells

A disparity read to whole pixels can report only the depths fB/k, so a stereo pair does not measure distance on a scale — it chooses among 113 shells between half a metre and twelve, 6.7 cm apart at two metres and 1.39 m apart at ten. A level floor comes back as 35 standing plates. And a finer step and a better reading are different purchases: at a quarter pixel with a quarter pixel of matcher error the pair prints 449 depths and can tell 149 apart.

depth · Disparity
slit leaning 10° forwardslit leaning 10° back4 m · 37 px9 m · 83 px15 m · 138 px23 m · 211 px35 m · 321 px52 m · 477 px9.169 px of disparity per metredepth to 7e-15 m

A scroll through two slits ranges in a straight line

Draw a scroll twice, through a slit leaning 10° forward along the track and one leaning 10° back, and every point appears in both drawings on the same row, separated by 9.169 px for every metre of its depth — at four metres and at fifty-two. Depth is proportional to that separation rather than reciprocal to it, so a pixel of error costs 10.9 cm at every distance, averaging leaves no bias, and there is no range past which the depth runs off to infinity. The price is paid in roll: a 100 m scroll ranges nothing past 283.6 m.

scroll · Pushbroom
248163264128256100100010000depth of the point from the track (m, log scale)separation of its two drawings (px, log scale)straight trackoutside a 500 m bendoutside a 200 m bendoutside a 100 m bendinside a 200 m bendstraight: 9.169 px per metreslits ±10° · 26 px per metre of roll

A scroll round a bend loses its straight-line depth

Draw a scroll through two slits leaning ±10° from a track that bends, and the separation that was 9.169 px for every metre of depth stops being proportional. Outside a 100 m bend it is 653.8 px at 256 m where a straight track gives 2347, and it never passes 907.6 px however deep the point; inside a 200 m bend it runs nearly three times ahead of depth and no slit reaches past 165.3 m. The two drawings still share their rows, and the scale along the roll becomes a function of depth.

scroll · Pushbroom
024010203040how far the mirror is turned from square, in degreeswhat three tenths of a pixel can cost, in millimetresnearly squareone mark, 0.3 px of marking error3.0× across the range

Square to the camera is the worst mirror

A mirror pair's baseline runs along the mirror's normal, so a mirror facing the camera puts the second eye directly behind the first — the forward-motion arrangement, with the epipole in the middle of the frame and the rays to a mark crossing at 23°. Turning it forty-four degrees opens that to 65° and cuts the worst depth error threefold, and the number to watch is not the angle but where the reflected lens sits on the print.

mirrors · Mirrorpair
020040060018202224along-roll scale measured beside the point (px of paper per metre of ground)separation of the point's own two drawings (px)5 m out10 m out20 m out40 m out80 m out120 m out6 points, one bendradius read back to 0e+0 m

A scroll can be asked its own radius

The two marks a bend leaves separate exactly. The along-roll scale alone fixes the angle in the disparity, so one point and a neighbour at its depth give back the radius and the depth in closed form — 200 m and 40 m returned to a part in 10⁹, with no search. The two answers are not equally held: a scale read one per cent too large under-reads the depth by one per cent and over-reads the radius by tan(φ − α)/α, which is 50 for a point ten metres from a five-hundred-metre bend. And a painter who evens the scale out by eye reports a gentler bend, never a bend that was never there.

scroll · Pushbroom
8 m4 m2 mepipoleone pixel costs 10 %: 19 px · 54 px · 123 px · 247 px0.5 m forward

An epipole in the picture leaves a blind disc

Step a camera half a metre straight forward and the image of the other eye sits in the middle of both pictures. Around it lies a disc where one pixel of reading costs a tenth of the depth or more — 20 px across a surface 2 m off, 247 px at 16 m — and at its centre no depth is recovered at any range.

twoviews · Epipole
050100204060how far the third eye stands from the point, in metreshow far the answer is from the truth, in millimetresnearest in metresleast reprojection error120 noise draws averaged at each station132 vs 34 mm

A third ray is worth what its picture is worth

Three eyes on one point, two at seven metres and one walked back to seventy. The point nearest all three rays in metres is 132 millimetres from the truth and the point of least reprojection error is 34 — the same 34 the near pair gives alone — and the first is pulled 12 millimetres along the line to the distant eye. And arrangement beats count outright — two rays spread over fifty-five degrees beat eight rays inside four, by a factor of 4.4.

depth · Triangulation
89°in plan · the mark's size is the angle at the pointthe track covers 60°

The spread a point gets

A track of sixty degrees gives no point of the scene sixty degrees. The nearest receive 89 and the furthest 41, a factor of 2.2, and their errors run from 1.5 to 8.4 millimetres — following the angle at the point as its −1.68 power, with 94 per cent of the variation explained. The arc a track covers is one number for forty-four different situations and predicts none of them.

manyviews · Spread
where the eyes are aimedin plan, framed to the shells drawnzero at 0.92 m, 40° aside

Vergence moves the shells and does not respace them

Turn two eyes inward and the depths a whole-pixel reading can report stop being planes and become a family of near-circles through both eyes — the twenty-pixel shell standing at 0.74 m forty degrees aside where a parallel pair puts it at 3.82. The spacing between consecutive shells is the same to 0.07 per cent across the whole field, so vergence relabels the rays and does not sharpen them, and the resolution argument for turning the eyes in does not exist.

depth · Disparity
2.7:13.1:14.5:15.8:17.2:1in plan; ellipses at 8σworst 7.2:1

The answer is an ellipse

A mark read with a round error does not come back as a round region on the ground. The ray is grazing, so a pixel across the picture is worth a little and a pixel up it is worth a great deal, and the recovered point's uncertainty is an ellipse pointing at the camera — 5.07 to 1 at eight metres from a camera 1.62 m up, which is the depth over the height. Propagated and sampled agree to 0.5 per cent, and a ray that is not grazing gives a disc.

metrology · Uncertainty
near and short3.68%0.5 m, 126 pxnear and long2.84%4.0 m, 1088 pxat the unknown's depth3.95%1.4 m, 154 pxfar and long8.36%5.2 m, 241 pxthe spread of the answer, per candidateshorter is better

Which reference to measure from

Given four candidate scale bars in one photograph, the best is not the longest and not the nearest — it is the longest in the picture. A five-point-two metre bar near the horizon is the longest thing in the scene and the worst reference in it; a four metre bar close to the camera is the best. Walk one bar outward and the term it controls falls as one over its length in pixels, with a fitted exponent of −1.08.

metrology · Uncertainty
0.2000.4000.6001.8022.20range, mheight above the plane of the eyes, mhorizontalverticalat 2 m, 40 cm off the plane79° between them

The second disparity cuts cells

A point off the plane of the eyes has a vertical disparity as well as a horizontal one, and quantising both, on an 86,400-point lattice of a room, gives 7,663 labels where one coordinate gives 179 — a count that belongs to the lattice rather than the room, as the essay after this one found. The gain is entirely vergence's — two eyes looking straight ahead have no vertical disparity at all, exactly — and it is largest where the first reading is already finest: 60.8 in the near metre and 3.7 in the far band.

depth · Disparity
010203051015how far each camera is turned in, degreesper centwhat the vertical disparity addslabels merged by rectifyingof those, from the warpfocal length to merge noneeach pair rectified at its own 900 px4.0% for eyes at 1.2 m

Rectifying a pair spends what its epipolar lines lean

Counted from the two disparities alone, rectifying a verged pair looks as if it throws away at least 99.7 per cent of what the pair can tell apart. That cannot be true of a warp that loses no ray, and it is not: once the place in the picture is counted, the vertical disparity adds 4.1 per cent for eyes verged at 1.2 m, and rectifying at the same focal length gives back all but 4.0 of it.

depth · Disparity
9 m out82.6 px apart along7.47 px apart in rows18 m out165.2 px apart along7.47 px apart in rows36 m out330.5 px apart along7.47 px apart in rows72 m out661.0 px apart along7.47 px apart in rowsrows parted by 7.47 px at every post · slits ±10° · drawn at 1.5×no single viewpoint — the rays miss by the height climbed between two momentsa 5% climb, eye upright

A scroll of a climbing road measures its grade

Every reading of the two-slit scroll has leaned on its two drawings of a point sharing a row, because the eye is at one height at both moments. On a road that climbs they do not — and what parts them is the height climbed between the two moments over the reach, which on a straight climb is 2·f·g·sin φ for every point at every depth and height. The scroll does not lose its rows to a hill. It gains a third mark, a gradient meter that a level bend cannot counterfeit.

scroll · Climb
two pictures: 206 pxthree, in a line: 92 pxthree, 5 cm sway: 83 px0.5 m between shots · 8 m away · a pixel costs 10 %centre: 29 %

A sway gives the blind centre a depth, not a good one

A camera driving straight forward cannot see how far away the thing it is driving toward is: the mark at the epipole does not move between pictures. Let one of three pictures sway sideways and the centre gets a depth at once — but a depth resting on the sway alone, which a pixel of reading moves by the focal length's reciprocal times the depth over the sway. For a centimetre of steering wobble at eight metres that is 144 per cent; for a tenth of the forward step, 29. The hole closes; the disc around it stays until the sway is a third of the step.

twoviews · Epipole
9 m outleans 1.58°0.00 px apart in rows18 m outleans 3.16°0.00 px apart in rows36 m outleans 6.31°0.00 px apart in rows72 m outleans 12.46°0.00 px apart in rowsrows parted by 0 px · posts lean with depth · slits ±10° · drawn at 1.5×no single viewpoint — the rays miss by the height climbed between two momentsa 5% climb, eye pitched with it

An eye that pitches with the road keeps its rows

An upright eye climbing a road parts each point's two drawings by the same few rows, and that offset reads the grade. Fix the eye to the vehicle instead, so it pitches with the road, and the offset vanishes exactly — for every point, at every depth and height. The grade has not gone. It has moved into the posts, which now lean by an amount that grows with their depth, and into one drawing, which can now read the grade on its own.

scroll · Climb
a wall at 10 m0 px−0.25 m0.25 px+0.17 m0.5 px+0.64 m0.75 px−0.64 m7 m8 m9 m10 m11 m12 m13 m14 mf = 900 px, B = 65 mm, whole pixelsshift 0.150 px puts a shell on the wall

A rectification's free shift is free only near the pair

Sliding a rectified pair's principal points apart adds a constant to every disparity, and a constant changes nothing about where points are — on paper. A whole-pixel reading is not paper. The same slide moves every depth the reading can report, and for a wall ten metres away the choice between the best shift and the worst is 1.71 metres. Near the pair it is millimetres. A matcher with half a pixel of its own error erases the choice, and pays more than the worst shift did.

depth · Disparity
in plan · ellipses 25× actual sizewithin 8.4° of the mean sight

Split the track and the needles turn

A point triangulated from a track of cameras is not known equally well in every direction: its error is a needle, long along the direction its lines of sight barely constrain. That direction is not the mean line of sight but the lines of sight weighted by how near each camera is — and it can be turned. Two groups of cameras more than a right angle apart swing every needle across, and the same six pictures of a facade then measure its depth four times better.

manyviews · Spread

Named alongside it

The objects these essays reach for when they reach for this one.

DisparityBaselineinstrument limitTriangulationConditioningrectified pairHandscrollMoving viewpointPushbroomQuantisationDemonstrationerror propagation

All concepts