Theme

The thread: What a second picture adds — page 2

One view fixes a ray and a set of ratios. A second fixes a point, the whole three-dimensional shape, and where the other eye was — recovered from the two drawings and nothing else. It does not fix a size, and it does not fix itself when the eyes are close together. Each of those is measured here rather than stated. Essays 25 to 48 of 50.
slit leaning 10° forwardslit leaning 10° back4 m · 37 px9 m · 83 px15 m · 138 px23 m · 211 px35 m · 321 px52 m · 477 px9.169 px of disparity per metredepth to 7e-15 m The eye that moves

A scroll through two slits ranges in a straight line

Draw a scroll twice, through a slit leaning 10° forward along the track and one leaning 10° back, and every point appears in both drawings on the same row, separated by 9.169 px for every metre of its depth — at four metres and at fifty-two. Depth is proportional to that separation rather than reciprocal to it, so a pixel of error costs 10.9 cm at every distance, averaging leaves no bias, and there is no range past which the depth runs off to infinity. The price is paid in roll: a 100 m scroll ranges nothing past 283.6 m.

00.50011.50210203040how many marks the fit was givenerror in the recovered translation direction, in degrees (powers of ten)flatwith depththe same reading error in both5 counts The second eye

An ambiguity is not an uncertainty

Eight marks to forty cuts a solid scene's pose error from 19.8° to 0.7° and leaves a flat one at 48°. The two failures look identical from inside — a confident answer, a residual at the floor — and they respond to opposite remedies, so telling them apart is worth more than either measurement.

the lenstwo marks, a straightedge, no arithmetic2.8e-13 px Mirrors that are not cameras

Two matches are enough

A general fundamental matrix has seven free numbers and needs eight correspondences. A mirror pair's has two, and two correspondences fix it — with a straightedge, on a print, by drawing the line from each mark to its reflection and marking where the two cross. Given the same sixteen marks read to four tenths of a pixel, the constrained fit lands 4.8 times closer to the truth than the eight-point algorithm.

fixatedListing's law · 20° right and 20° uppitch 3.93 mm: one curve What a pair is for

Raise the gaze, and the line is gone

Turn two eyes 20° aside in the plane they share and the horopter keeps its vertical line — but the line stays in the median plane, 1.277 m ahead, not at the point being looked at. Raise the gaze as well and the rule by which each eye rolls decides the rest: Helmholtz's rule keeps a line; Listing's law and Fick's rule make the eyes' relative motion slide 3.93 mm and 7.09 mm along its axis, no point stays put, and the horopter becomes one curve.

water, n = 1.333eyethe point, 1.50 m downsagittal: 0.740 mtangential: 0.320 mno single viewpoint — the rays miss by 0.840 mbetween the pencil's two images Through water and glass

A point under water has two depths

The apparent depth of a submerged point is not one number even along one line of sight. The rays it sends to an eye pass through two focal lines, and at 60° from the vertical a point 1.50 m down has an image 0.740 m down and another 0.320 m down. Two eyes side by side read the first, a head moving up and down reads the second, and a pair of eyes tilted between them reads neither — their two rays miss each other by as much as 6.39 mm.

248163264128256100100010000depth of the point from the track (m, log scale)separation of its two drawings (px, log scale)straight trackoutside a 500 m bendoutside a 200 m bendoutside a 100 m bendinside a 200 m bendstraight: 9.169 px per metreslits ±10° · 26 px per metre of roll The eye that moves

A scroll round a bend loses its straight-line depth

Draw a scroll through two slits leaning ±10° from a track that bends, and the separation that was 9.169 px for every metre of depth stops being proportional. Outside a 100 m bend it is 653.8 px at 256 m where a straight track gives 2347, and it never passes 907.6 px however deep the point; inside a 200 m bend it runs nearly three times ahead of depth and no slit reaches past 165.3 m. The two drawings still share their rows, and the scale along the roll becomes a function of depth.

024010203040how far the mirror is turned from square, in degreeswhat three tenths of a pixel can cost, in millimetresnearly squareone mark, 0.3 px of marking error3.0× across the range Mirrors that are not cameras

Square to the camera is the worst mirror

A mirror pair's baseline runs along the mirror's normal, so a mirror facing the camera puts the second eye directly behind the first — the forward-motion arrangement, with the epipole in the middle of the frame and the rays to a mark crossing at 23°. Turning it forty-four degrees opens that to 65° and cuts the worst depth error threefold, and the number to watch is not the angle but where the reflected lens sits on the print.

seen herethe pair's pointexposed by 21.4 pxlines agree to 4e-13 px What a pair is for

A mismatch on its own line needs a third eye

Slide one mark of a correspondence 30 px along the epipolar line the other mark fixes, and every test two photographs can run stays at the arithmetic floor — epipolar distance 2.2e-14 px, the two rays meeting to 1.5e-15 m, reprojection 1.1e-13 px — while the point is reported half a metre too near. A third picture exposes it by 21.4 px from a third eye two metres off the first line of sight, and by exactly nothing from an eye on that line.

eyethe sticktwo eyes side by sidea nodding headcorrect from 18 cm, at 160 mm widekink 14.96° · turn 4.29° Through water and glass

A straight stick in water is a kink and a curve

The bent stick is described as one kink at the surface. Traced point by point, the image two level eyes see leaves the surface 14.96° off a stick leaning 30° — the same whichever way it leans — and then keeps turning, by 1.11° when it leans away from the eye and 7.62° when it leans toward it. A photograph from the eye shows the kink and almost none of the curve, 1.63 px over 166 px, and when the stick leans straight toward or away from the eye it shows neither: the picture is one straight line.

the second pictureepipole22 parallax lines miss the epipole by at most 1.7e-10 pxsecond camera stepped forward The second eye

Two marks off a known plane find the other eye

Map a courtyard's ground from one picture into the other, and every raised mark lands somewhere the map did not send it — displaced along a line through the image of the other camera, to a fifth of a billionth of a pixel. Two such marks put that image where it is, and with it the whole epipolar geometry.

020040060018202224along-roll scale measured beside the point (px of paper per metre of ground)separation of the point's own two drawings (px)5 m out10 m out20 m out40 m out80 m out120 m out6 points, one bendradius read back to 0e+0 m The eye that moves

A scroll can be asked its own radius

The two marks a bend leaves separate exactly. The along-roll scale alone fixes the angle in the disparity, so one point and a neighbour at its depth give back the radius and the depth in closed form — 200 m and 40 m returned to a part in 10⁹, with no search. The two answers are not equally held: a scale read one per cent too large under-reads the depth by one per cent and over-reads the radius by tan(φ − α)/α, which is 50 for a point ten metres from a five-hundred-metre bend. And a painter who evens the scale out by eye reports a gentler bend, never a bend that was never there.

eyefaint: the row it imitates · solid: the row that is builtbuilt row21.0 pxthe deep row28.4 pxdisparity across the row, two eyes 63 mm apartfar column cut to 0.300the eyes read 74.1%, not 22.2% Where to stand

A set cut for one eye

Build a colonnade four metres deep and cut every column so that its picture is the picture of one eighteen metres deep. The taper is forced rather than chosen — height and width both scale as the real depth over the intended one — and the match from the design eye is exact to sixteen decimal places. What gives it away is the second eye, and not by the ratio anybody would predict.

horizonthe pointits shadowcorrect from 22 cm, at 160 mm widerays cross at 28.5° · recovered to 9e-16 m Light and mirrors

The lamp is the second eye

One photograph, one lamp whose position is known, and a point's place in space comes back to 9e-16 m — the camera's ray through the point, the lamp's ray through the image of its shadow, and the intersection of two lines. It is triangulation with one of the two eyes replaced by a light, and it degrades exactly like a stereo pair: 5.9 mm of depth per pixel at 39° between the rays, 1 mm at 15.4°.

8 m4 m2 mepipoleone pixel costs 10 %: 19 px · 54 px · 123 px · 247 px0.5 m forward The second eye

An epipole in the picture leaves a blind disc

Step a camera half a metre straight forward and the image of the other eye sits in the middle of both pictures. Around it lies a disc where one pixel of reading costs a tenth of the depth or more — 20 px across a surface 2 m off, 247 px at 16 m — and at its centre no depth is recovered at any range.

050100204060how far the third eye stands from the point, in metreshow far the answer is from the truth, in millimetresnearest in metresleast reprojection error120 noise draws averaged at each station132 vs 34 mm What a pair is for

A third ray is worth what its picture is worth

Three eyes on one point, two at seven metres and one walked back to seventy. The point nearest all three rays in metres is 132 millimetres from the truth and the point of least reprojection error is 34 — the same 34 the near pair gives alone — and the first is pulled 12 millimetres along the line to the distant eye. And arrangement beats count outright — two rays spread over fifty-five degrees beat eight rays inside four, by a factor of 4.4.

89°in plan · the mark's size is the angle at the pointthe track covers 60° Many pictures at once

The spread a point gets

A track of sixty degrees gives no point of the scene sixty degrees. The nearest receive 89 and the furthest 41, a factor of 2.2, and their errors run from 1.5 to 8.4 millimetres — following the angle at the point as its −1.68 power, with 94 per cent of the variation explained. The arc a track covers is one number for forty-four different situations and predicts none of them.

left pictureright picture12341234cross-ratio 3.012836 left · 3.012836 rightagree to 8e-12 The second eye

The two pencils keep one number

Four lines through the image of the other eye in one picture, and the four epipolar lines they become in the other. The angles between them change by up to 11.4°; their cross-ratio is 3.012836 on both sides, to eight parts in a trillion. Three pairs of lines fix the map between the pencils, and the fourth is predicted to a third of a billionth of a pixel.

where the eyes are aimedin plan, framed to the shells drawnzero at 0.92 m, 40° aside What a pair is for

Vergence moves the shells and does not respace them

Turn two eyes inward and the depths a whole-pixel reading can report stop being planes and become a family of near-circles through both eyes — the twenty-pixel shell standing at 0.74 m forty degrees aside where a parallel pair puts it at 3.82. The spacing between consecutive shells is the same to 0.07 per cent across the whole field, so vergence relabels the rays and does not sharpen them, and the resolution argument for turning the eyes in does not exist.

eyethe stickcorrect from 18 cm, at 160 mm widerays miss by 3.13 mm Through water and glass

The stick a stereo pair puts back

Two eyes side by side reconstruct a submerged stick exactly as the sagittal image — kinked 14.96° — and two eyes one above the other exactly as the tangential one, kinked 9.59°. Roll the baseline between them and the two rays to a point miss each other by up to 3.13 millimetres, past the 2.85 a pixel covers at that range, and the reconstruction is a third stick that is neither — 551 millimetres of a one-metre stick, with its tip at 0.405 metres against a true 0.866.

2468-1-0.50000.5001position along the family the two pictures leave freehow far the solid is from the scene's own shape (stretch ratio)the sceneevery member redraws both pictures to 7e-16 mthe ambiguity is a family of solids, not a tolerance The other systems

What two parallel views leave free

Two perspective pictures give shape and no size. Two parallel pictures do not even give shape: the metric upgrade has six unknowns, two views supply six equations, and the system comes out rank five — a one-parameter family of solids that redraw both pictures to 7e-16 m. A third view closes it, and the mirror image survives every count.

left, rectifiedright, rectifiedrows agree to 1.1e-13 px · points to 3.1e-14 mturned 0° about the baseline The second eye

Rectification is a family, not an operation

Turn both pictures of a pair so their epipolar lines become shared rows. A turn about the line between the eyes and a focal length are left free, and every choice puts all 44 matches on common rows to a tenth of a trillionth of a pixel and every point back where it was. What the choices disagree about is the pixels — one stretches its pictures unevenly by 1.77, another by 4.86.

left pictureright picturethe post it is matched toone image row, drawn as two strips19.8 m instead of 9.0 What a pair is for

A third eye that lands on the next post

Match one post of a railing to its neighbour and the pair reports it at 19.8 metres instead of 9.0, with every test two photographs can run at the arithmetic floor. A third picture usually exposes that by hundreds of pixels — but at five azimuths in seventy-eight degrees the wrong point lands within three pixels of another post, and the third view confirms the mistake. Narrow the railing to twenty centimetres and those places cover 28 per cent of the arc.

the true planefirst number of the plane, from the true valuesecond44 points in front: 31.9 % of the slicethe third number held at its true value The second eye

Seeing the scene fences in the plane at infinity

A reconstruction made without the calibration does not know which of its planes is infinitely far away. Requiring every point to lie in front of both cameras rules out every candidate that would tear the courtyard, and what is left is a convex region — 32 per cent of a generous slice — that always holds the true plane and never shrinks to it.

the lens, in the left mirrorcorrect from 15 cm, at 160 mm wide12 marks × 3 views Mirrors that are not cameras

Two mirrors are three cameras

A photograph with two mirrors in it holds three views of the scene from three places, at baselines of 2.90, 3.10 and 2.26 metres. Two of the three pairwise geometries are mirror pairs and are skew; the third is a rotation by twice the angle between the mirrors, and it is not new evidence — five numbers read off the print rebuild it to 9.4 × 10⁻¹⁴ pixels, where a general three-view arrangement needs eighteen.

All themes