Concept

Residual — where it appears

15 essays name this object, across 9 fields. What follows is each of them, and the objects they name alongside it.
the picturethe same plane, rectifieddoor — 0.5068 widths (true 0.5068)sill — 0.3026 widths (true 0.3026)diagonal — 1.1766 widths (true 1.1766)worst error 4e-16 relativethe probes were not used to build the map

Flattening a façade out of the photograph

Four corners of a rectangle whose proportions are known are enough to undo the projection of one plane. After that the plane can be measured with a ruler — lengths, angles, areas, all of it — in units of the rectangle's own width, and lengths the map was never given come back to fifteen digits.

metrology · rectify
horizon — the image of the line at infinityvanishing point at x = 1464 — off the framecorrect from 26 cm, at 160 mm wide34° across

Where parallel lines meet

They meet at a point that is not in the plane, and the horizon is the line made of all such points. Treating that as bookkeeping misses what it buys — a vanishing point becomes an ordinary point of the picture, findable from the drawn lines, checkable, and enterable into any calculation the others are.

foundations · vanishing
horizonshadows meet at x = -58, off the frameon the horizon, as it must be

Where shadows vanish

The shadows of parallel posts under the sun meet at a point, and that point must lie on the horizon. Under a lamp they meet at the lamp's foot instead. Both are checkable in any photograph, and a picture whose shadows fail the check was not lit by anything.

light · shadowvp
00.50011.502-0.400-0.20000.200k₁departure of the cross-ratio from the world's value (%)pinhole1.29%the pinhole's own error, on the same four points2e-16 — the control

A lens destroys the invariant

The cross-ratio is the one thing a projection preserves, and everything checkable on this site is checked with it. A lens returns it one and a third per cent out where the pinhole is exact to fifteen digits — and the height error that follows tracks a quantity nobody would guess.

lens · distortion
the water surfacethe pinholethe rays miss by 9.9 mmno single viewpoint — the rays miss by 9.9 mmdry control: 0e+0 m

A picture through water has no viewpoint

Continue the rays of a refracted picture into the water and fit them to a common point. They miss it by ten millimetres. The same fit with the water taken away misses by zero, which is what makes ten millimetres a measurement rather than a number.

refraction · nocentre
1234512345a point is chosen hereand must be on this linematch to its own epipolar line: 1.4e-13 px5 of 44 correspondences drawn

A point is a line over there

Knowing where a mark sits in one photograph does not say where it sits in the other. It says which line it is on, which removes one of the two unknowns and leaves one — and the five lines drawn here meet at a point to within a thirtieth of a billionth of a pixel.

twoviews · epipolar
recovered principal pointused to drawrecoveredgapfocal length853.90853.904e-15principal x345.0345.02e-12angle44.0°44.0°correct from 20 cm, at 160 mm wide44° across

Recovering the camera from the picture it drew

Draw a box from a known camera, forget the camera, and get it back from the twelve drawn edges alone. Agreement to one part in 10¹⁵ is a statement about the geometry, because the only thing that crossed between the two halves was a list of line segments.

foundations · recovery
fitted k₁ = -0.280000true -0.280000, off by 5e-15

Fitting a lens from straightness alone

No calibration target, no known scene, no camera. Only the knowledge that some edges in the picture were straight — and the coefficient comes back to fifteen digits. Then it comes back with a companion, and the two are correlated at −0.997.

lens · plumbline
midpoint — 2.77 mm gapfrom the left eyefrom the right eyegap 2.77 mm at 7.22 mexact marks: 2.2e-16 m

Two rays that do not meet

Triangulation is described everywhere as the intersection of two rays, and two rays in space do not intersect. Read the same two marks to a whole pixel and they miss by 2.77 mm at seven metres, which is a real length and is the part a residual will not report.

depth · triangulation
-10-50-2-10baseline (m, log scale)worst deviation in the recovered shape (log scale)exact pointsread to 1 pxat 2 mm: 4.7e-9 exact, 2.9e+1 read to 1 px6e+9× apart

A turn of the head is not a step sideways

The textbook says a short baseline makes reconstruction ill-conditioned. Measured, the algebra does not notice — a two-millimetre baseline recovers the courtyard to nine digits from exact marks. What fails is the ratio of baseline to reading error, and it fails without refusing.

depth · baseline
-10-50012345iterationreprojection error (px, log scale)exact marksread to 1 px4.67 px → 0.3324 px in 5 iterationsexact marks reach 1.3e-11 px

Where the adjustment stops

Given exact marks the reprojection error falls to a hundredth of a billionth of a pixel, which is arithmetic. Given the same marks read to a whole pixel it falls to a third of a pixel and stays there, and a solver that reached zero on those would be fitting the rounding.

manyviews · bundle
centric pointdistance point, 12 px off the sheet →430 pxcorrect from 10 cm at 160 mm wide47° across

The distance point is the viewing distance, drawn

There is exactly one place in the whole classical apparatus where the distance from the eye to the picture appears as a length on the page, and it is the offset from the centric point to the distance point. Everything this site exists to compute was drawn in the fifteenth century, on the horizon, and nobody said what it was.

construction · alberti
an anchorcorrect from 19 cm, at 160 mm wideflat 1e-13 px · rolled 30.5 px

A projection of a projection

Photograph a photograph and the composite map is a homography — four marks determine it and every other lands where they say, to 1e-13 px. Roll the print and the same four mispredict the rest by 30.5 px, which is why straightening a page of a thick book never quite works.

foundations · composition
the far field — where the stitch was fitted2.2 m — 3.2 px out24 m — 0.3 px outthe sky registers to 1e-13 pxthe foreground does not — up to 3.2 px

The eye is a place, not a point

Rotate a camera about the wrong point and the sky still stitches perfectly while the foreground slides. The misregistration falls as one over the distance, exactly — which is what says the fault is the pivot and not the lens.

lens · pupil
00.50011.50010203040correspondenceepipolar error at every OTHER point, after one match is movedmedian 0.54 pxthe moved oneevery point wrong: median 0.54 px, worst 1.7 pxclean fit 2.3e-13 px

A wrong match is not a small error

Move one correspondence of forty-four by thirty pixels and the recovered geometry is wrong for every other point — the typical one by half a pixel, from a fit that was exact to a part in ten trillion. Least squares has nowhere to put a bad row except across all of them.

depth · outlier

Named alongside it

The objects these essays reach for when they reach for this one.

Vanishing pointCorrespondenceFocal lengthHomographyPrincipal pointHorizonleast squaresBaselineCross ratioPicture planeReprojection errorsingle-view metrology

All concepts