Concept

error propagation — where it appears

How an error in what is read out of a picture becomes an error in what is computed from it, usually amplified. The amplification is a property of the arrangement rather than of the arithmetic, so it has to be quoted alongside a residual for the residual to mean anything.

Named by 32 essays across 10 fields — each of them below, with the objects they name alongside it.

025507510010203040true depth (m)depth reported from the disparity, with a 1 px reading error5.86–7.33 m13.96–26.69 m23.76–126.49 mat 40 m: +86.5 m against −16.2 munbounded past 58.5 m

Depth is a reciprocal

Two eyes measure a shift in the picture, and depth is that shift divided into a constant. So a fixed error in what is read maps to an interval in what is reported that is not centred on the answer, and at forty metres runs sixteen metres nearer and eighty-six further.

depth · Disparity
00.50011.502-0.400-0.20000.200k₁departure of the cross-ratio from the world's value (%)pinhole1.29%the pinhole's own error, on the same four points2e-16 — the control

A lens destroys the invariant

The cross-ratio is the one thing a projection preserves, and nearly everything checkable about a photograph is checked with it. A lens returns it one and a third per cent out where the pinhole is exact to fifteen digits — and the height error that follows tracks a quantity nobody would guess.

lens · Distortion
parallel, 52° above the ground56% · 56% · 56%one eye, 14.5 m away49% · 56% · 49%a square metre of floor varies 1.000× against 1.535×spread across rooms: 0 against 6.2 points

Measuring a room off the page

A perspective picture of a floor has to be rectified before anything on it can be measured, and the rectification is a fit that amplifies the marking error. An oblique picture of the same floor is already rectified — the page is the plan, at one scale, and a ruler on the paper is a ruler on the ground.

conventions · Fukinuki
05101550100150200distance from the camera (metres)error in the recovered height, per pixel of click error (%)6 m — 0.55%25 m — 2.27%60 m — 5.43%120 m — 10.84%one pixel, on a 690 px picturelinear in distance

How wrong a measurement from one picture can be

The formula divides by a difference of two nearly equal numbers when the object is tall, which looked like the instability and is not. Measured, a taller object is recovered better and a more distant one worse — half a per cent per pixel at six metres and eleven per cent at a hundred and twenty. The argument that was wrong is as much the finding as the curve that replaced it.

metrology · Height
two eyesno single viewpoint — the rays miss by 0.54 mtwo centres, 1.30 m apart

A picture with two eyes in it

Several traditions draw the floor from one place and the people on it from another. No single camera produces both, as an earlier essay showed. What such a picture actually is has a measurement attached: give the rays their world points and ask for the one place they all pass through, and at a stride of separation the best answer misses them by six tenths of a metre.

conventions · Twocentres
481632641282560.3131030100how far away the scene is (m, log scale)pixels of parallax, and degrees of pose error (log scale)parallax, pxpose error, degreesparallax goes as distance to the -0.977 distances

Far enough away, a pair is one eye

Hold the baseline and walk the scene away, and the parallax a single homography cannot explain falls as the distance to the power −0.968 — one over the distance, which says the ratio of baseline to depth is the whole of it. The recovered translation direction follows it down, from 3.3° at four metres to 74.5° at two hundred and fifty-six.

manyviews · Degenerate
the outline, its shadow, and the outline recovered from itcorrect from 20 cm, at 160 mm widerecovered to 4e-16 m

A shadow can be un-cast

A shadow looks like a lossy record — a flattened smear with the shape half thrown away. It is nothing of the kind. The map from the occluder's plane to the floor is a plane projectivity, so it has an inverse, and the outline comes back out of its own shadow exactly. What breaks it is not the light and not the shape: it is the floor not being flat.

light · Shadowinverse
0306090-3-2-1out-of-plane spread, as a fraction of the scene's own extent (powers of ten)error in the recovered translation direction, in degreeswith 0.3 px of reading errorexact marksthe geometry is a step and the measurement is a slope9 reliefs

How flat is flat enough

With exact marks the transition has no width at all — 84° of pose error at exactly coplanar and 0.000° at eight parts in ten thousand of relief. Put three tenths of a pixel of reading error in and the same sweep becomes a slope three decades wide, crossing into usefulness when the out-of-plane parallax reaches about ten times the marking error.

twoviews · Planar
view 1, heldview 6one standard deviation, drawn 5× actual size — held: the first camerapoints 52.1–158.0 mm · cameras 0.0–104.8 mmmarks read to 1 px

An uncertainty is quoted from something

One adjustment, one set of marks read to a pixel, and its uncertainty written four ways. Held at the first camera, the last camera is 105 mm from certain; held at nothing, every camera is within 4 to 6 mm. A ratio of two distances carries 0.1465 per cent in all four, to two parts in a billion.

manyviews · Gauge
the room, as it ismisses by 0.665 mthe room it is consistent withmeets to 1.5e-15 mdecimal places the rays agree tothe picture cannot be askedthe room can

Counting the eyes needs the room

How many eyes made a picture is not a question the picture can be asked. Told what the room really measures, the rays refuse to meet and a second eye has been caught; told instead that the room is the one the picture is consistent with, the same rays meet exactly, at the first eye. The refusal is real and it belongs to the room.

conventions · Twocentres
01230123the plane moved by a factor of ten to the …depth resolution, relative (powers of ten)near plane, brought infar plane, pushed out1/near − 1/farone term does all the work

One plane is nearly free

The near and far planes enter a depth buffer's precision through 1/near − 1/far, and one of those reciprocals is enormous. Pushing the far plane out by a factor of a thousand costs a tenth of a per cent; bringing the near plane in by the same factor costs a factor of a thousand — and an infinite far plane is the limit of the first rather than a separate case.

pipeline · Zbuffer
00.50011.50210203040how many marks the fit was givenerror in the recovered translation direction, in degrees (powers of ten)flatwith depththe same reading error in both5 counts

An ambiguity is not an uncertainty

Eight marks to forty cuts a solid scene's pose error from 19.8° to 0.7° and leaves a flat one at 48°. The two failures look identical from inside — a confident answer, a residual at the floor — and they respond to opposite remedies, so telling them apart is worth more than either measurement.

twoviews · Critical
three edges crowded on one side5.69e-3two on one side, one on the other5.66e-4three edges near the centre6.73e-3three edges placed by search9.57e-4the centre free · log scalebest: 5.66e-4

The lines that calibrate a lens

One straight edge through the centre of a picture says nothing about a lens's distortion, and one 180 px from the centre determines k₁ to 9.0 × 10⁻⁴ — the precision rises in proportion to the offset. But distance from the centre is not enough. Crowd three edges on one side and, the moment the distortion centre is also unknown, the coefficient is ten times worse, because a bend on one side looks like a moved centre; put one edge across the centre and it barely changes.

lens · Plumbline
the photographthe ground, rectified5.205 m²four marks fix the plane; the shoelace does the rest1.8e-14

An area, out of one photograph

A patch of ground comes back at 5.205 m² from one photograph, to 1.8 × 10⁻¹⁴, through a homography built from four marks and their four known positions. What is worth knowing is how it degrades — the patch's extent across the picture is read with an error growing as the depth, its extent into the picture with an error growing as the depth squared, and at twenty-eight metres the two are sixteen times apart — which is the depth divided by the camera's height.

metrology · Area
horizonthe pointits shadowcorrect from 22 cm, at 160 mm widerays cross at 28.5° · recovered to 9e-16 m

The lamp is the second eye

One photograph, one lamp whose position is known, and a point's place in space comes back to 9e-16 m — the camera's ray through the point, the lamp's ray through the image of its shadow, and the intersection of two lines. It is triangulation with one of the two eyes replaced by a light, and it degrades exactly like a stereo pair: 5.9 mm of depth per pixel at 39° between the rays, 1 mm at 15.4°.

light · Shadowdepth
025507510010203040how wrong the assumed curvature is, as a % of the true oneworst error in the recovered design (mm)0.91% buys 1 mma a ridged floor, k = 0.0644.0 mm at 41% out

How well the floor has to be known

“Supply the surface” is an instruction with no number in it, and an instruction with no number is a wish. Here is the number: the error in the recovered design is very nearly proportional to the error in the assumed curvature — the constant varies by 1.4% across a twentyfold range — so about nine parts in a thousand of the curvature buys one millimetre on a design 1800 mm wide, and 40% out costs 43.5 mm.

curved · Curvedrectify
89°in plan · the mark's size is the angle at the pointthe track covers 60°

The spread a point gets

A track of sixty degrees gives no point of the scene sixty degrees. The nearest receive 89 and the furthest 41, a factor of 2.2, and their errors run from 1.5 to 8.4 millimetres — following the angle at the point as its −1.68 power, with 94 per cent of the variation explained. The arc a track covers is one number for forty-four different situations and predicts none of them.

manyviews · Spread
05010015020011.502log₁₀ of the lamp's distance (m)pixels the recovered foot sits below the horizonthe sun: on the horizonthe recovered height stays exactwhat falls off is the evidence that the light is finite

A light far enough away

The evidence in a photograph that its light is in the room rather than at infinity is one number — how far below the horizon the shadow lines put the light's foot. It falls off as one over the distance, from 211 px at 4 m to 10.8 px at 266 m, while the recovered height stays exact to 5e-13 of itself. What fails first is not the arithmetic; it is the evidence, and one pixel of error costs 0.21 mm of height at the near end and 0.07 m at the far one.

light · Lightrecovery
0102030400.2000.4000.6000.800where along the edge, as a fraction of the visible lengthshare of the edge's response to the coefficient, in per cent93% outside the middle halfone edge, 82 marks, cut into tenthsmiddle two tenths: 1.4%

The response is at the ends and the information is not

A radial map bows a straight edge by an amount that grows as the square of the distance along it, so 93 per cent of an edge's response to the coefficient lies in its outer quarters. Spending the marks there is 16 per cent worse than spreading them evenly, because two clusters say nothing a shifted, tilted line could not say. What identifies the coefficient is a curvature, which needs three places — both ends and the middle, which beats an even spread by 11 per cent.

lens · Plumbline
2.7:13.1:14.5:15.8:17.2:1in plan; ellipses at 8σworst 7.2:1

The answer is an ellipse

A mark read with a round error does not come back as a round region on the ground. The ray is grazing, so a pixel across the picture is worth a little and a pixel up it is worth a great deal, and the recovered point's uncertainty is an ellipse pointing at the camera — 5.07 to 1 at eight metres from a camera 1.62 m up, which is the depth over the height. Propagated and sampled agree to 0.5 per cent, and a ray that is not grazing gives a disc.

metrology · Uncertainty
0.111010010000.5125the accuracy the survey is stated to have (mm)shape error of the courtyard (mm)survey really 1 mmsurvey really 5 mmsurvey really 20 mmmarks read to 0.1 px · 200 trials eachlowest at the true accuracy

A survey is trusted at its own accuracy, unless its error has a shape

Entered into an adjustment with a stated accuracy, a survey whose errors are random gives the smallest shape error when the stated accuracy is the true one — at 1, 5 and 20 mm alike. Stated twenty times too tight it can cost thirteen times the error; twenty times too loose, almost nothing. But twelve surveys all 10 mm out in fixed directions are best trusted anywhere from 0.3 mm to 10 mm, and the size of their error cannot say which.

manyviews · Gauge
0.6000.7000.800010203040generations of copyingthe drawing's depth-spacing ratiocopying the methodcopying the marksone hand error, two kinds of copyist9 lineages

What survives being copied

A workshop copying a drawing from a drawing is a random walk — the spread across lineages grows as the square root of the generation, with a fitted exponent of 0.5001. A workshop copying the method is not, and its exponent is 0.012, which is no growth at all, and after forty generations two lineages started from different originals end up 5 × 10⁻¹⁵ apart. Copying the marks loses the picture; copying the recipe loses the original and keeps the recipe.

conventions · Transmission
near and short3.68%0.5 m, 126 pxnear and long2.84%4.0 m, 1088 pxat the unknown's depth3.95%1.4 m, 154 pxfar and long8.36%5.2 m, 241 pxthe spread of the answer, per candidateshorter is better

Which reference to measure from

Given four candidate scale bars in one photograph, the best is not the longest and not the nearest — it is the longest in the picture. A five-point-two metre bar near the horizon is the longest thing in the scene and the worst reference in it; a four metre bar close to the camera is the best. Walk one bar outward and the term it controls falls as one over its length in pixels, with a fitted exponent of −1.08.

metrology · Uncertainty
0100200300distance from the picture's centre, pxeach edge, by how far it passes from the centreoffset 20 px20–326offset 60 px60–330offset 125 px125–348offset 180 px180–372four edges, 82 marks eachevery one spans 16× in radius

No design separates the two coefficients

Separating a squared term from a fourth-power one was supposed to need marks at radii far apart, which is a statement about where edges are placed. It is not: one straight edge already runs from 20 px to 326. Spreading ninety-six marks over three edges or sixteen changes the answer by 23 per cent, spreading the offsets makes it 19 per cent worse, and the correlation stays at −0.98 whatever is done. What a plumb-line calibration determines is one number, to 1.52 thousandths, and which number depends on the model.

lens · Plumbline
0102030401234the marking error, in pixelsthe error of the answer, in per centupper curve: the closure wrong · lower: the closure exactfloor 6.0%

The floor a better camera cannot reach

Sweep the marking error from four pixels down to a hundredth and the measurement's error falls thirty-fold and then stops — at 6.0 per cent, which is exactly the six per cent the reference's assumed shape was wrong by. With the closure exact the same sweep keeps falling to 0.06 per cent. The crossing is at half a pixel, and it can be computed before the photograph is taken, which makes it a decision about equipment rather than a discovery about it.

metrology · Uncertainty
0.6000.7000.8000255075100generations of copyingthe pavement's depth-spacing ratiothe workshop's taste7% of proposals rejectedband ±0.04

The workshop that throws drawings away

Adding a rule that discards a drawing which looks wrong turns the mark copyist's spread from a growing random walk into a stationary process — the fitted exponent falls from 0.542 to 0.022, indistinguishable from the method copyist's 0.033 — and the two mechanisms then separate only by where they settle, 0.7002 against 0.8000, seven and a half spreads apart.

conventions · Transmission
60 px160 px260 px360 pxmarks every 8 px, kept inside the frame47 / 125 / 114 / 122 marks

A known target sharpens the fit and does not separate it

Printed circles of stated size were supposed to break the −0.98 correlation between a lens's two radial coefficients, because a circle puts every mark at one radius and no straight edge can. They do not: every design of circles leaves the pair 0.979 to 0.9997 correlated, and for circles of known size the figure is exactly the cosine between r³ and r⁵. What a known target buys is precision — 3.8 times the straight edges' at the same budget — and only if its size in the picture is known to about a thousandth.

lens · Plumbline
a length on the ground3.22%1.00 m across the referencethe camera's height0.36%1.62 m above the grounda repeated object, size unknown3.60%the answer in units of the repeata standing object of known height0.41%1.75 m, upright, anywhere on the …the focal length and the horizon1.94%700 px, and where the ground's li…the spread of the answer, per closureshorter is better

Five facts that close the same gap

The gloss that one length has to come from outside the photograph names a single option, and there are at least five — a length on the ground, the camera's own height, a repeated object of unstated size, a standing object of known height, and the focal length with the horizon. All five give an answer on the same picture with the same noise; their spreads run from 0.36 to 3.60 per cent, a factor of ten, and which one is available depends on the photograph rather than on the arithmetic.

metrology · Scale
second eye1% error5% error20% errordisc area ∝ error10 m past30 m pastprobes 1 m up · marks read to 1 px · 60 trialscameras side by side

A plane's coefficient reaches as far as its parallax

After a known plane's map, every raised point's displacement is its height over its depth, read as a coefficient on the epipole — exactly, for any point either picture sees. The worry was that the number would be local, good only near the floor whose marks fixed the map. Read to a pixel, it is not a distance on the floor that runs out. It is a length in the picture: the point's error is about 260 per cent over its parallax in pixels, wherever the point stands.

twoviews · Planar
00.2500.5000.750120406080assumed centre of the picture, % of the way between the vanishing pointsreconstructed proportion of the rectanglethe rectangle that was there, 0.667 : 115.7× across the arcevery one a true rectangle

The proportion is the assumption

Read the proportions of a rectangle out of a photograph of it and the answer is a function of where the centre of the picture is assumed to be. Sweeping that assumption across the horizon takes one drawn quadrilateral from one part in fourteen to slightly wider than square, every reconstruction a genuine rectangle, and only a fiftieth of the sweep within five per cent of the truth.

construction · Rectangle
horizoncorrect from 19 cm, at 160 mm wide2 centres · 2.12 px

How many lamps a drawing has

The shadow field recovers a lamp by intersecting drawn lines. Two lamps make that a partition rather than an intersection — and two centres fit any bundle better than one, on a one-lamp drawing as readily as on a two-lamp one, so a count is a decision that needs a noise level before it exists. A criterion built on a penalty instead of a noise level returns four.

light · Twolamps
00.2500.5000.7501-1-0.50000.500how far apart the lamps are, log₁₀ metreshow often the drawing is read as two lampshalf the drawings1 px of clicking, 12 drawings each, separated across the viewbelow the crossing the second lamp is not in the picture

The distance at which two lamps part

Two lamps five centimetres apart are one lamp, and the drawing is right to say so. The separation at which they become two is proportional to how carelessly the picture was clicked — 3.6 centimetres at half a pixel, 7.2 at one, 28 at four — with no floor anywhere, so nothing but care stands between a reader and any separation at all.

light · Twolamps

Named alongside it

The objects these essays reach for when they reach for this one.

ConditioningSensitivitysingle-view metrologyHomographyinstrument limitCamera calibrationleast squaresPrincipal pointResidualBiascentre of projectionDegeneracy

All concepts