Reprojection error — where it appears
Named by 12 essays across 3 fields — each of them below, with the objects they name alongside it.
The track and the scene together
Six photographs go in and one hundred and sixty-eight numbers come out — every camera's position and orientation and every point's place in space, solved for at once. Nothing in the solve was ever told where a camera or a point was.
Two rays that do not meet
Triangulation is described everywhere as the intersection of two rays, and two rays in space do not intersect. Read the same two marks to a whole pixel and they miss by 2.77 mm at seven metres, which is a real length and is the part a residual will not report.
A turn of the head is not a step sideways
The textbook says a short baseline makes reconstruction ill-conditioned. Measured, the algebra does not notice — a two-millimetre baseline recovers the courtyard to nine digits from exact marks. What fails is the ratio of baseline to reading error, and it fails without refusing.
Where the adjustment stops
Given exact marks the reprojection error falls to a hundredth of a billionth of a pixel, which is arithmetic. Given the same marks read to a whole pixel it falls to a third of a pixel and stays there, and a solver that reached zero on those would be fitting the rounding.
The midpoint is a choice of ruler
Two photographs do not change when the world is measured with a different ruler, so an answer that belongs to the photographs cannot change either. The midpoint of two skew rays does: a threefold stretch moves it 0.203 mm and a projective frame 1.503 mm, while the point that minimises reprojection error stays put to 10⁻¹⁵ m. Both are 15.5 mm from the truth, which is the part a choice of route does not touch.
The eighth held number bends the scene
Four surveyed points, each 10 mm out in a different direction. Hold seven of their coordinates during an adjustment and the courtyard's shape moves by a trillionth of a millimetre; hold eight and it moves by 0.59 mm, because seven numbers choose a frame and the eighth makes a claim the pictures disagree with.
A narrow view keeps a second answer, inside out
Six pictures of a courtyard through a 3° field, every mark exact. Started from the scene turned inside out, the adjustment settles there — near points far, far points near — and misfits the marks by under a pixel. The misfit grows in proportion to the field and to the sweep of the cameras, and vanishes only where perspective does.
A third ray is worth what its picture is worth
Three eyes on one point, two at seven metres and one walked back to seventy. The point nearest all three rays in metres is 132 millimetres from the truth and the point of least reprojection error is 34 — the same 34 the near pair gives alone — and the first is pulled 12 millimetres along the line to the distant eye. And arrangement beats count outright — two rays spread over fifty-five degrees beat eight rays inside four, by a factor of 4.4.
A survey is trusted at its own accuracy, unless its error has a shape
Entered into an adjustment with a stated accuracy, a survey whose errors are random gives the smallest shape error when the stated accuracy is the true one — at 1, 5 and 20 mm alike. Stated twenty times too tight it can cost thirteen times the error; twenty times too loose, almost nothing. But twelve surveys all 10 mm out in fixed directions are best trusted anywhere from 0.3 mm to 10 mm, and the size of their error cannot say which.
A start needs the sign of its depths, not their size
Started part of the way from a courtyard toward its inside-out twin, a bundle adjustment returns to the truth from every start less than 42 per cent of the way — a start with a sixth of the true relief, the right way round — and falls into the twin from every start past 56. Between, neighbouring starts settle in different answers. The band sits in the same place at a 3° field, where the twin misfits by under a pixel, and at 25°, where it misfits by seven and a half.
The cameras decide where a narrow view settles
Scatter a narrow-field bundle adjustment's starting depths and the answer it reaches stops following them: of eighty scattered starts whose depths had the right sign, twenty-six fell into the inside-out twin, and of a hundred with the wrong sign, forty-three came home. Split the start in two and the reason is plain. With the cameras where they are, the courtyard comes home from its own inside-out points; with the cameras on the twin's side, it falls in from the true ones.
A third eye sees the water the pair cannot
A level stereo pair looking at a stick in water gets two rays that meet exactly and a stick 285 mm too short, with nothing to warn it. A third eye raised ten centimetres above the pair sees a disagreement of 2.6 pixels at the stick's tip. Asked to agree with the other two as if there were no water, it hides nearly all of that and makes the stick shorter still. Told only that there is a flat surface, the same three eyes find its refractive index and put the metre back.
Named alongside it
The objects these essays reach for when they reach for this one.
Residualbundle adjustmentTriangulationgauge freedomSimilarityskew raysBaselineConvergenceDepth reversalfield of viewLevenberg–MarquardtOrthographic