Field

The second eye

One picture fixes a ray; two fix a point. Everything a pair of pictures determines about the eyes that made them — the image of one eye in the other's picture, the line a match must lie on, and the camera pose recovered from correspondences alone — with the recovery never shown a camera.
epipoleepipoleleft pictureright pictureepipole from 44 correspondences vs the projected eye: 1.1e-9 px2.60 m between the eyes

The image of the other eye

Two photographs of one courtyard, and in each of them a point that is the other camera. It is computed from forty-four matched marks and nothing else, and it lands on the projection of the other eye to about a billionth of a pixel.

1234512345a point is chosen hereand must be on this linematch to its own epipolar line: 1.4e-13 px5 of 44 correspondences drawn

A point is a line over there

Knowing where a mark sits in one photograph does not say where it sits in the other. It says which line it is on, which removes one of the two unknowns and leaves one — and the five lines drawn here meet at a point to within a thirtieth of a billionth of a pixel.

-1012-0.500-0.25000.2500.500how finely each point is read off the picture (px, log scale)worst epipolar error against the exact geometry (px, log scale)raw pixelscentred and scaled1.1× apart at 0.25 px, 29.9× at 4 pxspread 102 against 2.5e+5

Eight points and the basis they are read in

The linear system that recovers a fundamental matrix is written in whatever coordinates the marks were read in, and pixel coordinates are a bad choice. Centring and scaling them first is worth nothing at a quarter-pixel reading and a factor of thirty at four.

points in front of both camerasR₁, t0 of 44180° from the truthR₁, t reversed0 of 44180° from the truthR₂, t44 of 44chosenR₂, t reversed0 of 44180° from the truththe chosen pose is the true one to 0.0e+0°cheirality, not algebra, picks it

Four cameras fit, and one of them can see

The essential matrix does not determine a camera pair. It determines four, all of which reproject every correspondence exactly, and the thing that picks one is not more algebra — it is the assumption that the photographer could see what was photographed.

as recovered0.308 across× 3.4 — same two pictures1.046 acrossworst ratio deviation 6.3e-14size fixed only by a supplied 0.80 m

Two views give shape and no size

Every pairwise distance ratio in a courtyard recovered from two photographs matches the real one to fourteen digits. The courtyard's actual size is not merely uncertain — it is absent, and a reconstruction three and a half times larger fits the same two pictures exactly as well.

All essays