Concept

Epipolar geometry — where it appears

The constraint two pictures of one scene place on each other, confining a point's match to a line rather than a region. It is decided by the two cameras alone and knows nothing about the scene, which is why it can be used to constrain a search before anything has been matched.

Named by 14 essays across 6 fields — each of them below, with the objects they name alongside it.

epipoleepipoleleft pictureright pictureepipole from 44 correspondences vs the projected eye: 1.1e-9 px2.60 m between the eyes

The image of the other eye

Two photographs of one courtyard, and in each of them a point that is the other camera. It is computed from forty-four matched marks and nothing else, and it lands on the projection of the other eye to about a billionth of a pixel.

twoviews · Epipole
1234512345a point is chosen hereand must be on this linematch to its own epipolar line: 1.4e-13 px5 of 44 correspondences drawn

A point is a line over there

Knowing where a mark sits in one photograph does not say where it sits in the other. It says which line it is on, which removes one of the two unknowns and leaves one — and the five lines drawn here meet at a point to within a thirtieth of a billionth of a pixel.

twoviews · Epipolar
vertical difference up to 30.8 px, drawn 8× overbaseline 63 mmconvergence 2.0 m

Turning the cameras inwards

A stereo pair made by rotating two cameras toward a common point puts the same world point at different heights in the two pictures — up to thirty pixels here, on a frame of four hundred. Two eyes level with each other see every point at the same height, so a pair with vertical difference is a pair of pictures of no scene at all.

screen · Stereodisplay
the eye the design is forthe cameracorrect from 14 cm, at 160 mm widerecovered to 2.5e-14 m

The wall under the paint

An anamorph's design is a set of rays from a known eye, fixed before any paint is applied — so the marks are a calibration target whose rays are known exactly and whose shape is not. One ordinary photograph supplies the second ray for each mark and the wall comes back at the arithmetic floor, on a dished floor, a ridged one, and a floor with a step in it. What it says between the marks is nothing, by the sagitta.

metrology · Wallrecovery
left pictureright pictureevery one of them fits every mark1.6e-6 px

A flat scene fixes no second eye

Eight marks on one plane leave the eight-point design matrix two ranks short, so a two-parameter family of fundamental matrices satisfies every mark exactly — three of its members are 1.41 apart after normalisation and all three fit to 1.6 × 10⁻⁶ pixels. The same photographs determine the plane's own map from four marks, to 5.9 × 10⁻¹³ pixels.

twoviews · Planar
0306090-3-2-1out-of-plane spread, as a fraction of the scene's own extent (powers of ten)error in the recovered translation direction, in degreeswith 0.3 px of reading errorexact marksthe geometry is a step and the measurement is a slope9 reliefs

How flat is flat enough

With exact marks the transition has no width at all — 84° of pose error at exactly coplanar and 0.000° at eight parts in ten thousand of relief. Put three tenths of a pixel of reading error in and the same sweep becomes a slope three decades wide, crossing into usefulness when the out-of-plane parallax reaches about ten times the marking error.

twoviews · Planar
-2e-7-1e-70-0.800-0.700-0.600-0.500α, the mix of the two nullspace directionsthe determinant that a fundamental matrix must make zeroa cubic with three real roots3 matrices, all exact

Seven marks, three answers

Seven correspondences leave a two-dimensional nullspace, and the requirement that a fundamental matrix be singular is a cubic in the mix — one or three real roots. Here it has three, and all three satisfy every one of the seven marks to 8.9 × 10⁻⁹ pixels. The eighth mark, withheld, separates them by more than an order of magnitude.

twoviews · Eightpoint
020406012345the baseline between the two eyes (metres)angle between the cone axes (°)42.6°two cones, one ballcentre to 9e-7°

Two pictures of a ball

Two outlines give two tangent cones, and where their axes cross is the ball's centre — with the radius following from either half-angle. There is no correspondence problem, because a ball's outline in one picture and its outline in another are guaranteed to be the same ball; and there is a degeneracy, which is the two eyes and the ball in a line, and the solver refuses it rather than returning something plausible.

metrology · Ballrecovery
both explain both photographs exactly11.4 m apart, median

The surface two pictures cannot separate

There is a quadric through both camera centres on which two genuinely different motions draw identical pictures. Built explicitly, forty-two marks satisfy both epipolar geometries to 2 × 10⁻¹³ pixels, and the two scenes they reconstruct place the same mark at 15.6 metres and 35.1. The design matrix's nullspace has two dimensions rather than one, which is the seven-point situation arrived at from the other side.

twoviews · Critical
the lenscorrect from 14 cm, at 160 mm wide12 pairs · 2.8e-13 px

One shutter, two views

A photograph with a mirror in it is a stereo pair, and a peculiarly well-behaved one. Its fundamental matrix is skew-symmetric, so both epipoles are the same point; that point is where the camera would see its own lens; and every line joining a mark to its reflection passes through it, to 1.4 × 10⁻¹² px. The baseline is twice the distance to the glass, which is the one number a single view cannot supply and a tape measure can.

mirrors · Mirrorpair
the second pictureepipole22 parallax lines miss the epipole by at most 1.7e-10 pxsecond camera stepped forward

Two marks off a known plane find the other eye

Map a courtyard's ground from one picture into the other, and every raised mark lands somewhere the map did not send it — displaced along a line through the image of the other camera, to a fifth of a billionth of a pixel. Two such marks put that image where it is, and with it the whole epipolar geometry.

twoviews · Planar
horizonthe pointits shadowcorrect from 22 cm, at 160 mm widerays cross at 28.5° · recovered to 9e-16 m

The lamp is the second eye

One photograph, one lamp whose position is known, and a point's place in space comes back to 9e-16 m — the camera's ray through the point, the lamp's ray through the image of its shadow, and the intersection of two lines. It is triangulation with one of the two eyes replaced by a light, and it degrades exactly like a stereo pair: 5.9 mm of depth per pixel at 39° between the rays, 1 mm at 15.4°.

light · Shadowdepth
the second picture0.650.710.431.421.6122 raised marks, disc size: the coefficient on the epipolek ∝ h/Z to 4e-14

A parallax length is a height over a depth

After a known plane's map, every raised mark's displacement points at the other camera's image, and its length carries the mark's height above the plane over its depth — but not as the ratio of lengths it looks like. That ratio departs from the point's own number by up to 45 per cent. Read as a coefficient on the epipole, the same length gives height over depth from the first camera to four parts in a hundred trillion, the same from every second picture.

twoviews · Planar
horizonthe post, and the post behind the eyecorrect from 14 cm, at 160 mm wideone mark to 6.4e-14 px · off-eye centre 51 px away

The picture contains what is behind the camera

A pinhole maps a direction, and a line has one direction, so a point behind the eye lands on exactly the same mark as its reflection in front — here to 6.4e-14 pixels. The sign the division throws away is why cheirality is a fact supplied from outside the picture rather than measured in it.

foundations · Behind

Named alongside it

The objects these essays reach for when they reach for this one.

Fundamental matrixEpipoleBaselineCorrespondenceHomographyDegenerate configurationParallaxReconstructionreconstruction ambiguityTriangulationConditioningCritical surface

All concepts