The thread: What a second picture adds
The image of the other eye
Two photographs of one courtyard, and in each of them a point that is the other camera. It is computed from forty-four matched marks and nothing else, and it lands on the projection of the other eye to about a billionth of a pixel.
What a pair is forDepth is a reciprocal
Two eyes measure a shift in the picture, and depth is that shift divided into a constant. So a fixed error in what is read maps to an interval in what is reported that is not centred on the answer, and at forty metres runs sixteen metres nearer and eighty-six further.
Many pictures at onceThe track and the scene together
Six photographs go in and one hundred and sixty-eight numbers come out — every camera's position and orientation and every point's place in space, solved for at once. Nothing in the solve was ever told where a camera or a point was.
The second eyeA point is a line over there
Knowing where a mark sits in one photograph does not say where it sits in the other. It says which line it is on, which removes one of the two unknowns and leaves one — and the five lines drawn here meet at a point to within a thirtieth of a billionth of a pixel.
What a pair is forThe range a pair cannot see past
A stereo rig has a distance beyond which it cannot say "no further than", and the distance is fixed before anything is built. It is the focal length times the baseline divided by the reading precision, and for a human pair of eyes it is fifty-eight and a half metres.
The second eyeEight points and the basis they are read in
The linear system that recovers a fundamental matrix is written in whatever coordinates the marks were read in, and pixel coordinates are a bad choice. Centring and scaling them first is worth nothing at a quarter-pixel reading and a factor of thirty at four.
What a pair is forTwo rays that do not meet
Triangulation is described everywhere as the intersection of two rays, and two rays in space do not intersect. Read the same two marks to a whole pixel and they miss by 2.77 mm at seven metres, which is a real length and is the part a residual will not report.
The second projectionTwo pictures on one screen
A stereoscopic display puts a point where two sightlines cross, so the depicted depth is b·D/(b−d) and the disparity that reaches infinity is exactly the separation of the reader's eyes — 63 mm, at any screen distance whatever. The depth budget is set by the width of a head and by nothing about the scene.
The second eyeFour cameras fit, and one of them can see
The essential matrix does not determine a camera pair. It determines four, all of which reproject every correspondence exactly, and the thing that picks one is not more algebra — it is the assumption that the photographer could see what was photographed.
What a pair is forA turn of the head is not a step sideways
The textbook says a short baseline makes reconstruction ill-conditioned. Measured, the algebra does not notice — a two-millimetre baseline recovers the courtyard to nine digits from exact marks. What fails is the ratio of baseline to reading error, and it fails without refusing.
What a pair is forA wrong match is not a small error
Move one correspondence of forty-four by thirty pixels and the recovered geometry is wrong for every other point — the typical one by half a pixel, from a fit that was exact to a part in ten trillion. Least squares has nowhere to put a bad row except across all of them.
Many pictures at onceAnother picture of the same sweep
Going from three views to seven across the same sixty degrees leaves the reconstruction exactly where it started, and at one point makes it worse. What a reconstruction is short of is angular spread, not photographs.
The second eyeTwo views give shape and no size
Every pairwise distance ratio in a courtyard recovered from two photographs matches the real one to fourteen digits. The courtyard's actual size is not merely uncertain — it is absent, and a reconstruction three and a half times larger fits the same two pictures exactly as well.
The second eyeA flat scene fixes no second eye
Eight marks on one plane leave the eight-point design matrix two ranks short, so a two-parameter family of fundamental matrices satisfies every mark exactly — three of its members are 1.41 apart after normalisation and all three fit to 1.6 × 10⁻⁶ pixels. The same photographs determine the plane's own map from four marks, to 5.9 × 10⁻¹³ pixels.
Many pictures at onceFar enough away, a pair is one eye
Hold the baseline and walk the scene away, and the parallax a single homography cannot explain falls as the distance to the power −0.968 — one over the distance, which says the ratio of baseline to depth is the whole of it. The recovered translation direction follows it down, from 3.3° at four metres to 74.5° at two hundred and fifty-six.
What a pair is forThe depth a pair calls zero
Two eyes verged on a point agree — the same coordinate in both pictures — not on a plane at the fixation distance but on a circle through both eyes and that point. Found by bisection along 121 azimuths and fitted rather than assumed, it is a circle to 0.0000 cm; at 26° off centre it lies 23 cm nearer than a flat wall does.
The second eyeHow flat is flat enough
With exact marks the transition has no width at all — 84° of pose error at exactly coplanar and 0.000° at eight parts in ten thousand of relief. Put three tenths of a pixel of reading error in and the same sweep becomes a slope three decades wide, crossing into usefulness when the out-of-plane parallax reaches about ten times the marking error.
What a pair is forThe midpoint is a choice of ruler
Two photographs do not change when the world is measured with a different ruler, so an answer that belongs to the photographs cannot change either. The midpoint of two skew rays does: a threefold stretch moves it 0.203 mm and a projective frame 1.503 mm, while the point that minimises reprojection error stays put to 10⁻¹⁵ m. Both are 15.5 mm from the truth, which is the part a choice of route does not touch.
The second eyeSeven marks, three answers
Seven correspondences leave a two-dimensional nullspace, and the requirement that a fundamental matrix be singular is a cubic in the mix — one or three real roots. Here it has three, and all three satisfy every one of the seven marks to 8.9 × 10⁻⁹ pixels. The eighth mark, withheld, separates them by more than an order of magnitude.
What a pair is forWhole pixels cut space into shells
A disparity read to whole pixels can report only the depths fB/k, so a stereo pair does not measure distance on a scale — it chooses among 113 shells between half a metre and twelve, 6.7 cm apart at two metres and 1.39 m apart at ten. A level floor comes back as 35 standing plates. And a finer step and a better reading are different purchases: at a quarter pixel with a quarter pixel of matcher error the pair prints 449 depths and can tell 149 apart.
Measuring from one pictureTwo pictures of a ball
Two outlines give two tangent cones, and where their axes cross is the ball's centre — with the radius following from either half-angle. There is no correspondence problem, because a ball's outline in one picture and its outline in another are guaranteed to be the same ball; and there is a degeneracy, which is the two eyes and the ball in a line, and the solver refuses it rather than returning something plausible.
The second eyeThe surface two pictures cannot separate
There is a quadric through both camera centres on which two genuinely different motions draw identical pictures. Built explicitly, forty-two marks satisfy both epipolar geometries to 2 × 10⁻¹³ pixels, and the two scenes they reconstruct place the same mark at 15.6 metres and 35.1. The design matrix's nullspace has two dimensions rather than one, which is the seven-point situation arrived at from the other side.
Mirrors that are not camerasOne shutter, two views
A photograph with a mirror in it is a stereo pair, and a peculiarly well-behaved one. Its fundamental matrix is skew-symmetric, so both epipoles are the same point; that point is where the camera would see its own lens; and every line joining a mark to its reflection passes through it, to 1.4 × 10⁻¹² px. The baseline is twice the distance to the glass, which is the one number a single view cannot supply and a tape measure can.
What a pair is forBoth coordinates agree on a circle and a line
Two eyes fixating a point straight ahead see their horizontal image coordinates agree on a whole vertical cylinder over the Vieth–Müller circle, the same radius at every height to the last bit. Their vertical coordinates agree on almost none of it — 7.35 px apart at 26° aside and 30 cm up, 29.26 px when the fixation is brought to 60 cm. The points where both agree are the circle and one vertical line, and the line is the axis of the motion that carries one eye onto the other.