Parallax — where it appears
Named by 30 essays across 11 fields — each of them below, with the objects they name alongside it.
A turn of the head is not a step sideways
The textbook says a short baseline makes reconstruction ill-conditioned. Measured, the algebra does not notice — a two-millimetre baseline recovers the courtyard to nine digits from exact marks. What fails is the ratio of baseline to reading error, and it fails without refusing.
The eye is a place, not a point
Rotate a camera about the wrong point and the sky still stitches perfectly while the foreground slides. The misregistration falls as one over the distance, exactly — which is what says the fault is the pivot and not the lens.
The port that is not there
A flat window into water costs a lens a third of its field. A sphere centred on the entrance pupil costs nothing at all — not nearly nothing, exactly nothing — and six millimetres off centre costs 0.635°.
Turning the cameras inwards
A stereo pair made by rotating two cameras toward a common point puts the same world point at different heights in the two pictures — up to thirty pixels here, on a frame of four hundred. Two eyes level with each other see every point at the same height, so a pair with vertical difference is a pair of pictures of no scene at all.
A picture with two eyes in it
Several traditions draw the floor from one place and the people on it from another. No single camera produces both, as an earlier essay showed. What such a picture actually is has a measurement attached: give the rays their world points and ask for the one place they all pass through, and at a stride of separation the best answer misses them by six tenths of a metre.
Far enough away, a pair is one eye
Hold the baseline and walk the scene away, and the parallax a single homography cannot explain falls as the distance to the power −0.968 — one over the distance, which says the ratio of baseline to depth is the whole of it. The recovered translation direction follows it down, from 3.3° at four metres to 74.5° at two hundred and fifty-six.
The plane is a choice
A projection has a centre and a surface, and they move independently. Keep the eye and turn the picture plane and every point of any scene lands where one 3×3 matrix says, to 2.5e-13 px. Move the eye instead and the matrix fitted to four points is exact at those four and out by 32.0 px everywhere else. The first is a homography of the picture; the second is parallax, and nothing about the picture can undo it.
How flat is flat enough
With exact marks the transition has no width at all — 84° of pose error at exactly coplanar and 0.000° at eight parts in ten thousand of relief. Put three tenths of a pixel of reading error in and the same sweep becomes a slope three decades wide, crossing into usefulness when the out-of-plane parallax reaches about ten times the marking error.
The hole a scene actually sees
The stop is not the centre of projection. Model a 50 mm lens with its stop 18 mm behind the glass and the chief rays from every object distance cross the axis at one point 28.1 mm on the other side of the lens — 10.1 mm from the stop and 1.56 times its size — to 3.6 × 10⁻¹⁵ mm. That point is the entrance pupil, and it is where a picture is a projection from.
The entrance pupil walks with the angle
The place a picture is a projection from is not a point in a wide-angle design. Chief rays traced through a strongly curved front element cross the axis 15.07 mm behind its front vertex when they are nearly on the axis, and 4.23 mm nearer the front at 80° of field. So no pivot makes a wide panorama seam clean: at one metre, pivoting at the paraxial pupil leaves 4.39 arcminutes of misregistration along a seam, and the best pivot still leaves 1.41.
Two marks off a known plane find the other eye
Map a courtyard's ground from one picture into the other, and every raised mark lands somewhere the map did not send it — displaced along a line through the image of the other camera, to a fifth of a billionth of a pixel. Two such marks put that image where it is, and with it the whole epipolar geometry.
A set cut for one eye
Build a colonnade four metres deep and cut every column so that its picture is the picture of one eighteen metres deep. The taper is forced rather than chosen — height and width both scale as the real depth over the intended one — and the match from the design eye is exact to sixteen decimal places. What gives it away is the second eye, and not by the ratio anybody would predict.
An epipole in the picture leaves a blind disc
Step a camera half a metre straight forward and the image of the other eye sits in the middle of both pictures. Around it lies a disc where one pixel of reading costs a tenth of the depth or more — 20 px across a surface 2 m off, 247 px at 16 m — and at its centre no depth is recovered at any range.
A turning frame can be straightened; a travelling one cannot
Read a frame row by row while the camera turns at a radian a second and every point is 21 px from where a global shutter would put it, at every depth alike. Turn each row's rays back and every point returns to six trillionths of a pixel, with no depth known. Travel at 3 m/s instead, and the best correction that needs no depth is exact at one distance and 21 px wrong at 2 m.
Turning and travelling blur different worlds
A subject 8 m away crosses the frame at 4 m/s, and the camera keeps it sharp over a thirtieth of a second. Turn to follow it and every still thing blurs by the same 13.5 px, whatever its depth. Travel beside it and the still world blurs as one over its depth — 49 px at 2 m, 1.5 px at 64 m — while everything moving with the subject is sharp at every depth.
Focusing moves the pivot past its best place
Focusing a fifty-millimetre lens to one metre carries its entrance pupil 2.63 millimetres forward of the camera body, and to half a metre 5.56 — which is more than the whole 5.53 that the pupil walks with field angle, so past a subject at 502 millimetres the focus decides where the pupil is. A panorama head aligned at infinity and used at a metre leaves 7.46 arcminutes along its seam; aligned at four metres it leaves 2.21, better than pivoting at the pupil at all.
The pivot that is not the eye
A camera bolted to a tripod turns about the screw under its baseplate, and the light crosses somewhere else. Every ray of the panorama that results passes the pivot by e sin γ — the offset times the sine of how far off its own frame's axis the ray points — so the picture has a radius where a projection would have a point.
A camera on a bend is sharp on a circle
A camera car rounding a 50 m bend at 10 m/s, aimed into the bend, blurs the still world everywhere except at the bend's centre — and under a pixel from 42 m to 63 m along its axis. Off the axis the sharp place comes nearer as the cosine of the bearing, on the circle through the camera and the centre. Above the ground only the vertical line through the centre stays sharp. Aimed along the road, the camera has no sharp distance at all.
A parallax length is a height over a depth
After a known plane's map, every raised mark's displacement points at the other camera's image, and its length carries the mark's height above the plane over its depth — but not as the ratio of lengths it looks like. That ratio departs from the point's own number by up to 45 per cent. Read as a coefficient on the epipole, the same length gives height over depth from the first camera to four parts in a hundred trillion, the same from every second picture.
The parallax you cannot shoot away
A stitched panorama's parallax has two halves and they do not behave alike. The one across the seam falls as the sine of half a frame spacing, so more frames buy it off; the one up the frame is the sine of half the frame's own height, and no quantity of shooting touches it. They cross at π over β, which has no pivot error in it at all.
A sway gives the blind centre a depth, not a good one
A camera driving straight forward cannot see how far away the thing it is driving toward is: the mark at the epipole does not move between pictures. Let one of three pictures sway sideways and the centre gets a depth at once — but a depth resting on the sway alone, which a pixel of reading moves by the focal length's reciprocal times the depth over the sway. For a centimetre of steering wobble at eight metres that is 144 per cent; for a tenth of the forward step, 29. The hole closes; the disc around it stays until the sway is a third of the step.
The camera that is a cylinder
A swing-lens camera turns its lens about its own entrance pupil and sweeps a slit across film bent into a circle concentric with it. Compute where the light lands, unroll the film, undo the pinhole's inversion, and the result is not similar to the cylindrical picture surface — it is the same map, to the arithmetic floor. What it pays instead is detail, and a shear on anything that moves.
A plane's coefficient reaches as far as its parallax
After a known plane's map, every raised point's displacement is its height over its depth, read as a coefficient on the epipole — exactly, for any point either picture sees. The worry was that the number would be local, good only near the floor whose marks fixed the map. Read to a pixel, it is not a distance on the floor that runs out. It is a length in the picture: the point's error is about 260 per cent over its parallax in pixels, wherever the point stands.
A frame's shear knows travel only over depth
Read a frame row by row while the camera turns and travels, and every vertical post leans — the near ones more. The lean is the turn plus the travel over the post's depth, and that sum is all the frame holds: twice the travel past posts twice as far draws the same frame to eighteen decimal places. Two posts cannot separate turn from travel. A facade can, because a turn leans the edges of the frame more than its middle, but the two signals are 99.8 per cent alike, and reading them apart takes a pixel on every row.
A rig is right on one surface
Several cameras looking outward have several centres, and no warp registers all of a scene. The residual is a disparity, so the depth the stitch is computed for has an exact optimum — the harmonic midpoint of the depth range, not the middle of it — and the arithmetic middle costs a factor of 2 z_far over the sum, which tends to two.
A refocused panorama is six lenses
Refocus between the frames of a room panorama and each frame is its own camera: its pupil carried forward by its own extension, its picture made at its own principal distance. The best fixed pivot then leaves 12.9 arcminutes along the worst seam, and a head that slides the camera back as the lens extends leaves 2.82 — the lens's walk alone. The pivot's share is first order and worth a tracking head indoors. But a stitcher that reads all six frames with one focal length misregisters by up to 270 arcminutes, which is the larger mistake by ninety times.
A rolling frame on a bend is right at its centre
Read a camera car's frame row by row as it rounds a bend and every still point moves — except the bend's centre, at every height, and the horizon row, at every depth. Each mark's displacement is its streak scaled by its row time, so the rolling frame is undistorted wherever the global one is sharp. And the usual repair makes it worse: a gyroscope that undoes the turn row by row puts 0.73 px back into the centre and is a net loss everywhere nearer than twice the bend's radius.
One focus stopped down is as sharp as six in a deep room
Refocusing a room panorama frame by frame costs a seam of 12.9 arcminutes on a fixed head. One focus stopped down costs none of that, and at f/40 holds half a metre to four metres to 5.27 arcminutes — sharper than the fixed head's seam, blunter than a tracking head's 2.82. But the comparison flatters refocusing: the frame on the table also holds the wall behind it, so it cannot be held sharper than 5.27 however it is focused. Counted properly, one focus on a plain head comes within 2.4 per cent of the geared one, and pays for it in light.
A rolling frame on a bend is a coarse curvature gauge
Read row by row on a bend, a frame leans every vertical by an amount proportional to one over its range less one over the bend's radius, so posts at several ranges lie on a straight line that crosses zero at the radius — exactly, to a thousandth of a metre. Off the axis the zero moves to R·cos of the bearing, the circle on which a camera on a bend is sharp. As a gauge it is coarse: one frame's eight posts read a 50 m bend as 45 m (35–74) with tops placed to half a pixel, and sixteen frames as 51 m (47–55). The slower the sensor reads, the better it measures the road.
The hole a rig cannot fill
A two-lens spherical rig covers every direction between its two lenses and still cannot see 0.470 per cent of the sphere directly beneath it, reaching 12.8 degrees from straight down — its own tripod, standing exactly where neither lens can look. No arrangement of lenses removes it, because it is not a gap in coverage; it is the rig occluding itself.
Named alongside it
The objects these essays reach for when they reach for this one.
centre of projectionEntrance pupilinstrument limitPanoramaHomographyStitchingBaselineDemonstrationEpipoleMoving viewpointConditioningDisparity