The collection

Every essay — page 5

Page 5 of 22, continuing through the fields in the same order.

What survives Constructing a view Where to stand Surfaces that are not flat The other systems Light and mirrors Mirrors that are not cameras Measuring from one picture Through water and glass The real instrument The second eye What a pair is for Many pictures at once The eye that moves Systems that kept the measure What each system gave up What a machine computes The rectangle behind the lens The second projection Drawn confidently

Surfaces that are not flat

A cylinder, a sphere, a fisheye. Every one of them is computed here rather than described, and every one is measured on the three things a picture surface can do to the world: bend its straight lines, turn its right angles, and change its scale. No surface escapes all three.

0204060204060frames in the panoramadistance from the pivot (mm)π/β = 9.5across the seamup the framepivot 60 mm · frame 38° tallfloor 19.53 mm

The parallax you cannot shoot away

A stitched panorama's parallax has two halves and they do not behave alike. The one across the seam falls as the sine of half a frame spacing, so more frames buy it off; the one up the frame is the sine of half the frame's own height, and no quantity of shooting touches it. They cross at π over β, which has no pivot error in it at all.

8 figures
the pupil, and the pivotsubject at 34°the filmcorrect from 15 cm, at 160 mm wideagrees with the cylinder to 1.1e-16

The camera that is a cylinder

A swing-lens camera turns its lens about its own entrance pupil and sweeps a slit across film bent into a circle concentric with it. Compute where the light lands, unroll the film, undo the pinhole's inversion, and the result is not similar to the cylindrical picture surface — it is the same map, to the arithmetic floor. What it pays instead is detail, and a shear on anything that moves.

8 figures
-500500.5001distance to the thing being stitched (log₁₀ metres)what the stitch leaves behind (px)2.86 m80 mm baselinezero at one depth each

A rig is right on one surface

Several cameras looking outward have several centres, and no warp registers all of a scene. The residual is a disparity, so the depth the stitch is computed for has an exact optimum — the harmonic midpoint of the depth range, not the middle of it — and the arithmetic middle costs a factor of 2 z_far over the sum, which tends to two.

8 figures
the centre of curvature, 4.0 mthe sitting distance, 2.6 mno single viewpoint — the rays miss by nothing — this is a plan of a room319′ out where people sit

Drawn for the cylinder, shown on the cylinder

Four essays in this collection have named the arrangement where a picture's surface and a screen's surface are the same surface, and none has run it. It is exact — a tenth of a millionth of an arcminute — and the exactness is not the finding. Three separate things have to be true at once, and a curved television's own maker prints a sitting distance where the first of them is out by five degrees.

9 figures
01002000.80011.20the condition, as a fraction of what makes the picture exacthow far a mark is from where it was drawn to be seen, in arcminutesthe seatthe horizontal scalethe vertical lawcurved television, one condition at a timeall three linear

Three conditions, and three prices

A matched picture needs the seat, the horizontal scale and the vertical law all at once. Each is broken alone here with the other two held, and all three turn out to be linear in the mismatch — the unforgiving case, with no margin at all. The vertical law costs a third of an arcminute on a television and eighty-four on a dome, because it is the difference between an angle and its tangent and that difference is cubic in the picture's vertical field.

8 figures
cylinderexactequirectangular0.18′equidistant fisheye0.73′equal-area fisheye0.82′stereographic0.99′flat plane1.79′curved television, from its matched seateach surface fitted to it

The surface a screen wants

Six picture surfaces laid on one screen and viewed from the seat its curvature names, each with its own extents fitted so the ranking is about shape rather than scale. Each screen's own surface is exactly right on it and nothing else is — and on a curved television the runner-up is a fifth of an arcminute behind, which nobody can see.

8 figures
flat panel1.000×exact at its seatcurved television1.000×exact at its seatcurved monitor1.000×exact at its seatcinema screen1.000×exact at its seatdome1.180×exact at its seatthe stretch of laying the picture downbefore anybody sits

A picture that can be printed

Two screens are fed the surface that is exactly right for each, so nothing about the viewer is left in the answer. What remains is whether the picture can be made flat before it goes up — and a cylinder unrolls while a sphere does not, so the dome's picture is stretched by eighteen per cent between its middle and its rim before anybody sits down.

7 figures
plane — ×24.99 edge to centrecylinder — ×2.40 edge to centrestereographic — ×2.22 edge to centreequidistant — ×1.30 edge to centreequal-area — ×1.00 edge to centreequirect. — ×1.34 edge to centre36 cells of 377 square degrees, out to 70°equal-area ×1.00 · plane ×25.0

Where a surface spends its pixels

A picture surface is a budget before it is anything else, and the six named ones distribute the same marks over the same directions quite differently. The flat plane lays 25.0 times as many on a square degree at the edge of a 70° field as on one at the centre; the equal-area fisheye is flat to 8.3e-6 per cent.

7 figures
plane — line, 5e-18cylinder — sinusoid, 6e-17stereographic — circle, 6e-16equidistant — circle, 9e-4equal-area — circle, 2e-3equirect. — sinusoid, 1e-4tilted 10°, sampled over 140° of azimuththe horizon swings ±10°

The horizon's shape belongs to the surface

The horizon is one great circle of directions whatever draws it, and at zero tilt all six named surfaces draw it straight. Tilt the camera and they separate — and the cylinder, not the equirectangular surface, is the one whose horizon is exactly a cosine, to 9e-16 against 8.3e-3.

7 figures
one direction — the pole — drawn as the whole of this edge8° cap at the pole: ×9.2the same cap, 20° off axis: ×0.646both caps hold 201 square degrees of sky×14 between them

A pole is a line

An equirectangular surface sends one direction to a whole edge, so an 8° cap of sky at the pole takes 4.50 per cent of the marks against a 0.49 per cent share of the world. The worst singularity is not the pole at all — the equidistant fisheye's antipode costs ×17.9 — and only the cube map, which never holds a sphere in one chart, is bounded.

5 figures
42.0°27.3°13.5°13.5°27.3°42.0°leftfrontrightbackupdownmidpoint: 0°7 straight lines, at 60° to the seamworst 42.04° · midpoint 0°

The kink at a seam

A cube map is six flat pictures, so every great circle is drawn exactly straight inside a face — to 3e-15 of its chord — and breaks at the join. The break is a kink and not a bend, it is exactly zero at a seam's midpoint whatever the slant, and it is bounded by 2·atan(½) = 53.130° at the corner.

6 figures
02401020304050degrees off the optical axis, inside the reprojected framemarks the target wants, per mark the source laid downone mark for one mark×5.49 at the edge68% of the source unusedcorrect from 6.7 cm at 160 mm wide

Shot on one surface, shown on another

Two picture surfaces are two charts of the same pencil of rays, so a reprojection between them is a change of coordinates and loses no geometry at all — bit-exact at all 408 sampled directions. What it costs lies elsewhere — 70 per cent of the source has nowhere to go, and the target wants ×5.49 the marks at its edge.

7 figures
00.2500.5000.7501020406080angle off the optical axis (degrees)image radius, against the radius the same lens gives at 90°equidistantequal-areastereographicorthographicflat planeeach curve divided by its own radius at 90°54.0% apart at 45°

Which rule a fisheye obeys, from straightness alone

Four candidate rules for a fisheye lens part by 54.0 per cent at 45° off axis, and a plumb-line fit shown no scene, no camera and no calibration target can still name which one took a photograph — reliably from about 45° of half-field. Below that the four are indistinguishable in the marks, and naming one collapses to guessing.

6 figures
051015200204060how far off the fovea the line passes (degrees)departure from a straight chord, in degrees of visual angleschematic eyeconcentric retinaa line spanning ±65° of azimuth17.30° at 40° eccentricity

The eye is a picture surface too

A retinal sphere behind an off-centre nodal point takes every measurement this collection puts to a lens or a screen, and answers all of them. It is the equal-area fisheye to within 110 micrometres of retina rather than the equidistant one everybody draws it as, and a flat picture at its own correct distance leaves the identical arc on it, to 1.4e-14 degrees.

7 figures
five points · worst 2.10 px5 straight lines, drawn as arcs between their vanishing pointsworst 2.10 px at 40° of tilt

The arcs the five-point construction actually draws

The taught five-point construction draws circular arcs between five vanishing points and instructs a draughtsman to graduate the radius evenly. Read that way, the arcs miss a straight line's true image by up to 3.75 pixels on a 300-pixel disc. Read at the stereographic scale instead, the same arcs are exact to 4.3e-13 pixels — the construction was always drawing one projection, and the taught scale was never it.

7 figures
column 62 mmcorrect from 19 cm, at 160 mm wide0.966% hidden, to 15.3° from the nadir

The hole a rig cannot fill

A two-lens spherical rig covers every direction between its two lenses and still cannot see 0.470 per cent of the sphere directly beneath it, reaching 12.8 degrees from straight down — its own tripod, standing exactly where neither lens can look. No arrangement of lenses removes it, because it is not a gap in coverage; it is the rig occluding itself.

7 figures
projectorthe seatcorrect from 19 cm, at 160 mm wide23.6° worst

A projector that is not at the dome's centre

A projector 0.40 of a dome's radius off centre puts its own picture up to 23.6 degrees from where it belongs, and the pre-warp that corrects it is exact for one seat and only one. Two metres from that seat costs 11.5 degrees of the same displacement, wherever the projector itself stands — because the correction never knew where the projector was in the first place.

7 figures

What a pair is for

Depth from two views is a reciprocal, so a fixed error in what is read maps to an interval that is not symmetric and eventually is not bounded. What a stereo pair can and cannot measure, computed rather than described, including the range past which one pixel reaches infinity.

025507510010203040true depth (m)depth reported from the disparity, with a 1 px reading error5.86–7.33 m13.96–26.69 m23.76–126.49 mat 40 m: +86.5 m against −16.2 munbounded past 58.5 m

Depth is a reciprocal

Two eyes measure a shift in the picture, and depth is that shift divided into a constant. So a fixed error in what is read maps to an interval in what is reported that is not centred on the answer, and at forty metres runs sixteen metres nearer and eighty-six further.

8 figures
123-2-10baseline (m, log scale)range past which 1 px of disparity error is unbounded (m, log scale)65 mm → 58.5 mrange = fB/δ — 58.5 m at a 65 mm baseline900 px focal length, 1 px reading

The range a pair cannot see past

A stereo rig has a distance beyond which it cannot say "no further than", and the distance is fixed before anything is built. It is the focal length times the baseline divided by the reading precision, and for a human pair of eyes it is fifty-eight and a half metres.

8 figures
midpoint — 2.77 mm gapfrom the left eyefrom the right eyegap 2.77 mm at 7.22 mexact marks: 2.2e-16 m

Two rays that do not meet

Triangulation is described everywhere as the intersection of two rays, and two rays in space do not intersect. Read the same two marks to a whole pixel and they miss by 2.77 mm at seven metres, which is a real length and is the part a residual will not report.

6 figures
-10-50-2-10baseline (m, log scale)worst deviation in the recovered shape (log scale)exact pointsread to 1 pxat 2 mm: 4.7e-9 exact, 2.9e+1 read to 1 px6e+9× apart

A turn of the head is not a step sideways

The textbook says a short baseline makes reconstruction ill-conditioned. Measured, the algebra does not notice — a two-millimetre baseline recovers the courtyard to nine digits from exact marks. What fails is the ratio of baseline to reading error, and it fails without refusing.

5 figures
00.50011.50010203040correspondenceepipolar error at every OTHER point, after one match is movedmedian 0.54 pxthe moved oneevery point wrong: median 0.54 px, worst 1.7 pxclean fit 2.3e-13 px

A wrong match is not a small error

Move one correspondence of forty-four by thirty pixels and the recovered geometry is wrong for every other point — the typical one by half a pixel, from a fit that was exact to a part in ten trillion. Least squares has nowhere to put a bad row except across all of them.

8 figures
in units of the 1.20 m fixation distance0.0000 cm over 121 azimuths

The depth a pair calls zero

Two eyes verged on a point agree — the same coordinate in both pictures — not on a plane at the fixation distance but on a circle through both eyes and that point. Found by bisection along 121 azimuths and fitted rather than assumed, it is a circle to 0.0000 cm; at 26° off centre it lies 23 cm nearer than a flat wall does.

7 figures
the needle: along the rays' bisectorreprojection minimum, both framesmidpoint, world framemidpoint, changed framemidpoint moved 0.203 mm · minimum moved 1.0e-15 mtruth 15.5 mm along the needle

The midpoint is a choice of ruler

Two photographs do not change when the world is measured with a different ruler, so an answer that belongs to the photographs cannot change either. The midpoint of two skew rays does: a threefold stretch moves it 0.203 mm and a projective frame 1.503 mm, while the point that minimises reprojection error stays put to 10⁻¹⁵ m. Both are 15.5 mm from the truth, which is the part a choice of route does not touch.

6 figures