What a pair is for

The scale names the mistake when the camera has lost its place along the wall

A third camera that knows how far it has paced towards a facade, and nothing about where along or up the wall it stands, still names a stereo pair's column mistake from one picture. Any offset at all refutes the honest reading, which predicts none from anywhere; and once the unknown place is fitted away as one uniform slide, what is left is the rebuilt facade's scale, which each mistake predicts differently. Five centimetres towards the wall names the mistake 95 times in 100 at half a pixel, ten centimetres every time — where a camera that believes it knows its place and is 20 cm out manages 77. The distance has to be paced, though: a rangefinder or the windows' known spacing would have named the mistake by themselves.

Worth reading first: A wrong match is not a small error · Two rays that do not meet.

A turn at the landing makes the mistake a scale followed a third camera up an outside stair beside a facade of identical windows, which a level stereo pair had matched some columns out and so rebuilt nearer than the wall. On a flight along the wall every rebuilt window slides through the camera’s picture by one shared amount; on a flight towards the wall the rebuilt facade’s picture becomes the real one’s scaled about the focus of expansion — the point the camera walks towards — by a factor each mistake sets differently. The scale is weak evidence, a fifth of what a step along the wall buys. But it has a property the slide does not: it depends only on how far the camera has come towards the wall, not on where along or up the wall it stands.

Every reading in that essay knew where the camera was, up to an error along one flight. It closed by asking what happens to a camera that knows its distance towards the wall and has lost the rest — a photographer who climbed a first flight they did not count, reached a landing they cannot place, and then paced the second flight towards the building. The slide is useless to such a camera, since every slide is a guess at its own place. Is the scale enough?

An unknown place is one uniform offset

The facade is the one of the earlier essays: five columns of windows 2.4 m apart, three storeys of 3 m, twenty metres off, faced squarely by a pair 1.1 m apart with a focal length of 900 px. A kk-column mistake rebuilds each window on the left eye’s ray through it at the depth ratio ρ\rho — 0.314 for one column out, 0.186 for two — so its rebuilt facade stands 6.3 m or 3.7 m from the pair.

A third camera moved by (Tx,Ty,Tz)(T_x, T_y, T_z) from the left eye draws a real window at xx and its rebuilt copy at x′=e+s (x−e)x' = e + s\,(x - e), with the scale s=ρ(Z−Tz)/(ρZ−Tz)s = \rho(Z - T_z)/(\rho Z - T_z) and ee the focus of expansion, c+f (Tx,−Ty)/Tzc + f\,(T_x, -T_y)/T_z. A matcher sees the offset x′−x=(s−1) x−(s−1) ex' - x = (s - 1)\,x - (s - 1)\,e, wrapped to the nearest real window — and the second term is the same for every window. Whatever the camera does not know about where along and up the wall it stands enters the picture as one uniform offset, two numbers, and two numbers can be fitted.

0.4 m towards the wall from a landing whose place along the wall is lost, the 1-column reading's offsets are one slide of 54 px, which refutes the honest reading and says nothing of which mistake, plus a scale of 0.047, which names it: with the slide fitted away the true reading leaves nothing and the two-column reading 8.5 pxA third camera that climbed a first flight it has lost track of to a landing, then paced 0.4 m level towards the facade, facing it squarely. Left: the offsets a matcher sees between each rebuilt window of the pair's 1-column reading and the real window it lands on, drawn at the real window's place in a reduced picture, at half size — very nearly one shared slide of 39.8 px across and 36.6 px down. The slide is set by where along and up the wall the camera stands, which it does not know, so its size says nothing about which mistake was made; but the honest reading predicts no offset at all from anywhere, so any slide that is not a whole number of columns and storeys refutes it. Right: the same offsets with the best uniform offset removed, magnified 4 times. What is left is the rebuilt facade's picture scaled by 1.0466 against the real one's, a pattern spreading from the facade's middle, and it depends only on how far the camera has paced towards the wall. Each mistake predicts its own spread, (s − 1) times each window's distance from the middle; with the slide fitted freely, the root-mean-square misfit of each reading to these offsets is honest 54.64 px, 1 out 0.00 px, 2 out 8.53 px, 3 out 17.95 px, 4 out 28.38 px — the honest reading's being the slide it cannot fit.the offsets a matcher sees, ×½with one slide removed, ×4misfit with the slide fitted: 1 out 0.0 px · 2 out 8.5 px · 3 out 17.9 px · honest 55 px, no slide to fitsquares: real windows, reduced1 column out · 0.4 m towards the wall
Fig. 1 The offsets a matcher sees in one picture 0.4 m towards the wall, for a pair that matched one column out, and the same offsets with the best uniform offset removed and magnified; below, how far each reading misfits once its own uniform offset is fitted.

On the left, every rebuilt window is offset from the real window it lands on by very nearly the same 54 px: a slide, set by where the camera happens to stand. Remove the best uniform offset and what is left, on the right, is a spray of short arrows pointing away from the facade’s middle — the rebuilt facade’s picture scaled by 1.047 against the real one’s. That pattern depends only on how far the camera has come towards the wall. Each mistake predicts its own: the one-column reading scales by 1.047 at this distance, the two-column by 1.098, the three-column by 1.154. With each candidate’s uniform offset fitted freely, the one-column reading leaves nothing, the two-column 8.5 px of misfit, the three-column 18.

The honest reading is different in kind. It has no scale — its rebuilt facade is the facade — and so it predicts no offset at all, from any camera anywhere. It has nothing to fit. Any slide that is not a whole number of columns and storeys refutes it outright, which here is the 55 px of misfit it cannot remove.

Two questions the slide answered at once

That splits what the straight stair’s slide used to answer into two questions, and the camera that has lost its place can still answer both, by different means.

Is the reading honest? Any offset says no. The slide is 98 px a metre for the one-column reading along the wall, and wherever the camera stands it is very rarely a whole lattice step. On the earlier essays’ straight stairs, the places where it was — the blind places — were where every window agreed with the honest reading at once. A camera that does not know where it stands cannot know whether it is at one, but it does not need to: if its picture shows no offset anywhere, it is either honest or at a blind place, and the scale decides between them.

Which mistake? That is what the slide’s size used to say, through the camera’s known position, and it is what an unknown position takes away. The scale says it instead.

How far towards the wall the scale has to come

Where the slide happens to vanish, only the scale separates a mistake from the honest reading, and that is the worst case.

Where the slide happens to be a whole number of columns and storeys, only the scale is left to tell a mistake from the honest reading: 2.2, 4.4, 6.7, 9.0 px at 10 cm for readings one to four columns out, growing in proportion to the distance pacedFor each reading one to four columns out, the root-mean-square size of the part of its offsets that an unknown focus of expansion cannot absorb: (s − 1) times the windows' spread about the facade's middle in the picture, 188 px across all fifteen windows. That is how far each reading sits from the honest one, which predicts no offset at all, in a picture taken where the slide happens to be a whole number of columns and storeys — the blind places of a straight stair, which a camera that does not know where it stands cannot know it is at. Readings one to four columns out: 2.18, 4.41, 6.69, 9.02 px at 10 cm; the lines run in proportion to the distance paced, from a centimetre to 1.5 m. The dashed lines are reading errors of half a pixel and two pixels: a reading is told from the honest one from a single picture about where its line crosses the error, and from its neighbours where the gaps between lines do. The nearer rebuilt facades grow faster, so the one-column reading — the commonest mistake and the farthest rebuilt facade — is the last to separate.0.010.11110100how far the camera has paced towards the wall, metreswhat the scale leaves once the slide is fitted, px (RMS over windows)1 column out2 columns out3 columns out4 columns outdashed: reading errors of 0.5 and 2 pxthe slide fitted away
Fig. 2 What each mistake’s scale leaves against the honest reading, in a picture where the slide happens to be a whole lattice step, against how far the camera has paced towards the wall; dashed, reading errors of half a pixel and two pixels.

The part of a reading’s offsets that an unknown focus cannot absorb is (s−1)(s - 1) times the windows’ spread about the facade’s middle, 188 px across the fifteen windows. Ten centimetres towards the wall, that is 2.2 px for the one-column reading, 4.4 for the two-column, 6.7 and 9.0 for the three- and four-column. It grows in proportion to the distance paced, because s−1s - 1 does: (1−ρ) Tz/(ρZ−Tz)(1 - \rho)\,T_z/(\rho Z - T_z) is very nearly Tz/ρZT_z/\rho Z times (1−ρ)(1 - \rho) while the walk is short against the rebuilt facade’s distance. The one-column reading, the commonest mistake, has the farthest rebuilt facade and the slowest scale, and it crosses a half-pixel reading error at about two and a half centimetres and a two-pixel error at about nine.

One picture with the focus free

Over many pictures — a first flight of unknown pitch, 10° to 50°, and unknown length, 0.6 to 1.2 m, then a level pace of a stated distance towards the wall, forty pictures for the honest reading and for each of the four nearer mistakes, the interior windows only — the question is how often one picture names the mistake made.

With the focus of expansion fitted freely, one picture names the mistake 95% of the time 5 cm towards the wall and 100% at 10 cm, read to half a pixel — where a camera that believes itself 20 cm out along the wall names it 77%Single pictures from a camera that climbed a first flight of unknown pitch and length — 10° to 50°, 0.6 to 1.2 m — to a landing and then paced level towards the facade by 0.02, 0.05, 0.1, 0.2, 0.4, 0.8, 1.5 m, facing it squarely. Forty pictures a mistake for the honest reading and each of the four nearer mistakes, the interior windows only. Three readers. One knows the camera's whole position: 100%, 100%, 100%, 100%, 100%, 100%, 100%. One knows how far it has paced towards the wall and believes itself out along the wall by a normal 20 cm, the position error a straight stair suffers: 76%, 77%, 77%, 77%, 77%, 83%, 79%. One knows only how far it has paced towards the wall and fits the focus of expansion freely — a uniform offset, two unknowns — leaving the scale alone to name the mistake: marks read to 0.5 px, 69%, 95%, 100%, 100%, 100%, 100%, 100%; to 2 px, 29%, 54%, 80%, 97%, 100%, 100%, 100%. The slide is strong evidence and an error in it is expensive; with the focus free there is no slide to get wrong, and the scale it leaves grows with every centimetre paced.00.2500.5000.7501how far the camera has paced towards the wall, metres (log scale)share of single pictures naming the mistake made0.020.050.10.20.40.81.5whole position knownfocus free, 0.5 pxfocus free, 2 pxbelieved 20 cm out alongdashed: the whole position knowna level walk towards the wall, interior only
Fig. 3 The share of single pictures naming the mistake made, against how far the camera has paced towards the wall: the whole position known; the distance known and the rest believed 20 cm out along the wall; the distance known and the focus fitted freely, at half a pixel and two.

With every mark read to half a pixel, fitting the focus freely names the mistake 69 times in 100 two centimetres towards the wall, 95 at five, and every time from ten centimetres on. Read to two pixels, it names it 54 times at five centimetres, 80 at ten and 97 at twenty. A camera that knows its whole position names it every time at every distance, because it also has the slide, and the slide is the strong evidence.

The interesting line is the third. A camera that knows how far it has paced and believes it knows the rest, but is out along the wall by a normal 20 cm — the size of error the earlier essay tried for a photographer who has miscounted a tread or two — names the mistake 76 to 83 times in 100, and pacing further does not help it. Its belief puts every candidate’s slide in the wrong place by up to 20 px, and the scale it could have read is buried under that. Fitting the focus costs less than believing a wrong position from five centimetres on, and costs nothing at all from ten. The earlier essay’s warning was that a step along the wall is strong evidence and an error in it expensive; the remedy is not to know the position better but to stop using it.

Every mistake the focus-free reading makes is between two mistakes, never between a mistake and the honest reading. At two centimetres towards the wall, over every picture drawn, the honest reading was named every time it was made and never named when it was not; the misreadings were two-column readings taken for one- or three-column ones, and three-column readings for one, two or four. The slide refutes honesty and the scale has to sort the rest, and sorting needs the scales of neighbouring mistakes to differ by more than the reading error.

Away from the wall reads as well

The earlier essay found a flight running away from the wall the most forgiving: it shrinks the rebuilt facade’s picture towards the focus, so the rebuilt windows crowd in over the facade instead of off its edges.

Read to 2 px with the focus free, 20 cm towards the wall names the mistake 97% of the time and 20 cm away 92%; at 1.5 m both name it every time, and the walk away keeps more of the rebuilt windows on the facade to read it fromThe focus-free reading, marks read to 2 px, on level walks of 0.02, 0.05, 0.1, 0.2, 0.4, 0.8, 1.5 m from the landing towards the wall and away from it, forty pictures a mistake. Towards: 29%, 54%, 80%, 97%, 100%, 100%, 100%. Away: 27%, 45%, 74%, 92%, 98%, 100%, 100%. A walk away from the wall scales every rebuilt facade's picture down towards the focus of expansion instead of up away from it, so the rebuilt windows crowd in over the facade rather than off its edges; the number of pictures with at least three rebuilt windows on the facade, of 200 drawn, was 159, 158, 158, 158, 155, 148, 130 towards and 159, 159, 159, 159, 161, 164, 169 away. The scale's evidence grows with the distance paced whichever way the camera goes, and at a few tens of centimetres the two directions read alike.00.2500.5000.7501how far the camera has paced from the landing, metres (log scale)share of single pictures naming the mistake made0.020.050.10.20.40.81.5towards the wallaway from the wallfocus free, marks read to 2 pxinterior windows only
Fig. 4 The share of single pictures naming the mistake with the focus free, marks read to two pixels, against how far the camera has paced towards the wall or away from it.

With the focus free the two directions read alike. At two pixels, twenty centimetres towards the wall names the mistake 97 times in 100 and twenty centimetres away 92; at forty centimetres, 100 and 98; at a metre and a half, both every time. The scale grows with the distance paced whichever way the camera goes, since 1−s1 - s changes sign but not size to first order. What away keeps is the windows: of two hundred pictures drawn at a metre and a half, 130 towards the wall still had three or more rebuilt windows on the facade to read, and 169 away from it. The direction matters for how long the reading lasts, not for how soon it starts.

The distance has to be paced

The reading needs the distance towards the wall, because each mistake’s predicted scale is set by it. The earlier essay suggested the camera might have that distance from a rangefinder, or from the facade’s own known spacing. Neither will do, and the reason is instructive.

A rangefinder aimed at the wall measures the distance to the wall, and to turn that into how far the third camera has come towards it the reader needs the pair’s distance to the wall as well — which is the very thing in dispute. The honest reading puts the wall twenty metres off; the one-column reading puts it 6.3. A rangefinder that measured either distance would settle the mistake on its own, with no third picture at all. The windows’ known spacing is the same thing in another form: a rebuilt facade stands at ρ\rho of the wall’s distance with its windows ρ\rho of the true spacing apart, so a reader who knows the windows are 2.4 m apart already knows the one-column reading’s 0.75 m is wrong. A facade matched a column out comes forward found that, and a length fixes the scale where it lies is the general statement: one known length in the scene is a closure the reading can be checked against directly.

So the distance must come from the camera’s own motion — treads counted, a tape on the ground from the landing, a pace — and that is a distance with an error of its own.

Paced to within 5 cm, 40 cm towards the wall names the mistake 92% of the time and 10 cm 59%; paced to 20 cm, 61% and 53%; not known at all, 43% and 17%The focus-free reading, marks to half a pixel, the distance paced towards the wall known to within a normal 0 cm, 5 cm, 10 cm, 20 cm, at 0.1, 0.2, 0.4, 0.8, 1.5 m, forty pictures a mistake. 0 cm: 100%, 100%, 100%, 100%, 100%; 5 cm: 59%, 74%, 92%, 99%, 93%; 10 cm: 54%, 60%, 75%, 93%, 85%; 20 cm: 53%, 55%, 61%, 75%, 77%. Dashed, the distance not known at all, every reading allowed whatever distance between 1.5 m away and 1.5 m towards the wall fits it best: 17%, 24%, 43%, 60%, 57%. The scale a reading predicts is (1 − ρ)·Tz/(ρZ − Tz), very nearly proportional to the distance paced, so an error in that distance is an error of the same proportion in every reading's scale, and readings whose scales stand two to one — one and two columns out — are confused once the distance is wrong by a large share of itself. With no distance at all each reading picks its own scale, and the honest reading, which has none to pick, loses to whichever wrong one fits the noise.00.2500.5000.7501how far the camera has paced towards the wall, metresshare of single pictures naming the mistake made0.10.20.40.81.5paced exactlypaced to 5 cmpaced to 10 cmpaced to 20 cmdistance not knownfocus free, marks read to 0.5 pxdashed: no distance at all
Fig. 5 The share of single pictures naming the mistake with the focus free, against how far the camera has paced towards the wall, with the pace known exactly, to 5, 10 and 20 cm; dashed, the distance not known at all.

The tolerance is a proportion, because every mistake’s scale is very nearly proportional to the distance. Paced to within 5 cm, forty centimetres towards the wall names the mistake 92 times in 100 and ten centimetres 59; paced to within 20 cm, 61 and 53. At eighty centimetres a 5 cm pace is good for 99 and a 10 cm pace for 93. A pace wrong by a large share of itself scales every candidate together, and the one- and two-column readings, whose scales stand two to one, trade places once the share approaches a half. A photographer who paces a metre towards a building to within a stride’s tenth is well inside the tolerance; one who shuffles ten centimetres and guesses is not.

With no distance at all, each candidate may choose whatever distance fits it best, and the reading collapses — 17 times in 100 at ten centimetres, 43 at forty. The honest reading suffers most: a wrong reading allowed to choose a distance near zero predicts almost no scale, fits its uniform offset to the noise, and beats the honest reading on its own pictures. That is the control the measurement needs. The scale is evidence only about readings whose scales are fixed in advance, and they are fixed by the pace.

What the reading leans on

The camera faces the wall squarely. A camera that also turns redraws everything through one warp, which the earlier essay found adds and loses nothing; but a turn the reader does not know is two more unknowns, and they are not a uniform offset. A camera whose turn is read from the facade’s own horizontal and vertical lines leaves the reading as it is here.

The facade is one plane. A projecting bay puts some windows nearer than others, and depth is a reciprocal is why the scale then differs from window to window even for the honest reading. The uniform offset that absorbs the camera’s place no longer absorbs everything that is not the mistake.

The mistake is a clean shift of whole columns. A wrong match is not a small error is the standing reason a coherent mistake has one ρ\rho and therefore one scale.

Each rebuilt window keeps its name. The offsets are compared window by window: the reading knows which rebuilt window it is predicting, because the pair rebuilt it from a named pair of marks, and it compares that window’s predicted offset with the offset of the same window in the third picture. What the matcher does not know is which real window a rebuilt one lands beside, and that is why every offset is wrapped. A reader that lost the names too would be comparing two clouds of offsets rather than two lists, and a cloud has no scale — only a spread, which a uniform offset cannot change and a scale enlarges by ss. It would still read something, but the scale’s sign, which separates walking towards the wall from walking away, would be gone with the names.

The reading error is independent from window to window. A focal length wrong by a per cent scales every window’s picture about the principal point, which is a scale about a different centre — and a scale about any centre is a scale about the focus plus a uniform offset. Fitted freely, the focus absorbs the offset part and leaves a one per cent scale that every candidate must explain. A third ray is worth what its picture is worth: the focal length must be known to better than the scale being read, which at ten centimetres for the one-column reading is about one per cent.

What the camera needs to know about itself

A mismatch on its own line needs a third eye began this line of reading with a third camera off the pair’s baseline. A staircase winds the mistake round the lattice and the essays on the climb found such a camera’s slide strong and its blind places few, provided it knew where it stood. The earlier essay found the scale weak and its blind places none. This one finds the scale needs to know only one thing about the camera — how far it has come towards the wall — and that a camera whose knowledge of the rest is merely good is better off forgetting it and fitting it from the picture.

That is a dolly zoom is a step and a zoom read the other way round. There, a step towards a subject moves every mark along the line from the point stepped towards, and a zoom moves them from the principal point; a subject at a known depth separates the two. Here the subject’s depth is the unknown, the step is known, and the point stepped towards is fitted. The geometry is one homothety, and it can be read for whichever of its three numbers the picture is not told.

Still open: whether a camera that turns as it paces can still fit its place away

Every camera here faced the wall squarely, so that what it did not know about its position entered the picture as one uniform offset. A photographer pacing towards a building rarely holds the camera square: it pans a degree or two to keep the facade framed, and tips to keep the roofline in. A small turn about the camera’s own centre moves every window’s picture by nearly the same amount — a uniform offset again — plus a little perspective warp across the frame, and the warp is the same size as the scale being read.

The measurement that settles what that is worth gives the pacing camera an unknown pan and tilt of a stated size, fits them with the focus as four unknowns or reads them first from the facade’s own straight lines, and asks whether the scale then still names the mistake from one picture — how large a turn the four-unknown fit absorbs before the warp it leaves is mistaken for a scale, whether reading the turn from the facade’s lines first costs less than fitting it, and whether a camera that turns as it paces needs to pace further to make up for it.

Shares its objects with

Essays that name at least two of the same things, and that neither author linked.

Named objects

A flat tag is an object no other essay names yet.

CorrespondenceDegenerate configurationFocal lengthOutlierrobust estimationTriangulation