What a pair is for

A turn at the landing makes the mistake a scale, and a scale is weak evidence

On a straight stair along a facade, a stereo pair's column mistake slides through a third camera's picture as one offset shared by every window. Turn the stair towards the wall at a landing and the offset stops being shared: the rebuilt facade's picture becomes the real one's scaled about the point the camera is walking towards, a different scale for every mistake, so no picture on that flight is blind. But the scale grows as the walk over the rebuilt facade's distance, and 10 cm towards the wall separates the one-column reading from the honest one by 1.8 px where 10 cm along the stair gives 9.8. Turning the camera in place adds nothing at all. What the turn does buy is tolerance: an error in how far towards the wall the camera has come costs almost nothing, for the same reason.

Worth reading first: A wrong match is not a small error · Two rays that do not meet.

A staircase winds the mistake round the lattice put a third camera on a straight stair along a facade of identical windows, which a level stereo pair had matched one to four columns out. Every rebuilt window — nearer than the wall, because every such mistake pulls the facade forward — slides through the climbing camera’s picture along the stair’s own direction, at 98 px for each metre and each column of the mistake, and a matcher sees the slide wrapped at the columns across and the storeys up: a line wound round a torus. The stair names the mistake from almost any single frame, and is blind only at the few places where that line passes back through a real window.

Every flight in that essay ran along the wall, so the camera never changed its distance from it. Most outside staircases turn. They climb one wall to a landing and then rise towards the building, or away from it, or round a corner. The essay ended by asking what such a turn does: on the second flight a camera sees near and far parts of the facade at different depths, so the slide is no longer the same at every window. Is that variation a nuisance the reading must model, or evidence — enough that one oblique picture from the landing does what the whole straight flight did?

The answer splits the question into two things that a turn does and that the question ran together. Turning the camera does nothing. Moving towards the wall does something exact and weak.

Towards the wall, the slide becomes a scale

The facade is the one of the straight-stair essay: five columns of windows 2.4 m apart and three storeys of 3 m, twenty metres off, faced squarely by a pair 1.1 m apart with a focal length of 900 pixels. A rebuilt window lies on the left eye’s ray through its real window, at the depth ratio ρ=B/(B−kp)\rho = B/(B - kp) for a kk-column mistake — 0.314 for one column out, 0.186 for two, 0.133 for three, 0.103 for four, so the rebuilt facades stand 6.3, 3.7, 2.7 and 2.1 m from the pair.

A camera moved by (Tx,Ty,Tz)(T_x, T_y, T_z) from the left eye — along the wall, up it, and towards it — and still facing the wall squarely draws a real window at xx and its rebuilt copy at x′x', and the two are related by one line of algebra:

x′−e=s (x−e),s=ρ (Z−Tz)ρZ−Tz,e=c+fTz (Tx, −Ty).x' - e = s\,(x - e), \qquad s = \frac{\rho\,(Z - T_z)}{\rho Z - T_z}, \qquad e = c + \frac{f}{T_z}\,(T_x,\,-T_y).

The rebuilt facade’s picture is the real facade’s picture scaled by ss about ee, and ee is the focus of expansion: the point in the picture the camera is moving towards. A dolly zoom is a step and a zoom found the same structure for a camera stepping towards a subject — every mark moves along the line from the point stepped towards, outward if it is nearer than the subject — and the rebuilt facade is a nearer subject. When the camera does not move towards the wall, Tz=0T_z = 0, the focus runs off to infinity and the scale about it becomes the uniform slide of the straight stair.

A metre towards the wall from the landing, the 2-column reading's rebuilt windows are the real windows' picture scaled by 1.298 about the point the camera is walking towards; 6 of 9 still land on a real windowThe facade of fifteen windows — five columns 2.4 m apart, three storeys of 3 m, 20 m from the pair — seen by a third camera that climbed a stair along the wall at 30° for 0.8 m to a landing and then walked a level metre straight towards the wall, still facing it squarely. Squares: the real windows as this camera draws them. Dots: where it draws the windows the level pair rebuilt from a match 2 columns out, which stand at 0.186 of the wall's distance on the left eye's rays. Each rebuilt window is its real window's picture moved away from the focus of expansion — the point the camera is walking towards, here 624 px right of the picture's centre and 360 px above it, off the canvas — by the factor s = ρ(Z − Tz)/(ρZ − Tz) = 1.2981, Tz = 1.00 m. On a straight stair every window moves by one slide; here each moves by an amount that grows with its distance from the focus, and a matcher sees 6 of the 9 rebuilt windows land within half a column and half a storey of a real one. The slider changes the mistake: the nearer the rebuilt facade stands, the faster it grows.squares: real windows · dots: rebuilt2 columns out · scaled by 1.298
Fig. 1 A third camera a metre towards the wall from a landing: the real windows, and where it draws the windows a stereo pair rebuilt from a match some columns out. The slider changes the mistake.

On the camera drawn here — a 30° stair along the wall for 0.8 m to a landing, then a level metre straight towards the wall — the one-column reading’s rebuilt windows are the real windows’ picture scaled by 1.130, the two-column reading’s by 1.298, the four-column reading’s by 1.850. The focus is 624 px to the right of the picture’s centre and 360 px above it, far off the canvas, because the camera has moved further along and up the wall than towards it; seen from the facade, each rebuilt window is pushed away from a point out beyond the top right corner by an amount that grows with its distance from that point. The windows nearer the focus move less, and the gradient across the picture is the variation the question was asking about.

The scale grows as the walk over the rebuilt facade’s distance

How large is the variation? The closed form says, and the projection agrees with it to the last digit.

Walking 1.5 m towards the wall scales the rebuilt facade's picture by 1.21, 1.55, 2.13, 3.42 for readings one to four columns out — slowly at first, because even the nearest rebuilt facade stands 2.1 m off and the one-column facade 6.3 mThe scale s = ρ(Z − Tz)/(ρZ − Tz) by which a camera that has walked Tz metres towards the wall sees the rebuilt facade's picture enlarged against the real one's, about the point it is walking towards. ρ is the rebuilt facade's share of the wall's distance — 0.314, 0.186, 0.133, 0.103 for readings one to four columns out, so the rebuilt facades stand 6.3, 3.7, 2.7, 2.1 m away. Lines: the closed form. Dots: one rebuilt window projected into a camera on a level walk from the landing, its distance from the focus of expansion divided by its real window's, at 0.5, 1, 1.5 m — on the lines to the last digit. The scale grows as Tz over ρZ while the walk is short against the nearest rebuilt facade, so the first ten centimetres towards the wall change the one-column reading's picture by 1.11% — a few pixels across a facade a few hundred pixels wide.12300.2500.5000.75011.251.50how far the camera has walked towards the wall, metresscale of the rebuilt facade's picture against the real one's1 column out2 columns out3 columns out4 columns outlines: the closed form · dots: projecteda level walk straight at the wall
Fig. 2 The scale of the rebuilt facade’s picture against the real one’s, against how far the camera has walked towards the wall, for readings one to four columns out. Lines: the closed form; dots: projected.

The scale is 1+(1−ρ) Tz/(ρZ−Tz)1 + (1 - \rho)\,T_z/(\rho Z - T_z), so while the walk is short against the rebuilt facade’s distance it grows as Tz/ρZT_z/\rho Z — the walk measured against 6.3 m for the one-column reading. A metre and a half towards the wall scales the four readings by 1.21, 1.55, 2.13 and 3.42; the first ten centimetres change the one-column reading’s picture by 1.11 per cent. On a facade drawn a few hundred pixels across, that is a few pixels. The nearer mistakes grow faster because their rebuilt facades stand nearer, and every reading grows at a different rate — which is the whole of the evidence a turn can supply.

Two things follow at once. The first is that no picture on a flight towards the wall is blind. On a straight stair, two readings agree at a frame when their slides differ by a whole number of columns and storeys, and then every window agrees at once, because every window carries the same slide. Under two different scales the windows carry different offsets, growing with their distance from the focus, and they cannot all differ by a whole lattice step at once unless the scales differ by a whole number — a doubling, a walk of metres. The second is that the evidence comes slowly. A slide grows as the walk over the wall’s distance multiplied by the baseline ratio; a scale grows as the walk over the rebuilt facade’s distance, and its effect on a window’s offset is that times the window’s distance from the focus.

Turning the camera adds nothing

Before the walk towards the wall, there is the turn itself. A photographer on a landing turns to face the next flight, and a camera that turns sees the facade obliquely: near columns larger, far ones smaller, the window lattice drawn as a converging grid. That is the variation across the picture the question described, and it is present before a single step is taken.

It carries nothing. A rebuilt window and its real window lie on one ray from the left eye, and a camera at the left eye’s position draws them at the same point however it is turned; a camera displaced from it draws them apart by the displacement and nothing else. Turning a camera about its own centre re-draws the whole picture through one homography — the same warp applied to real windows and rebuilt ones — and a matcher that undoes the warp has the unturned picture back, pixel for pixel. The turn changes how the evidence is drawn, not how much of it there is.

The measurement confirms it exactly. The straight-stair essay’s diagonal stair, rising at 51.3° — a storey over a column — carries the one-column reading back onto the real lattice 1.76 m along it: there the interior of a picture reads that mistake exactly as it reads the honest facade. Turned at that place by 0°, 2° or 4° — turns small enough to keep the whole facade in a picture whose half-width spans 21° — the camera still reads the two identically, to three millionths of a millionth of a pixel. A landing whose turn is made by the photographer rather than by the stair is a landing on the straight stair.

A step towards the wall breaks the blindness, slowly

So the question becomes what a step does, and the blind place is where it shows most clearly: there the slide has put the one-column reading exactly on the honest one, and whatever separates them afterwards is what the step bought.

From the place on the diagonal stair where the one-column reading lands back on the real lattice, 10 cm on along the stair or straight up separates it from the honest reading by 9.8 px; 10 cm towards the wall, by 1.8A stair rising along the wall at 51.3° — a storey over a column — carries the one-column reading back onto the real window lattice 1.76 m along it: there a picture's interior reads that mistake exactly as it reads the honest facade. From that place the camera moves on along the stair, straight up, or level towards or away from the wall, and the line is how far apart the two readings then sit, as the root-mean-square difference of their offsets over the windows both land. On along the stair: 0.0, 4.9, 9.8, 14.7, 19.6, 24.5, 29.5, 34.4, 39.3 px at 0, 0.05, 0.1, 0.15, 0.2, 0.25, 0.3, 0.35, 0.4 m; straight up: 0.0, 4.9, 9.8, 14.7, 19.6, 24.5, 29.5, 34.4, 39.3; towards the wall: 0.0, 0.9, 1.8, 2.7, 3.6, 4.6, 5.6, 6.6, 7.6; away from it: 0.0, 0.9, 1.7, 2.5, 3.3, 4.1, 4.9, 5.7, 6.4. A move in the wall's own plane slides the rebuilt facade at 98 px a metre for this reading. A move towards or away from the wall only scales it about the point the camera moves towards, and the scale grows as the move over the rebuilt facade's distance — 6.3 m — so the same distance buys a fifth or less of the separation.01020304000.1000.2000.3000.400how far the camera moves from the blind place, metresone-column reading against the honest one, px (RMS over windows)on along the diagonalstraight uplevel, towards the walllevel, away from the walldashed grey: the half-pixel reading errorthe edge set aside
Fig. 3 From the blind place on the diagonal stair, how far apart the one-column and honest readings sit as the camera moves on along the stair, straight up, or level towards or away from the wall. Dashed: the half-pixel reading error.

Ten centimetres on along the stair, or straight up, separate the two readings by 9.8 px; the slide in the wall’s plane runs at 98 px a metre for this reading, and any direction in that plane gives the same. Ten centimetres level towards the wall separate them by 1.8 px, and away from it by 1.7. Forty centimetres towards the wall reach 7.6 px, which along the stair took eight centimetres. The two readings sit at a fifth of the separation, at the cost of the same walk.

A level 10 cm step from the blind place separates the two readings by 9.8 px along the wall and 1.8 px straight at it: every degree a step turns towards or away from the wall gives up separationFrom the blind place on the diagonal stair, a level step of 10 cm in each direction in plan, the camera still facing the wall squarely, and how far apart the one-column and honest readings then sit (root-mean-square over the windows both land): -90° 1.70, -75° 2.20, -60° 4.29, -45° 6.33, -30° 8.02, -15° 9.22, 0° 9.82, 15° 9.77, 30° 9.06, 45° 7.74, 60° 5.91, 75° 3.75, 90° 1.77 px. Along the wall the step slides the rebuilt facade; at the wall it scales it about the point the camera steps towards; in between it does some of each, and the slide is worth about 5.5 times as much as the scale for the same distance. The curve is not symmetric because a step towards the wall enlarges the rebuilt facade's picture and a step away shrinks it, and the two meet the lattice differently.02.5057.5010-90-60-300306090direction of a level 10 cm step in plan, degrees (0: along the wall, 90: straight at it, −90: away)one-column reading against the honest one, pxa level 10 cm step from the blind placeaway 1.7 · along 9.8 · at 1.8 px
Fig. 4 How far apart the two readings sit after a level 10 cm step from the blind place, against the direction of the step: along the wall, straight at it, straight away, and every direction between.

Between the two directions, a step does some of each — slides the rebuilt facade by its component along the wall and scales it by its component towards it — and the separation falls smoothly as the step turns: 9.8 px along the wall, 9.1 and 7.7 at 30° and 45° towards it, 5.9 at 60°, 1.8 straight at it. The slide is worth about five and a half times the scale for the same distance. A flight that turns towards the facade at an angle short of a right angle keeps most of what the straight flight had, by keeping most of its run along the wall.

Enough of a weak thing is still evidence

A fifth of the separation is not none, and the reading error is half a pixel. The question with a number in it is how far from the blind place one picture has to be taken before it names the right reading.

One picture 2 cm on along the stair from the blind place names the right reading 100% of the time; 2 cm towards the wall, 45%, and towards the wall it takes 5 cm (95%)Single pictures taken at stated distances from the blind place on the diagonal stair, each with half a pixel of reading error, read by the interior of the picture alone — the facade's edge set aside, since an edge names a mistake even at a blind place — between the two readings the blind place confuses, honest and one column out; 100 pictures of each, 200 at every distance. Share that names the reading made: on along the stair 95%, 100%, 100%, 100%, 100%, 100%, 100%, 100%; level towards the wall 35%, 45%, 60%, 95%, 100%, 100%, 100%, 100%; level away 35%, 45%, 57%, 91%, 100%, 100%, 100%, 100% — at 1 cm, 2 cm, 3 cm, 5 cm, 7.5 cm, 10 cm, 15 cm, 20 cm. A coin names 50%. The variation across one picture that a move towards the wall creates is evidence, and enough of it is reached a few centimetres from any blind place; it is reached two to three times further away than the slide along the stair reaches it.0.4000.6000.800100.0500.1000.1500.200how far from the blind place the one picture is taken, metresshare of 200 pictures that tell the two readings aparton along the diagonallevel, towards the walllevel, away from the wallhalf a pixel; the edge set asidedashed: a coin
Fig. 5 Share of single pictures, taken a stated distance from the blind place, that tell the one-column reading from the honest one by the interior of the picture alone. Dashed: a coin.

Set the facade’s edge aside — an edge names a mistake even at a blind place, as the climbing essays found, and the point here is what the interior says. One picture a centimetre on along the stair names the right reading 95 times in 100, and two centimetres on every time. Towards the wall, two centimetres name it 45 times — a coin — three centimetres 60, five centimetres 95, seven and a half centimetres every time. Away from the wall the figures are almost the same. A turn towards the wall does what the question hoped: one picture on that flight, anywhere beyond a few centimetres from the landing, names the mistake from the variation across it. It needs two to three times the distance a step along the wall needs to do it.

So the answer to “does one oblique picture from the landing do what the whole straight flight did” is that a single picture already did that on the straight flight. The climbing essay found one frame enough almost anywhere, and the straight stair kept that. What the straight flight could not do was escape its blind places by any means but another frame elsewhere. The turned flight escapes them within its own picture, slowly.

The same weakness is a tolerance

The straight-stair essay found the real cost of reading on a climb was what the camera knows of its own position: a camera that believes it is 70 cm up when it is 75 predicts every reading’s offset 5 cm of slide from where it is. On a flight towards the wall, the same 5 cm of error is 5 cm of walk towards the wall, and that moves every prediction by a fifth as much.

Not knowing how far up the second flight it is costs a camera least when the flight runs level at or from the wall: at 50 cm of error one picture names the reading 94% of the time walking away, 84% walking towards, 66% carrying on along itA stair along the wall at 30° for 0.8 m to a landing, then a second flight; one picture taken somewhere on its first metre, read with half a pixel of error by a camera that knows the landing and believes it is a stated distance (one standard deviation) further or nearer along the second flight than it is. Every reading one to four columns out and the honest one, 60 pictures each. Share named, at 0, 0.1, 0.2, 0.3, 0.5, 0.75, 1 m of error: level, towards the wall 100%, 97%, 93%, 90%, 84%, 79%, 77%; level, away from the wall 100%, 100%, 99%, 98%, 94%, 91%, 90%; climbing at 30°, towards it 100%, 94%, 89%, 82%, 73%, 65%, 61%; on along the wall at 30° 99%, 89%, 81%, 75%, 66%, 61%, 58%. The same weakness that makes a step towards the wall poor evidence makes an error towards the wall cheap: a camera that has misjudged its distance from the wall predicts every window's offset nearly where it is. Walking away, the rebuilt windows also shrink towards the point the camera backs from and stay on the facade, so no error flips a window on or off it.00.2500.5000.750100.1000.2000.3000.5000.7501error in how far up the second flight the camera believes it is, metresshare of 300 single pictures naming the reading madelevel, towards the walllevel, away from the wallclimbing at 30°, towards iton along the wall at 30°one picture, half a pixelthe landing known
Fig. 6 Share of single pictures naming the reading made, against the error in how far up the second flight the camera believes it is, for flights level towards and away from the wall, climbing towards it, and carrying on along it.

A camera that knows where the landing is and misjudges how far up the second flight it has come by 20 cm names the reading from one picture 93 times in 100 on a level flight towards the wall, 99 on a level flight away, 89 on a flight climbing towards the wall at 30°, and 81 carrying on along it at 30°. At 50 cm of error the figures are 84, 94, 73 and 66; at a metre, 77, 90, 61 and 58. The level flights are the robust ones because their whole motion is towards or away from the wall, where error is cheap. The climbing flight towards the wall rises as it goes, and its rise is in the wall’s plane, where error is expensive, so it sits between.

That is a weakness and a tolerance stated twice. A move towards the wall changes the picture little, so it is poor evidence and an error in it costs little; a move along the wall changes the picture a great deal, so it is strong evidence and an error in it costs a great deal. A photographer who knows which step of a flight they are on to a tread should want the flight along the wall; one who has lost count should want it running at the wall, or better, away from it.

Away from the wall keeps the facade

Away is better than towards in that figure for a reason the scale makes plain. Walking towards the wall enlarges the rebuilt facade’s picture about the focus, and its outer windows are pushed off the real facade one after another. Walking away shrinks it towards the focus, and the rebuilt windows crowd in over the facade rather than off it.

Three metres up a second flight, 11 rebuilt windows still land on real ones when the flight turns away from the wall, against 4 when it turns towards it and 4 when it carries on alongThe rebuilt windows of all four nearer readings, 30 of them, carried into a camera on a second flight that leaves the landing (0.8 m along a 30° stair) turned towards the wall, away from it, or not at all, and rises at 30°: how many still land within half a column and half a storey of a real window, at 0, 0.5, 1, 1.5, 2, 2.5, 3 m. Towards: 24, 17, 16, 11, 11, 8, 4; away: 24, 23, 17, 16, 11, 11, 11; along: 24, 23, 13, 7, 7, 4, 4. A window that has slid off the facade can no longer be read, and the climbing essays found that the binding limit on how long a slide names its mistake. Walking towards the wall enlarges the rebuilt facade's picture about the point walked towards and pushes its outer windows off; walking away shrinks it towards that point and keeps them on — the one advantage a turn has that a straight flight cannot have.010203000.50011.5022.503how far up the second flight, metres (rising at 30°)rebuilt windows still landing on a real one, of 30towards the wallaway from the wallon along the wallall four nearer readingsthe second flight rising at 30°
Fig. 7 How many of the thirty rebuilt windows of the four nearer readings still land on a real window, up a second flight rising at 30° that turns towards the wall, away from it, or carries on along it.

Of the thirty rebuilt windows the four nearer readings have between them, 24 land on real windows at the landing. A metre and a half up a flight turned towards the wall, 11 still do; carrying on along it, 7; turned away, 16. Three metres up, the flights towards the wall and along it have 4 left each, and the flight away has 11. A facade matched a column out comes forward and the climbing essays found the lattice’s edge the binding limit on how long a slide can be read, and a straight stair can spend its slide only against the facade’s width and height. A flight away from the wall spends almost none of it: the scale it adds pulls the rebuilt facade in rather than out. It is the one thing a turn does that no straight flight can.

The geometry the reading leans on

The camera faces the wall squarely on both flights. The scale about the focus of expansion is exact for a camera that only translates. A camera that also turns redraws everything through one warp; that adds nothing and loses nothing, except that a facade seen obliquely is drawn with fewer pixels across its far columns, and resolution lost there is reading error gained.

The landing is known. Every position error here is along the second flight. A camera that does not know where the landing is carries an error in the wall’s plane as well, and the tolerance of a flight towards the wall then applies only to the part of the error that is towards the wall.

The facade is one plane. A projecting bay or a recessed porch puts some real windows nearer than others, and the scale of each depends on its own depth: depth is a reciprocal is why, since the scale is set by TzT_z over each window’s distance. A facade of several depths would show several scales even for the honest reading, and the reading would have to model them.

The mistake is a clean shift of whole columns. A wrong match is not a small error is the standing reason: a coherent mistake has one ρ\rho and so one scale, and a scatter of errors has neither.

The reading error is half a pixel, independent from window to window. A third ray is worth what its picture is worth states the general rule. A focal length wrong by a per cent scales every window’s picture together, about the centre rather than about the focus of expansion — a different centre, which is the only thing that keeps it from being read as a walk towards the wall.

What the turn adds to the straight stair

A mismatch on its own line needs a third eye found that a repeat along one baseline is broken by a baseline not parallel to it. A third eye that lands on the next post found that such a baseline is blind only at the single placement where the repeat recurs. The straight stair extended that to a lattice, blind at the slopes the lattice repeats along. The turn adds the third dimension. A move towards the wall is a baseline the lattice cannot repeat along at all, because it does not slide the rebuilt facade across the lattice but scales it, and no lattice repeats under a scale. That makes it the one direction with no blind places — and, because the facade is far, the direction that buys least for each step.

Still open: whether the scale names the mistake for a camera that does not know where along the wall it stands

Every reading here knew where the camera was, up to an error along one flight. The scale and the slide depend on the camera’s position differently: the slide on its move along and up the wall, the scale only on its move towards it, and the focus of expansion on the ratio of the two. A camera that knew its distance from the wall — from a rangefinder, or from the facade’s own known spacing — and nothing about how far along or up it stood would have no use for the slide, whose every offset is a guess at its own position, but might still have the scale.

The measurement that settles what that is worth reads one picture taken from a camera whose distance towards the wall is known and whose position along and up the wall is unknown: for each candidate mistake it fits the focus of expansion freely, as two extra unknowns, and asks whether the scale left over names the mistake. The questions with numbers in them are how far towards the wall the camera must be before the scales of the five readings are told apart from one picture with the focus free; whether fitting the focus costs the reading more than the slide’s position error did; and whether a picture taken walking away from the wall, which keeps the rebuilt windows on the facade, reads the scale as well as one taken walking towards it.

What links here

Computed from the collection, not written here: the essays that point at this one.

Shares its objects with

Essays that name at least two of the same things, and that neither author linked.

Named objects

A flat tag is an object no other essay names yet.

CorrespondenceDegenerate configurationFocal lengthOutlierrobust estimationTriangulation