Measuring from one picture

A second photograph reads the lean the first cannot, if it is taken round the corner

One photograph with two plumb corners grades a street's posts for their lean across its line of sight and is blind to a lean towards or away from it. A second photograph, read the same way, sees each post's lean across its own sight — so the pair reads both components wherever their two sight lines through a post cross at a wide angle. At right angles they read the lean along the first sight to a tenth of a degree, and catch 65 in 100 of the posts the first picture missed, against 26. The picture the question proposed, from across the street, is nearly the worst place to stand: its sight lines run back along the first, it sees the same component reversed, and it catches 29.

Worth reading first: The one thing a single view cannot give · What one picture of a plane determines.

A photograph grades its posts across the sight, and not along it took a street with a row of posts in front of a building and read each post for its own lean. Two plumb corners fix the picture’s vertical vanishing point, and each post’s line is compared with the plumb line through its foot: the angle between them is the post’s lean, seen through the camera. Posts 2.5 metres tall at 7.5 metres were read to about a twelfth of a degree. But only the part of a lean that lies across the line of sight turns a post’s image. A lean towards the camera keeps the post on its own plumb line near the centre of the frame and turns it only a little at the edges, so a post leaning straight at the camera was caught five times in a hundred near the centre.

That essay ended by proposing the obvious remedy, a second photograph, and two places to take it: across the street, or a few paces along the same pavement. It asked how far apart the two viewpoints must be before the lean along the first sight is read as well as the lean across it, and whether the second picture needs plumb corners of its own.

The measurement says both proposed places are poor, and why: the second picture reads the same kind of thing the first does, and what matters is the angle between what the two read.

Two pictures, two equations for every post

A post’s lean has two components on the ground: how far its top stands to one side of its foot, and how far forward or back. Call them, for the first camera, across and along its sight. In any picture, the angle between the post’s line and its plumb line is a sum: a gain times the across component plus another gain times the along component, where the gains depend on where the post stands in that picture. The first essay measured them. Across the sight the gain is about one — a post leaning a degree sideways turns its image by about a degree — and along the sight it is the post’s distance from the centre column over its distance from the camera, nearly zero in the middle of the frame.

A second camera standing elsewhere has gains of its own. Its across direction is the across direction of its own sight line, which is some mixture of the first camera’s across and along. So each post gives two equations — one angle read in each picture — in its two lean components, and the pair can be solved post by post. The solution is exact when the readings are; with reading error it is good when the two equations are independent and poor when they are nearly the same equation. They are the same equation when the two sight lines through the post run parallel, in either direction: two cameras on one line through the post see the same across component, one of them reversed.

The second camera 90° round the row: its sight lines cross the first camera's at 65° to 115° at the posts, and the post where they run nearest parallel — the 1st from the left, at 65° — is the one whose lean along the first sight it reads worstA street seen from above: eight posts 2.5 m tall in a row 7 m long, the first camera 7.5 m in front of the row's middle, and a second camera 10 m from the middle, walked 90° round from the first camera's bearing — at 180° it stands across the street looking back. Thin lines are each camera's sight line to each post. Each picture reads, of a post's lean, only the part across its own sight line, so two pictures read both parts of a post's lean where their sight lines through it cross at a wide angle and neither where they run parallel. Here they cross at 65°, 72°, 79°, 86°, 94°, 101°, 108°, 115° from left to right. A second picture from a few paces along the pavement crosses at a few degrees everywhere; from across the street, at nearly 180° for the posts in the middle, which is parallel again. The slider walks the second camera round.firstsecondseen from above · a larger dot is a wider crossingsecond camera 90° round
Fig. 1 A street seen from above: the row of posts, the first camera, a second camera walked round the row, and each camera’s sight line to each post. A larger dot is a post whose two sight lines cross more widely. The slider walks the second camera round.

So the question is not how far apart the two cameras stand but at what angle their sight lines cross at each post. The street here is the first essay’s — eight posts 2.5 metres tall in a row 7 metres long, the first camera 7.5 metres in front of the row’s middle, a building’s two plumb corners behind them — and the second camera stands 10 metres from the row’s middle, walked round it by a stated angle from the first camera’s bearing, with a pair of plumb corners of its own behind the posts as it sees them, and every post’s edge read across itself to 0.4 pixels in both pictures. At ninety degrees round, the two sight lines cross at the posts at 65 degrees on the left of the row to 115 on the right. At 180 degrees — directly across the street, looking back — they cross at 136 degrees at the ends of the row and 173 in the middle, nearly back along each other. A few paces along the pavement, ten degrees round, they cross at a few degrees everywhere.

Read best at right angles, worst near either bearing

The reading follows the crossing angle.

Two pictures at right angles read a post's lean along the first sight to 0.10° and across it to 0.08°; from a few paces along the pavement (10°), 0.72°, and from across the street, 0.30°Rows of eight posts standing at random leans of 0.2° in each direction, every post's edge read across itself to 0.4 px, each picture's vertical read from a pair of plumb corners of its own; the second picture taken 10 m from the row's middle at 5, 10, 20, 30, 45, 60, 75, 90, 105, 120, 135, 150, 165, 180° round from the first. For each post, the scatter of its read lean about its true one over 120 rows, then the median over the eight posts. Along the first camera's sight: 1.476, 0.718, 0.349, 0.241, 0.160, 0.126, 0.109, 0.101, 0.115, 0.137, 0.150, 0.208, 0.297, 0.302°. Across it: 0.239, 0.157, 0.090, 0.073, 0.069, 0.071, 0.074, 0.080, 0.087, 0.088, 0.089, 0.085, 0.097, 0.069°. The dashed line is the first picture alone reading the across component, 0.084°; alone it reads nothing along the sight. The along component is read best near a right angle, worst a few degrees either side of the first camera's bearing — and worst again from across the street, where every post's two sight lines run back along each other.00.2000.4000.6000306090120150180how far round the row the second camera stands, degrees (180: across the street)median over the posts of the reading's scatter, degreesalong the first sightacross itdashed: one picture, across onlyclipped at 0.6°
Fig. 2 The median over the posts of how finely each lean component is read, against how far round the row the second camera stands. Dashed: one picture alone, reading only the component across its sight.

At ninety degrees round, the pair reads each post’s lean along the first sight to 0.10 of a degree and across it to 0.08 — the across reading as good as the first picture alone gave, 0.084, and the along reading nearly as good. At sixty degrees and at 120 the along reading is 0.13 and 0.14. At forty-five, 0.16. Short of that it falls away quickly: 0.24 at thirty degrees, 0.35 at twenty, 0.72 at ten, and a degree and a half at five. Past ninety it falls away too, more slowly: 0.15 at 135 degrees, 0.21 at 150, and 0.30 from across the street.

A few paces along the pavement is the near end of that curve. Ten degrees round from 10 metres is a step of about a metre and three-quarters to the side, and from there the pair reads the along component to 0.72 of a degree — three times the quarter-degree lean the first essay set out to catch. The second picture has hardly changed the angle of anybody’s sight line through any post, so it has hardly added an independent equation, and solved as a pair the near-duplicate equation even drags the across reading down with it, to 0.16 of a degree from the first picture’s 0.08; a reader would keep the first picture’s across reading there.

The far end — across the street — is the end the question proposed, and it is poor for the opposite reason. The second camera looks back along very nearly the first camera’s sight lines and reads, of each post’s lean, very nearly the same across component, reversed. What it adds is a second reading of the across component — which is why the across reading is best there, 0.069 of a degree, two readings averaged — and very little of the along one.

The post it reads worst moves along the row

The median hides that the posts are not alike. The crossing angle differs from post to post, and so does the reading.

As the second camera walks round towards the far side of the street, the post it reads worst walks in from the end of the row: post 1 at 90°, post 8 at 135°, post 6 at 165°, post 4 at 180°, counting from the leftThe scatter of each of eight posts' read lean along the first camera's sight, over 80 rows of posts at random leans of 0.2°, for a second camera 10 m from the row's middle at 90, 135, 165, 180° round. 90°: 0.16, 0.12, 0.12, 0.12, 0.09, 0.08, 0.08, 0.07°; 135°: 0.14, 0.12, 0.16, 0.13, 0.14, 0.25, 0.44, 3.99°; 165°: 0.18, 0.19, 0.24, 0.32, 0.74, 1.65, 0.41, 0.28°; 180°: 0.19, 0.21, 0.35, 1.03, 1.01, 0.41, 0.25, 0.20°. A post is read worst where its two sight lines run parallel, and at 90° none does; past it, the post at the far end of the row first sees the two cameras nearly opposite, and by 180° it is the posts in the middle. The two pictures' different distances from the row — 7.5 and 10 m — keep the lines from running exactly back along each other except on the centre line, so the end posts are read fairly well from across the street and the middle ones not at all. Readings above 2° are clipped.00.50011.502the eight posts, left to right across the rowscatter of the lean along the first sight, degrees90° round135° round165° round180° roundsecond camera 10 m from the row's middleclipped at 2°
Fig. 3 Each post’s scatter of the lean along the first sight, for a second camera 90°, 135°, 165° and 180° round the row.

At ninety degrees round no post’s two sight lines run parallel, and every post is read to between 0.07 and 0.16 of a degree, the worst being the leftmost, where the lines cross at 65 degrees. At 135 degrees the rightmost post sees the two cameras almost opposite, and it is read to four degrees — not read at all — while the leftmost six are read to between 0.12 and 0.16. At 165 degrees the blind post has walked in to the sixth from the left; at 180 it is the two in the middle, read to a degree each, while the posts at the ends, whose sight lines still cross at 136 degrees, are read to 0.2.

That is worth knowing before choosing where to stand, because a second picture that reads most posts well and one post not at all is a survey with a hole in it at a place the photographer can predict. The hole is wherever a line from the first camera through a post, carried on through the post, reaches the second camera. A camera standing at right angles to the first, seen from the row, puts that line nowhere among the posts.

Caught at the same false alarm

The point of the first essay’s grading was a decision about each post: leaning, or straight. The pair can make it for the posts the first picture could not.

With straight posts cleared nine times in ten, a second picture at right angles catches 65% of the posts leaning along the first sight, against 26% for one picture; from across the street, 29%Rows of eight posts, half leaning a quarter of a degree in a random direction and half within a twentieth; each post's read lean weighed by its own reading scatter, learned from rows of plumb posts, and called leaning above a cut set so that nine straight posts in ten are cleared in every arrangement; 150 rows. Share of leaning posts caught, and of those leaning within 30° of the first camera's sight: one picture 57% and 26%; two, 10° apart 62% and 32%; two, 30° apart 63% and 38%; two, 60° apart 73% and 58%; two, 90° apart 75% and 65%; two, 120° apart 67% and 49%; two, 150° apart 64% and 35%; two, 180° apart 65% and 29%. One picture catches a post that leans across its sight and is blind to one that leans along it. A second picture puts the along component across its own sight, and catches it best when the two sight lines cross at a right angle; a few paces along the pavement or across the street, it sees nearly what the first saw.one picture: every leaning post57%leaning along the first sight26%two, 10° apart: every leaning post62%leaning along the first sight32%two, 30° apart: every leaning post63%leaning along the first sight38%two, 60° apart: every leaning post73%leaning along the first sight58%two, 90° apart: every leaning post75%leaning along the first sight65%two, 120° apart: every leaning post67%leaning along the first sight49%two, 150° apart: every leaning post64%leaning along the first sight35%two, 180° apart: every leaning post65%leaning along the first sight29%straight posts cleared 90% in every arrangement150 rows of eight
Fig. 4 The share of leaning posts caught, and of those leaning along the first camera’s sight, with straight posts cleared nine times in ten, for one picture and for two at a range of angles apart.

Half the posts in each row lean a quarter of a degree in a random direction and half within a twentieth. Each post’s read lean is weighed by how well that post is read — its scatter learned beforehand from rows of plumb posts — and called leaning above a cut set so that nine straight posts in ten are cleared in every arrangement, so the arrangements are compared on what they catch at the same false alarm. One picture catches 57 in 100 of the leaning posts and 26 of those leaning within thirty degrees of its own sight, which are the posts it cannot see. A second picture ninety degrees round catches 75 of all leaning posts and 65 of those. At sixty degrees round, 73 and 58; at 120, 67 and 49. From a few paces along the pavement, 62 and 32; from across the street, 65 and 29 — barely more of the hidden posts than one picture alone.

The overall share is held down by what was already limiting the first essay: a quarter of a degree is only two and a half times the reading’s scatter, and at a fixed false alarm some leaning posts always slip under the cut. The along-sight share is the one that measures what the second picture adds, and it more than doubles at right angles and hardly moves anywhere else.

A second picture needs a vertical of its own

The question also asked whether the second picture needs plumb corners of its own, or whether the posts the two pictures share could fix its vertical.

A second picture with no building of its own reads its vertical from the posts and gives up the right angle: 0.64° at 90° against 0.10° with corners, while at 60° it costs only 0.04°The second picture's vertical read from a pair of plumb corners of its own, or — with no building behind the posts from its side — from the eight posts themselves, which takes them as plumb on average. Median scatter of the along-sight lean, degrees, at 30, 45, 60, 75, 90, 105, 120° round: with corners 0.241, 0.160, 0.126, 0.109, 0.101, 0.115, 0.137; from the posts 0.284, 0.199, 0.169, 0.148, 0.639, 0.154, 0.160. Share of posts leaning along the first sight caught, straight posts cleared nine in ten: with corners 38%, 46%, 58%, 64%, 65%, 57%, 49%; from the posts 32%, 34%, 44%, 44%, 21%, 43%, 37%. A vertical read from the posts loses whatever lean the row shares, and near 90° the posts stand one behind another on one column of the second picture, so their lines barely fix a vanishing point at all. Turned a little short of a right angle the row spreads across the picture again and the posts read their own vertical nearly as well as a building would.00.2500.5000.75013045607590105120how far round the row the second camera stands, degreesmedian scatter of the lean along the first sight, degreescorners of its ownvertical from the postssecond camera 10 m from the row's middleclipped at 1°
Fig. 5 The scatter of the lean along the first sight, against how far round the second camera stands, with the second picture’s vertical read from plumb corners of its own and read from the posts themselves.

They cannot quite. Each picture’s vertical vanishing point has two unknowns, every post adds two, and two pictures give two equations a post; the posts alone leave the second picture’s vertical two equations short. What a second picture without a building can do is read its vertical from the posts themselves, taking them as plumb on average — the reading the first essay found loses whatever lean the whole row shares. At sixty degrees round that costs the along reading 0.04 of a degree, 0.17 against 0.13. At ninety degrees it costs nearly everything, 0.64 against 0.10, and the hidden posts caught fall from 65 in 100 to 21. At ninety degrees the second picture looks straight down the row, the posts stand one behind another on one column of its frame, and lines that nearly coincide barely fix a vanishing point at all. Turned fifteen degrees short of the right angle, the row spreads across the picture again — 75 degrees round, the along reading is 0.15 without corners against 0.11 with them.

So the instruction has a second half. A second picture taken at right angles needs a building behind the posts from its side; without one, take it at sixty or seventy-five degrees round instead, where the posts themselves can stand in for a building at a small cost.

Where the rule comes from

None of this is particular to posts. A picture measures directions across its own line of sight and not along it, and the same is true of every measurement made with rays. Two rays that do not meet found a point’s position read from two pictures to be good across both rays and poor along them where they nearly coincide, and a third ray is worth what its picture is worth found that what a further view adds depends on the direction it comes from as well as how well it is read. A lean is a direction rather than a position, but its two components are read through the same two sight lines, and the conditioning is the same: the sine of the angle at which the lines cross. That is why ninety degrees is best, why a few paces is a few degrees and worth little, and why across the street — which sounds like the most different view a photographer can take — is the same sight line seen from its other end.

There is a kindred result in another field. A post read both ways sets its lean aside separated a post’s own tilt from a rolling shutter’s lean by driving past it twice, in opposite directions, so that the shutter’s contribution changed sign and the tilt’s did not. Opposite views help there because the thing to be removed reverses and the thing to be kept does not. Here the thing to be read reverses too, so opposite views read it no better than one.

A step is not an angle

It is tempting to measure a second viewpoint by how far it is from the first, and the street shows why that is the wrong ruler. From a few paces along the pavement the second camera stands a metre and three-quarters from the first and reads the along component to 0.72 of a degree; from across the street it stands seventeen metres away and reads it to 0.30; from round the corner, ninety degrees round, it stands twelve and a half metres away and reads it to 0.10. Distance between the cameras orders those three wrongly. The angle between their sight lines at the post orders them rightly, because the angle is what decides whether the two readings are two equations or one. A turn of the head is not a step sideways made the corresponding point for a stereo pair’s baseline: what fails a short baseline is not the algebra but the ratio of what the step changes to what the reading can resolve, and here what the step changes is a direction of sight.

On a real street that turns into a simple instruction. The second picture belongs at the end of the row, or down the side street at a corner, looking along the row rather than across it — wherever a line from the first camera through the middle of the row, turned through a right angle at the row, leads. Sixty to seventy-five degrees round is nearly as good and keeps the posts from hiding each other.

What the second picture cannot change is the floor the first essay found under every reading of a lean. Each picture’s vertical comes from its corners, and a facade’s corners see the horizon is where that vanishing point’s precision was first measured: a building’s corners fix it far better than its widths, but not exactly, and the error is shared by every post that picture reads. It sets a floor no number of posts or pictures goes under, which is the shape the floor a better camera cannot reach found for every measurement closed by an assumption. Two pictures with their own corners have two such floors, in the two components each reads best, and together they are the floor of the pair.

What the pair takes on trust

Each picture’s vertical is read correctly. Both pictures rest on a pair of plumb corners, as the first essay’s did, and a leaning post is worth its lean is the reminder that a corner taken as plumb when it is not moves every reading in that picture together. Two pictures with two buildings have two such chances to be wrong, and a corner’s error in one picture appears as a lean shared by the whole row in the components that picture reads best.

The posts are straight. A post that bends, or whose top is a lamp bracket overhanging to one side, has no single line; each picture fits its own line to whatever part it sees, and two pictures from different sides can fit different lines to the same post.

Every post is seen whole in both pictures. At ninety degrees round the posts stand one behind another in the second picture. Here each was read as if the one in front were transparent; in a real picture the nearer posts hide parts of the farther ones, and which parts depends on the row’s spacing and the posts’ width. That is one more reason to stand at sixty or seventy-five degrees rather than ninety.

The ground is level. A lean is measured against the vertical, not the ground, so a sloping pavement changes nothing about the reading; but a photographer who expected the posts to stand square to the pavement on a slope would call every one of them leaning, by the slope, in the direction it runs.

Still open: whether a third picture fills the hole the second leaves

At any angle other than ninety degrees a second picture leaves one post, or a pair, read badly: the post whose sight lines to the two cameras run nearest parallel. A third picture, taken from the other side of the first — sixty degrees round to the left where the second was sixty to the right, say — has its blind post somewhere else, and between the three no post need be read badly.

The measurement that settles what that is worth reads every post from three pictures with three equations in two unknowns, solves each post by least squares, and asks how much the worst post’s reading improves over the best pair; whether three pictures at sixty degrees either side of the first, which see the row spread across their frames and need no building at right angles, catch as many of the hidden posts as two at a right angle with a building of its own; and whether, with three pictures, the posts can after all fix the second and third pictures’ verticals between them, since three equations a post leave one to spare.

What links here

Computed from the collection, not written here: the essays that point at this one.

Shares its objects with

Essays that name at least two of the same things, and that neither author linked.

Named objects

A flat tag is an object no other essay names yet.

Identifiabilityleast squaresModel errorsingle-view metrologyTriangulationVanishing point