Mirrors that are not cameras

The wall convicts a pair set too wide

A window set wider than its partner's reflection keeps every joining line on the mirror's point, so the one test a symmetric photograph was known to carry cannot see it. The wall the other pairs fix can: it says where the partner should be seen, and a window set ten centimetres too wide misses by 6.0 pixels. With marks read to 0.4 px it convicts a 3-centimetre offset eight or nine times in ten and a 5-centimetre one every time. What no single photograph can see is a move along the camera's own ray to the window.

Worth reading first: One shutter, two views · The one thing a single view cannot give.

Two wide pairs are most of a symmetry read a partly symmetric facade from one photograph — twelve pairs of marks across a symmetric frame, eight lone marks in an asymmetric middle — and found that very little of an object has to be symmetric for the reading to work. It ended on the danger that remained. A pair that is not a pair, a window set a little wider than its partner, keeps every joining line through the mirror’s point to 2×10−132\times10^{-13} pixels, because a move along the symmetry plane’s normal slides a mark along its own joining line. The concurrence, the test a symmetric object is its own stereo pair built, is blind in exactly the direction a facade’s windows most often err.

The essay named the test that might cover the gap: the false pair’s recovered points lying off the wall the other pairs fix. That test turns out to be better than a complement. It sees every direction a pair can be wrong in but one, and the one it misses is a direction no photograph can see.

What the wall predicts

The facade and the photograph are the earlier essay’s: a gabled front seen from 34 degrees round, twelve pairs of marks, a symmetry plane found from the pairs’ joining lines. The test works pair by pair. Fit the front wall to the recovered points of every other pair that lies on it. Carry the suspect pair’s left mark along its ray to that wall, reflect the point in the fitted symmetry plane, and project the reflection into the photograph. That is where the wall says the partner should be seen, and the test is how far the partner’s own mark lies from it.

A window set 10 cm too wide keeps the joining lines concurrent to 6e-13 px and misses the wall's prediction by 6.0 px: the wall sees the one direction the concurrence cannotThe partly symmetric facade, twelve pairs, exact marks, the widest pair made false by moving its right half. The wall's test fits the front wall to every other pair's recovered points, carries the pair's left mark along its ray to that wall, reflects it in the symmetry plane and asks how far the partner's mark lies from where the reflection is seen. Moved wider, along the symmetry plane's normal, by 2, 5, 10, 15, 20 cm: the concurrence reads 7e-13, 8e-13, 6e-13, 7e-13, 7e-13 px and the wall's test 1.21, 3.02, 6.02, 9.00, 11.96 px — about 0.60 px a centimetre, and the pair's points 6.0 cm off the wall at 10 cm. Moved higher by the same distances: the concurrence 3.5, 8.6, 17.0, 25.2, 33.5 px, the wall's test 0.8, 2.1, 4.3, 6.7, 9.1 px. Each test sees a direction; together they see both.010203005101520how far the false pair's right half is moved (cm)what each test reads (px)concurrence, moved widerthe wall's test, moved widerconcurrence, moved higherthe wall's test, moved highertwelve pairs, exact marks, the widest pair falsetwo tests, two directions
Fig. 1 The widest pair made false, exact marks. Moved wider along the normal, 2 to 20 cm: the concurrence reads 7e-13 px throughout, the wall’s test 1.21 to 11.96 px, 0.60 px a centimetre. Moved higher by the same: the concurrence 3.5 to 33.5 px, the wall’s test 0.8 to 9.1.

With exact marks and every pair true, the wall predicts every partner exactly. Set the widest pair’s right half wider than its reflection and the two tests part company. The concurrence stays at 7×10−137\times10^{-13} pixels however far the half is moved, as the earlier essay found. The wall’s test grows in proportion: 1.21 pixels at two centimetres, 6.02 at ten, 11.96 at twenty — about 0.60 pixels for every centimetre. Drag the offset and the two rings part: the one on the concurrence stays on the floor of the plot at every setting, while the one on the wall’s test climbs a straight line away from it. The false pair’s two triangulated points lie 6.0 centimetres off the wall at a ten-centimetre offset, which is the depth error the offset introduced.

Moved higher instead, the pair fails both tests: the concurrence opens by 3.5 to 33.5 pixels and the wall’s test by 0.8 to 9.1. So the wall sees what the concurrence sees, and it also sees what the concurrence cannot.

The reason is what each test compares. The concurrence asks whether the pair’s joining line runs through the mirror’s point, which is a statement about the pair alone and the symmetry plane’s direction. The wall’s test asks whether the pair’s partner is where the rest of the facade says it must be, which uses the plane’s direction, its position through the fitted wall, and every other pair’s points. A move along the normal slides the partner along its joining line — invisible to a test about lines — but moves it off the place the wall predicts.

How small an offset it convicts

With exact marks any offset shows. With marks read to 0.4 pixels the question is how large an offset must be before the test reads more on the false pair than it reads, by chance, on a true one.

With marks read to 0.4 px the wall convicts a window set 3 cm too wide 80–91 times in a hundred, and one set 5 cm too wide every timeTwelve pairs, marks read to 0.4 px, one pair made false by setting its right half wider along the normal; 100 pictures a point. A pair is convicted when the wall's test reads more than it does on that pair, true, in 95 pictures of a hundred — 1.35 px for the pair 2.60 m wide, 1.37 px for the pair 1.72 m wide, 1.40 px for the pair 0.90 m wide. Share convicted at 1, 2, 3, 4, 5, 8 cm: 2.60 m pair 17%, 41%, 80%, 97%, 99%, 100%; 1.72 m pair 15%, 51%, 84%, 99%, 100%, 100%; 0.90 m pair 14%, 58%, 91%, 100%, 100%, 100%. The test's reach hardly depends on the pair's width: a narrow pair's joining line is fixed less well, but the wall's prediction of its partner is fixed by the other pairs, not by itself.00.2500.5000.75012468how far wider the false pair's right half is set (cm)share of pictures whose wall convicts ittrue pairs flaggedpair 2.60 m widepair 1.72 m widepair 0.90 m widemarks read to 0.4 px, 100 pictures a point, 5% false alarmsa few centimetres
Fig. 2 Marks read to 0.4 px, one pair set wider along the normal, 100 pictures a point; convicted when the wall’s test exceeds what the true pair reads one picture in twenty (1.35–1.40 px). Set 3 cm wide: 80%, 84% and 91% for pairs 2.60, 1.72 and 0.90 m wide. Set 5 cm wide: 99–100%.

The threshold is set where a true pair’s own reading exceeds it one picture in twenty: 1.35 pixels for the widest pair, 1.40 for a pair ninety centimetres wide. A pair set a centimetre too wide is convicted about one time in seven — little better than the one-in-twenty the threshold allows on true pairs. Two centimetres, about half the time. Three centimetres, eight or nine times in ten. Four and five centimetres, every time or nearly.

The test’s reach hardly depends on the pair’s own width, which is the opposite of the earlier essay’s finding for the symmetry plane itself. There, wide pairs fixed the plane far better than narrow ones, because a pair’s joining line is fixed by the distance between its marks. Here the pair’s own line hardly matters: the prediction of where its partner should be is made by the wall and the plane, which the other pairs fix. A narrow window is judged by the facade’s wide frame, and judged as well as a wide one.

That answers the question the earlier essay closed on. A window set five centimetres too wide lies measurably off its own wall, and one set three centimetres too wide usually does. For a facade read from one photograph at this distance and resolution, the two tests together leave no false pair of that size unexposed — with the one exception drawn at the end.

Why the threshold is about a pixel and a third

The threshold is not a choice; it is what the photograph’s own reading error leaves, and it can be accounted for. The partner’s mark is read to 0.4 pixels in each direction. The prediction it is compared with is built from the left mark, read to the same 0.4 pixels, carried to a wall that the other pairs’ marks fix a little uncertainly and reflected in a plane that their joining lines fix a little uncertainly. Each of those adds its share, and the discrepancy on a true pair ends up with a typical size of about 0.6 pixels in each direction. A distance in the picture built from two such independent errors exceeds 1.35 pixels about one time in twenty, which is where the figure puts it.

Converted by the test’s own response, 0.60 pixels a centimetre, that threshold is a little over two centimetres. That is the test’s resolution at this distance and this focal length: a partner more than about two centimetres from where its reflection should be starts to show, and one more than four shows every time. For a facade seven metres away photographed on a sensor that resolves a centimetre of wall into about 0.9 pixels, it is roughly the size of a window reveal misjudged by a mason, or a frame fixed a finger’s width off its partner’s line — small errors, but the ones a symmetric facade actually has.

The same account says how the test scales. Everything in it is a length in pixels, so a photograph taken from half the distance, or with twice the focal length, doubles the response to a centimetre of offset and leaves the reading error in pixels where it was; the test’s resolution in centimetres halves. A photograph taken twice as far away needs twice the offset before the wall can see it. The one thing that does not scale is the direction the test is blind to, which is set by where the camera stands and not by how far.

The wall has to be there

The test borrows everything from the other pairs, and so it is only as good as the wall they give it.

The wall's test needs the wall: with 5 pairs it convicts a 3 cm false pair 28 times in a hundred, with 12, 82The widest pair made false by 3 cm along the normal, and the wall fitted from the other pairs among the first k taken widest first, marks read to 0.4 px, 100 pictures a point, each at the threshold true pairs exceed one picture in twenty. 5 pairs (3 on the wall, the false one included): threshold 2.41 px, 28%; 6 pairs (4 on the wall, the false one included): threshold 2.35 px, 30%; 8 pairs (6 on the wall, the false one included): threshold 1.80 px, 47%; 10 pairs (7 on the wall, the false one included): threshold 1.60 px, 65%; 12 pairs (9 on the wall, the false one included): threshold 1.28 px, 82%. With few pairs the wall is fixed by few points, so its prediction of the partner scatters and the threshold rises; the symmetry plane, which the prediction also needs, is fixed better by the same added pairs.00.2500.5000.75015681012pairs used, widest firstshare convicting a 3 cm false paira 3 cm false pair, 0.4 px marks, 100 pictures a pointmore wall, better wall
Fig. 3 The widest pair set 3 cm wide, the wall fitted from the other pairs among the first k taken widest first, 0.4 px marks. With 5 pairs (3 on the wall) the threshold is 2.41 px and the pair is convicted 28% of the time; with 8, 1.80 px and 47%; with 12 (9 on the wall), 1.28 px and 82%.

With five pairs, three of them on the front wall, the wall is fixed by four points besides the suspect pair’s, and a true pair’s reading scatters to 2.41 pixels one picture in twenty; a three-centimetre offset is convicted 28 times in a hundred. With eight pairs the threshold falls to 1.80 pixels and the conviction rate rises to 47. With all twelve, nine of them on the wall, it is 1.28 pixels and 82 per cent.

Two things improve together as pairs are added. The wall is fixed by more points, so its place along the suspect pair’s ray is better known; and the symmetry plane, which the prediction reflects through, is fixed by more joining lines. Two matches are enough found that two pairs fix the mirror’s point exactly with exact marks; with marks read to a fraction of a pixel, the wall’s test wants many more, and wants them on the wall.

Pairs that do not lie on the wall — the back corners of the building, the gable’s ridge — cannot be tested this way at all, since there is no fitted surface to carry their marks to. For those the concurrence is the only one-picture test, and the direction along the normal remains its blind spot.

Where to stand

The earlier essay found that standing further round the facade fixes the symmetry plane better. For the wall’s test, the opposite holds, and for a reason that is easy to draw.

Where the camera stands decides the wall's reach: a 3 cm false pair is convicted 96 times in a hundred from 12° round and 13 from 70°The widest pair made false by 3 cm along the normal, twelve pairs, marks read to 0.4 px, the camera at 12, 23, 34, 46, 58, 70 degrees round from square on. How far the wall's test moves for each centimetre: 0.82 px, 0.72 px, 0.60 px, 0.48 px, 0.37 px, 0.28 px; the level true pairs exceed one picture in twenty: 1.41 px, 1.30 px, 1.28 px, 1.26 px, 1.43 px, 2.23 px; the share convicted: 96%, 94%, 82%, 64%, 37%, 13%. A move along the symmetry plane's normal is seen side-on from square on and end-on from far round, so the test's response falls as the camera goes round; its scatter falls too, because the symmetry plane is fixed better from further round.00.2500.5000.7501122334465870where the camera stands, degrees round from square onshare convicting a 3 cm false paira 3 cm false pair, twelve pairs, 0.4 px marksthe normal seen side-on or end-on
Fig. 4 A 3 cm false pair, twelve pairs, 0.4 px marks, the camera at 12° to 70° round from square on. The test moves 0.82 px a centimetre at 12° and 0.28 at 70°; true pairs reach 1.41 and 2.23 px one picture in twenty; the false pair is convicted 96% of the time at 12°, 82% at 34° and 13% at 70°.

A move along the symmetry plane’s normal is a move across the facade. Seen from near square on, it is seen side-on, and the partner’s image moves by the most it can: 0.82 pixels a centimetre at twelve degrees round. Seen from far round, it is seen more nearly end-on — the move points increasingly along the line of sight — and the image moves less: 0.28 pixels a centimetre at seventy degrees. The threshold, meanwhile, is about 1.3 pixels from twelve to forty-six degrees and climbs to 2.2 at seventy, where the wall is foreshortened and fixed less well. So a three-centimetre false pair is convicted 96 times in a hundred from twelve degrees round, 82 from thirty-four and 13 from seventy.

Square to the camera is the worst mirror found that a symmetric object seen square on is read badly, because its joining lines are nearly parallel and cross far away. The best place to stand is therefore a compromise between two tests that want opposite things: the symmetry plane wants the camera well round, and the check on false pairs wants it near square. Somewhere between a quarter and a third of the way round does both reasonably, which is where the earlier essay’s photograph was taken.

Every direction a pair can be wrong in

A real false pair is not wrong along a chosen axis; its half is wherever the builder put it. The last two figures ask which directions of wrongness the two tests catch between them.

A false pair 5 cm out in any direction is caught by one test or the other at least 51 times in a hundredThe pair 1.72 m wide made false by moving its right half 5 cm in a stated direction, marks read to 0.4 px, 100 pictures each; each test convicts at the level it reaches on true pairs one picture in twenty (concurrence 23.88 px, wall 1.37 px). wider (along the normal): concurrence 3%, wall 100%, either 100%; higher: concurrence 87%, wall 100%, either 100%; deeper into the wall: concurrence 4%, wall 100%, either 100%; wider and higher: concurrence 15%, wall 100%, either 100%; wider and deeper: concurrence 4%, wall 48%, either 51%. The concurrence sees what moves a pair off its joining line and the wall sees what moves it along the line or off the wall, so a move along the normal is the wall's alone, a move straight up mostly the concurrence's, and a move into the wall both tests see.wider (along the normal): concurrence3%the wall's test100%either100%higher: concurrence87%the wall's test100%either100%deeper into the wall: concurrence4%the wall's test100%either100%wider and higher: concurrence15%the wall's test100%either100%wider and deeper: concurrence4%the wall's test48%either51%5 cm out, 0.4 px marks, 5% false alarms eachtwo tests, every direction
Fig. 5 The 1.72 m pair’s right half moved 5 cm, 0.4 px marks, each test at its one-in-twenty level (concurrence 23.88 px, wall 1.37 px). Wider: concurrence 3%, wall 100%. Higher: 87% and 100%. Deeper into the wall: 4% and 100%. Wider and higher: 15% and 100%. Wider and deeper: 4%, 48%, either 51%.

Five centimetres in four of the five directions, the wall’s test convicts every time. The concurrence, read at 0.4 pixels, is much the weaker test: with twelve pairs of different widths, the narrow pairs’ joining lines are fixed poorly, and a true set of pairs misses its common point by up to 23.9 pixels one picture in twenty. It catches a pair moved five centimetres straight up 87 times in a hundred and almost nothing else. On this facade, with a wall to test against, the wall’s test does nearly all the work.

The fifth direction, wider and deeper, is caught only half the time by either test, and that is not an accident of the facade.

Moved 5 cm in any level direction, a false pair is caught by one test or the other except near 40° — along the camera's own ray to it, which no single picture can seeThe pair 1.72 m wide made false by moving its right half 5 cm in a direction swept round the level plane, from straight wider along the symmetry plane's normal (0°) through into the wall (90°) and out of it (−90°); marks read to 0.4 px, 100 pictures a direction, each test at its one-in-twenty level. The wall's test: 100, 100, 100, 100, 100, 100, 100, 100, 100, 100, 100, 89, 79, 52, 57, 80, 98, 99, 100%; the concurrence: 8, 8, 7, 5, 5, 5, 5, 5, 5, 3, 4, 4, 4, 5, 4, 4, 4, 4, 4%; either: 100, 100, 100, 100, 100, 100, 100, 100, 100, 100, 100, 90, 82, 56, 60, 81, 98, 99, 100% at -90, -80, -70, -60, -50, -40, -30, -20, -10, 0, 10, 20, 30, 40, 50, 60, 70, 80, 90°. The dip is at 40°, where either test convicts 56 times in a hundred; the camera's ray to the moved half runs at 45° in this sweep (the rule). A point moved along the ray through it lands on the same pixel, so its picture has not changed at all, and nothing read from that picture can say it moved.00.2500.5000.7501-90-4504590direction of the false half's 5 cm move in the level plane (0: wider; 90: into the wall)share of pictures convicting itthe camera's raythe wall's testthe concurrenceeitherpair 1.72 m wide, 5 cm moves, 0.4 px marksblind only along the ray
Fig. 6 The 1.72 m pair’s half moved 5 cm in every level direction, 0° wider, 90° into the wall; 100 pictures each. Either test convicts it every time from −90° to 10° and from 70° to 90°, and only 56 times in a hundred at 40° — beside 45°, where the camera’s ray to the moved half runs (the rule).

Swept round the level plane, the wall’s test convicts a five-centimetre move every time from −90 degrees through straight wider to ten degrees past it, and again from seventy degrees to straight into the wall. Between, it dips to 52 per cent at forty degrees and 57 at fifty, and the concurrence adds almost nothing there. The camera’s ray to the moved half runs at forty-five degrees in this sweep.

A point moved along the ray through it lands on the same pixel. Its photograph has not changed at all, and nothing read from that photograph can say it moved — not the concurrence, not the wall, not any test that could be invented. A five-centimetre move exactly along the ray is invisible, and moves near it are seen only by their small component across it. The image of the other eye is where this collection’s reading of two photographs begins, and it is the reason a second photograph exists: a second eye’s rays cross the first’s, and a move along one eye’s ray is a move across the other’s.

What the two tests are

It is worth being exact about what has been built. The concurrence is a test the symmetry supplies from the pairs alone, with no surface and no assumption beyond the symmetry; it sees any move that takes a pair off its joining line and none that slides a pair along it. The wall’s test borrows two assumptions — that the pairs on the front wall lie on one plane, and that the suspect pair is on it too — and in exchange it sees any move that changes where the partner is seen, which is every move but one.

The one it cannot see is set by the camera, not by the facade. One shutter, two views described a mirror’s photograph as two views taken at once; a symmetric object is the same pair of views with the mirror built in, and a pair of views of one point can disagree about the point only in the direction both views look along. For a mirror pair, the two views of the partner are the camera’s ray to it and the reflected camera’s ray to its reflection. A move of the partner along the camera’s own ray changes neither view that the photograph contains.

So the earlier essay’s worry has a precise answer. A single photograph of a partly symmetric object, read against its wall, has a complete check for false pairs up to one direction per pair — the camera’s ray to the pair’s second half. A window set wider than its partner is caught unless it happens to be set wider along that ray, and the facade seen from about thirty degrees round makes that a direction some forty-five degrees away from the one a builder’s error usually takes. Two mirrors are three cameras is where a second mirror gives a third view; a second photograph from another side gives the same, and closes the last direction.

What was assumed

The front wall is flat and carries the suspect pair. The test carries the left mark to the wall the other pairs fix, and a window set in a projecting bay, or a pair of balconies, is off that wall by design; the test then convicts an honest pair by its relief, as the corners’ plane did for the shifted windows of a facade matched a column out.

One pair is false. A facade with several false pairs pulls the fitted wall and plane towards them, and a threshold set on true pairs is then too generous. Testing each pair against a wall fitted without it, as here, limits the damage but does not remove it.

Marks are read independently to 0.4 pixels. The corners of a real facade are read better than the middle of a window’s edge, and a reading weighted by each mark’s own precision would favour the wall’s test further, since the wall is fixed mostly by corners.

Still open: whether a false pair can be named rather than only detected

The tests here say that a pair is false. They do not say which of its two halves is wrong, nor by how much. A false pair has two marks, either of which could be the one out of place, and the wall’s prediction runs from left to right; run it from right to left as well and there are two discrepancies, one for each half.

The measurement that settles whether the pair’s fault can be located takes the facade with one half of one pair moved by a stated vector, computes the wall’s prediction of each half from the other, and asks whether the two discrepancies — their sizes and directions in the picture — identify which half moved and recover the move itself, in centimetres, up to its component along the camera’s ray. If they do, a reader of one photograph can not only reject a false pair but correct it, and keep the pair’s information rather than throwing the pair away.

Shares its objects with

Essays that name at least two of the same things, and that neither author linked.

Named objects

A flat tag is an object no other essay names yet.

ConditioningCorrespondenceEpipoleFundamental matrixMirror planeReconstructionscale ambiguityStereo pair