What survives

Two circles, one picture

A photographed circle leaves its own pose ambiguous, and not a little: two congruent circles in planes 23.6° apart draw the same conic to 1.1e-16 on normalised coefficients, both of them in front of the camera. On top of that the distance is free, so the family is two discrete poses each with one continuous parameter — and a plane one degree from either draws a conic 2.5e-4 away, which is what makes the agreement a measurement.

Worth reading first: Five marks and the sixth · What one picture of a plane determines.

A circular marker is the most useful thing anybody can put in front of a camera. It is easy to make, it can be found in an image automatically, its edge is a curve rather than four corners that have to be ordered, and five marks on it determine its picture exactly.

It is also, on its own, ambiguous — and the ambiguity is not the mild kind that shrinks when the picture is sharper. Two circles of the same size, in planes twenty-four degrees apart, both in front of the camera, draw the same curve to the last digit the arithmetic carries.

Two circles, differently tilted, drawing one pictureBoth are 6.4 m across and both are in front of the camera; their planes are 23.61° apart. Each draws the conic to 1.1e-16 on normalised coefficients, while a plane one degree from either draws one 2.5e-4 away — so the agreement is a measurement and the ambiguity is real. And the distance is free on top of that: at 1.7× the range the same picture is drawn by a circle 1.7× as wide.horizonflat on the groundleaning 23.6°two circles, 6.4 m across, in planes 23.6° apartcorrect from 26 cm, at 160 mm widetwo poses, 23.6° apart, one picture
Fig. 1 Both hoops are 6.4 m across, both are in front of the camera, and both draw the drawn conic to 1.1e-16 on normalised coefficients. Their planes are 23.61° apart. A plane one degree from either draws a conic 2.5e-4 away, so this is a genuine ambiguity and not a solver that has stopped noticing its input.

Where the family comes from

The reason the family exists at all is short, and it is the whole essay.

A picture is not a set of points; it is a set of rays. A conic drawn in the picture therefore names a cone of directions with its apex at the eye — every ray whose image lands on the curve. Nothing about the world has been supplied yet: the cone is the entire content of the photograph.

Now ask which circles in the world could have drawn that curve. A circle drew it exactly when the circle is a section of that cone by some plane, and the section is a circle. So the question becomes: which planes cut a given cone in a circle?

The answer is a piece of classical geometry with a definite number in it. A quadric cone has exactly two families of parallel planes that cut it in circles — its two systems of circular sections — and that is the whole ambiguity. Two plane orientations, and within each, a free choice of how far along the cone to put the plane.

A 8.8 m circle on the ground, seen from outside itThe whole conic is drawn, including the part no camera can photograph. Every point of the circle is at least 4.55 m beyond the plane through the eye, so the image is an ellipse and the camera can see all of it. B² − 4AC = -1.69e-1.horizonthe eye stands 8.78 m from the centrecorrect from 26 cm, at 160 mm wideellipse · nearest point +4.55 m
Fig. 2 The object the ambiguity is about: the cone of rays a photographed circle names. The drawn conic is one section of it; every other circular section of the same cone is a circle that would have drawn the identical picture.

Computing the two orientations

The construction is worth writing out because the ordering in it is the whole content, and getting the ordering wrong produces two plausible normals that cut the cone in ellipses — a failure with no symptom, since an ellipse is a perfectly good section.

Write the cone as a quadratic form in camera coordinates: substitute the ray direction for the image point in the conic’s equation and clear denominators, and a symmetric 3×33\times3 matrix falls out. Diagonalise it. A real cone has eigenvalues of mixed sign; order them λ1λ2λ3\lambda_1 \ge \lambda_2 \ge \lambda_3 with eigenvectors e1,e2,e3e_1, e_2, e_3. Then the circular sections are the planes with normals

n±  =  λ1λ2  e1  ±  λ2λ3  e3.n_\pm \;=\; \sqrt{\lambda_1 - \lambda_2}\; e_1 \;\pm\; \sqrt{\lambda_2 - \lambda_3}\; e_3 .

The middle eigenvalue is the one both roots are taken against. Using the largest or the smallest instead gives two directions that look entirely reasonable and are wrong, so the machinery here ends by measuring how round the section it produced actually is — the pullback of the image conic into the candidate plane has to have equal diagonal terms and no cross term, and it is checked to a part in 10710^7 before the plane is accepted.

The two normals differ by the sign, so the two orientations are mirror images of each other in the cone’s own plane of symmetry. That fact has a consequence worth reporting rather than hiding.

The two poses are congruent

At one distance from the eye, the two circles have the same radius. Not nearly the same: the same, to nine digits, because they are reflections of one another.

So the ambiguity is not a choice between a big circle and a small one, or a near one and a far one. It is a choice between two poses of the same circle — two ways of tilting a hoop of a given size so that it draws one picture. Which is exactly the ambiguity that a pose recovered from a single circular marker has, and it is why such a marker needs a second feature to break it: a mark on the rim, a concentric second circle, a known up direction.

Four camera pairs fit the same two pictures; one of them is in frontThe essential matrix recovered from 44 correspondences decomposes into two rotations and two translation signs. All four satisfy every epipolar constraint exactly. Counting how many points each puts in front of both eyes separates them at once: 44 against 0, 0, 0. The winner is the true pose to 0.0e+0°; the nearest rejected candidate is 180° away — and one of the three shares the winner's rotation exactly, differing only in walking the baseline backwards.points in front of both camerasR₁, t0 of 44180° from the truthR₁, t reversed0 of 44180° from the truthR₂, t0 of 44180° from the truthR₂, t reversed44 of 44chosenthe chosen pose is the true one to 0.0e+0°cheirality, not algebra, picks it
Fig. 3 The same phenomenon from the two-view field, where it is met as a matter of course: a decomposition that returns four poses of which the geometry admits only one. There the disambiguation is cheap, because a second camera is already present. With one circle and one camera it is not.

And on top of that, the scale

The two orientations are the discrete half. The continuous half is the one every single view has.

Move the plane along the cone, away from the eye, and the section stays a circle and grows in proportion. At 1.7 times the range, the circle that draws the same picture is 1.7 times as wide — exactly, to nine digits, because the cone is a cone and scaling about the apex is a symmetry of it.

So a photographed circle determines: a plane orientation up to a two-fold choice, and a radius-to-distance ratio. It determines no distance and no radius. That is the ordinary one-view scale ambiguity, arriving here in the cleanest form it takes anywhere on this site.

Two scenes 137× apart, and the one picture they both makeEverything in the second plan — the room, the eye's distance, the eye's own height — is 137 times the first. Every projected vertex agrees to 1e-13 px. A single photograph has no scale, and this is what that means.a room 2.8 m across, eye 1.6 m up1 mthe same plan, 137× bigger137 midenticalpicturesthe picture — both scenes, drawn twice, one on top of the otherlargest disagreement 1e-13 px over 8 verticesone length has to come from outside the picture
Fig. 4 The scale half, made unmissable elsewhere on the site: a scene photographed and then rebuilt 137 times larger, with the camera moved to match, produces a picture identical to the first. One view has no size, and a circle is no exception.
One reconstruction, drawn at its own scale and at 4.0×The courtyard recovered from two pictures, seen from above. Every pairwise distance ratio matches the world's to 4.2e-13, so the shape is exact. The size is not determined at all: the right-hand plan is the same reconstruction 4.0 times larger and fits the same two pictures equally well. One measured length in the scene — here 0.800 m — fixes it, and nothing in the pictures can.as recovered1.333 across× 4.0 — same two pictures5.333 acrossworst ratio deviation 4.2e-13size fixed only by a supplied 0.80 m
Fig. 5 And what a second view does and does not fix. Shape comes back; size does not, until something in the scene is measured.

Making it a measurement rather than a claim

An ambiguity is easy to assert and worth nothing until the alternatives can be produced and shown to be genuinely different. Three things are required, and the third is the one that takes work.

The family draws the same picture. Each recovered circle is pushed back through the projection and its image conic compared with the original on normalised coefficients. The worst disagreement is 1.1e-16, which is the arithmetic.

The members are genuinely different. Measured on the scene rather than in the picture, because a difference visible only in the picture would be the thing that was supposed to be identical. The two plane normals are 23.61° apart, and the far members of each branch are at 1.7 times the distance with 1.7 times the radius.

And a neighbour does move the picture. Take one recovered circle and turn its plane by one degree about a line in it, keeping the circle where it is on the plane. The conic it now draws differs by 2.5e-4 on the same normalised scale — nine orders of magnitude above the family’s own agreement. Without that control the first two would be satisfied by a routine that had stopped looking at its input.

Two circles, differently tilted, drawing one pictureBoth are 6.4 m across and both are in front of the camera; their planes are 23.61° apart. Each draws the conic to 1.1e-16 on normalised coefficients, while a plane one degree from either draws one 2.5e-4 away — so the agreement is a measurement and the ambiguity is real. And the distance is free on top of that: at 1.7× the range the same picture is drawn by a circle 1.7× as wide.horizonflat on the groundleaning 23.6°two circles, 6.4 m across, in planes 23.6° apartcorrect from 26 cm, at 160 mm widetwo poses, 23.6° apart, one picture
Fig. 6 The same two poses computed at a different point along the cone. The orientations are unchanged — they are properties of the cone — and both circles have grown in proportion, which is the continuous half of the family drawn rather than described.

A number for how bad it is

“Ambiguous” is a yes-or-no word and the useful question is by how much, so it is worth converting the two-fold family into something a reader can act on.

The two poses are 23.61° apart in the configuration drawn here. That is not a fixed constant: it depends on how obliquely the circle is seen. Seen square on the two coincide; seen very obliquely they separate widely, and the separation is roughly twice the tilt of the true plane away from square. So a hoop lying flat on the ground, photographed from an eye a little above it, has a phantom twin leaning back at nearly twice that tilt — which is exactly the case that arises when a circular marker is put on the floor and a camera looks down at it from head height.

The consequence for anybody using such a marker is concrete. A pose error of twenty-odd degrees is not a refinement problem; it puts an object in a visibly wrong place. And because both poses fit the marks exactly, no residual threshold anywhere in the pipeline will reject the wrong one. The disambiguation has to come from outside the circle, and it has to be built in rather than hoped for.

What breaks the tie

The ambiguity is two-fold, so it takes surprisingly little to remove it — but it does take something, and knowing what is the useful part.

A second circle. Two coplanar circles, not concentric, give two cones; the plane has to be a circular section of both, and the two-fold choices generally intersect in one. This is why calibration targets use rings of dots rather than one ring.

A mark on the rim. The two poses are mirror images, so a single asymmetric feature on the circle distinguishes them: it lands in different places in the two.

A known direction. If the circle is known to be lying flat on the ground, and the ground’s horizon is available from anything else in the picture, the pose whose plane matches is the answer.

Or a second view. Two cones from two eyes intersect in the circle, and the ambiguity is gone — at the cost of the thing a single view was chosen to avoid.

What does not break it is more marks on the same circle. Twenty marks give a better-conditioned conic and exactly the same two-fold family, because the family is a property of the conic and not of how well the conic was estimated. That is the distinction worth carrying away: precision and ambiguity are different axes, and improving one does nothing whatever to the other.

Another picture of the same sweep buys nothingTwo ways of adding views to the courtyard, every mark read to 1 px. Filling in a fixed 1.6° sweep leaves the worst camera-centre error at 2.1e-2 where 3 views gave 2.8e-2. Widening the sweep by 12° per view improves it from 3.2e-3 to 1.3e-3 and then flattens as well. What the reconstruction is short of is angular spread, not pictures. At every point on both curves the Jacobian has exactly 7 flat directions.-3-2.50-2-1.5034567number of viewsworst camera-centre error (fraction of the track's mean radius, log scale)7 flat7 flat7 flat7 flat7 flat1.6° sweep, filled in12° per view, wideningfilled in: 2.8e-2 → 2.1e-2widened: 3.2e-3 → 1.8e-3
Fig. 7 Precision against ambiguity, from the many-view field. Adding views buys accuracy on a curve that flattens; what it buys against an ambiguity is not on this plot at all, because an ambiguity either survives a configuration or does not.
Three solids, and two pictures that cannot tell them apartMembers of the one-parameter family two parallel views leave. Each redraws both of the pictures it was built from to 7e-16 m, and each is a different solid — the departure from a similarity of the scene runs from 1.00 to 8.59. The scene is one of them and the pictures do not say which.stretch 2.09redraws both to 7e-16 mstretch 1.00redraws both to 6e-16 mstretch 8.59redraws both to 7e-16 mone family, three membersthe two pictures are identical for all of them
Fig. 8 The same distinction in its purest form on this site. A one-parameter family whose members redraw both pictures exactly and differ from the scene by stretch ratios up to eight and a half — no amount of accuracy in the pictures touches it.

The two branches, drawn from the cone

It is worth seeing why the two orientations are mirror images rather than two unrelated tilts, because the reason makes the count of two look inevitable.

A cone over a conic has three principal axes — the eigenvectors of its quadratic form — and the middle one is an axis of symmetry for the pair of circular sections. Reflect the whole configuration in the plane perpendicular to the largest axis and the cone maps to itself while the two normals swap. So the two branches are not two solutions the algebra happened to find; they are one solution and its image under a symmetry the cone always has.

That also explains why the two coincide when they do. The reflection is trivial exactly when λ1=λ2\lambda_1 = \lambda_2, which is when the cone is right circular, which is when the circle is seen square on. The ambiguity does not disappear because a better method was used; it disappears because the symmetry became the identity.

And it explains what raising the number of marks cannot do. The symmetry is a property of the cone, and the cone is determined by the conic; twenty marks give the same conic more accurately and hand back the same symmetry.

A 14.0 m circle on the ground, seen from outside itThe whole conic is drawn, including the part no camera can photograph. Every point of the circle is at least 1.98 m beyond the plane through the eye, so the image is an ellipse and the camera can see all of it. B² − 4AC = -3.27e-1.horizonthe eye stands 8.78 m from the centrecorrect from 22 cm, at 160 mm wideellipse · nearest point +1.98 m
Fig. 9 One conic, one cone, and the whole family behind it. Everything the photograph contains about the circle is in the shape of this curve; everything the curve contains about the circle is two poses and a ratio.

Standing on the boundary

There is one configuration where the two poses coincide, and it is worth naming because it is the one people accidentally use.

When the circle’s plane is perpendicular to the line from the eye to its centre — the circle seen square on — the cone is a right circular cone, its two circular-section families coincide with each other and with the plane the circle is in, and the ambiguity collapses. The image is a circle, and nothing is uncertain except the scale.

Which sounds like the case to arrange. It is the worst possible case for anything else: seen square on, a circle’s image says almost nothing about the tilt, because the derivative of the image with respect to the tilt vanishes there. A tilt of one degree away from square changes the image by a second-order amount; the same one degree at forty degrees of tilt changes it by a first-order amount.

So the pose is unambiguous exactly where it is least well determined, and it is well determined exactly where it is two-fold. That is not a coincidence — both are consequences of the same symmetry — and it is the sort of trade a reader should expect from any single-view recovery.

A sphere 30° off the axis of a 96° frameOn the paper it is an ellipse 1.156 times as long radially as across, against the 1/cos θ of 1.155 the geometry predicts. From the station point every point of that same ellipse is 5.0000° from its axis, and the spread across 720 of them is 3e-13° — it is a circular cone after all.drawn: 1.156 : 1subtended at the station point: 1.000000000 : 1the faint circle is the mean radius, for comparisonthe drawn centre sits 1.84 px from the axis's own mark
Fig. 10 The neighbouring effect, and a caution against reading too much into the shape of an imaged circle. A sphere thirty degrees off the axis draws an ellipse too, for reasons that have nothing to do with any tilt — the cone through the eye is cut obliquely by a flat picture plane.
An elation: the centre has fallen onto the axisThe axis is still fixed pointwise and the centre now lies on it, so no point off the axis is fixed and there is no ratio to state.faint dots: before · solid: afterelationno ratio
Fig. 11 The census this belongs to. A map of the plane is classified by the structure it leaves fixed, and the two-fold family above is what happens when a picture is asked to name a map rather than to apply one.

Why the cone is the right object to think about

There is a habit worth taking from this essay that has nothing to do with circles.

The temptation with any single-view recovery is to reason about the picture: this curve is an ellipse of such-and-such eccentricity, so the plane is tilted by so much. That reasoning works and it is fragile, because eccentricity is not projectively meaningful — it depends on the picture’s own frame, so every conclusion drawn from it has the focal length and the principal point smuggled into it.

Reasoning about the cone avoids all of that. The cone is what the picture is: a bundle of directions through one point, with no frame attached. Every question about what could have produced the picture becomes a question about sections of the cone, and every answer comes out in terms the camera cannot influence.

The two-fold ambiguity is the clearest example. It is a property of a cone’s eigenvalues, so it survives changing the lens, cropping the picture, tilting the film, or re-photographing a print of the photograph. An account in terms of the drawn ellipse would have had to be redone for each of those; the account in terms of the cone does not notice them.

That is also why the ambiguity cannot be argued away. A statement about a cone’s symmetry is not a statement about a method, so there is no better method.

The shape of the result

Written out, the answer to “what does one photograph of a circle determine” is this.

The conic: exactly, from five marks, with no fitting.

The plane’s orientation: up to a two-fold choice, the two members being mirror images in the cone’s symmetry plane, 23.6° apart in the case drawn here and coinciding when the circle is seen square on.

The radius and the distance: only their ratio.

And the circle’s own position within its plane: exactly, once the plane is chosen — because the section of the cone by that plane is one definite circle.

Which is a great deal for one curve and one photograph, and it is short of a pose by precisely one bit and one number. The bit costs a mark on the rim; the number costs a ruler somewhere in the scene.

A 3.4 m object measured from one picture, 14 m awayThe base, the horizon crossing, the top and the vertical vanishing point have a cross-ratio of 1.9101. With the eye at 1.62 m that gives 3.400 m, against a true 3.4 m. The camera is not consulted.horizon — the eye's own heightbase — 0 mhorizon crossing — 1.62 mtop — 3.40 m recoveredthe vertical vanishing point is 8586 px above this framerecovered 3.400 m · true 3.400 m2.3 cm per pixel of click error
Fig. 12 What the missing number costs, in the field that has to pay it most often. A height from one photograph is a ratio until something in the picture has a known size, and then it is a length.
Projective, affine, metric — what each stage buysThe photograph fixes the plane only up to a projectivity: the midpoint of a receding side lands 0.3970 of the way along. Supplying the plane's vanishing line buys the midpoint back exactly and nothing else. Supplying the image of one circle buys the last three numbers, at which point the right angle is 90.000° and two equal sides measure 1.000000. The cross-ratio is 1.333333 in all three, because it was never lost.projectiveaffinemetricmidpointtwo equal sidesa right anglecross-ratioprojective1.333333333affine0.5000001.333333333metric0.5000001.00000090.000°1.333333333— means the stage does not determine it at allcross-ratio 1.333333 throughout
Fig. 13 And the ladder the two missing pieces sit on. Each rung is one assumption about the scene, and the circle buys two of them at once — which is why it is the marker everybody reaches for, ambiguity and all.

Shares its objects with

Essays that name at least two of the same things, and that neither author linked.

Named objects

A flat tag is an object no other essay names yet.

centre of projectionCircleConicdegrees of freedomEigenvaluesPicture planepoint at infinityProjective mapreconstruction ambiguityscale ambiguitysingular values