The rectangle behind the lens

A tracked post reads the bend, if the speed is known

A rolling camera aimed at a bend's centre passes across its roadside posts rather than towards them: in half a second a post twelve metres out moves from 12.0 to 12.8 metres away and its lean changes by five per cent. Followed through those sixteen frames it is one lean read sixteen times, and one lean is a ratio of the car's speed to the bend's radius. With the speed known it reads the radius as 49.9 metres (48.1–52.9), closer than eight posts in a single frame; with it unknown, it reads nothing. Aimed forty-five degrees ahead, the camera closes on the post, its lean doubles, and one post gives both.

Worth reading first: A frame is an interval · Every row is a different camera.

A rolling frame on a bend is a coarse curvature gauge found that a camera whose rows are read one after another, on a car rounding a bend, leans every upright post in its picture by an amount that lies on a straight line in one over the post’s range — crossing zero exactly at the range of the bend’s centre. Eight posts in one frame, their tops read to half a pixel, gave a 50-metre bend back as 44.6 metres with quartiles from 35 to 74; averaged over sixteen frames, 50.9 (47–55). That averaging pretended the posts kept their ranges while the car drove past them.

The essay ended by proposing the honest version. A moving car sees each post at a different range in each frame, so a single post tracked through many frames samples the line over a range of distances — including, perhaps, the far part where the line’s intercept is decided. If one post seen at many ranges is worth as much as many posts seen at one, a camera needs only one lamp post it can follow round the bend.

Whether it does depends on where the camera is pointing, and on whether the car knows its own speed.

What a followed post does

The car is the earlier essay’s: a 50-metre bend at ten metres a second, a camera 1.5 metres up whose rows are read over a thirtieth of a second — every row is a different camera, each a little further round the bend — posts three metres tall. Each frame is read about its own moment, a thirtieth of a second after the last, and a frame is an interval, not an instant, which is why a post leans at all. A post standing still beside the road is seen in frame k from wherever the car is then, at a range and bearing of its own, and by the bend’s symmetry its lean in that frame is exactly the single-frame law at that range and bearing, which a direct trace of the rolling image confirms to nine decimal places.

Aimed 45° ahead of the bend's centre, a post 12 m out ends half a second of frames leaning 2.15 times as much as it began, from 12.0 m to 8.9 m awayA rolling camera on a car rounding a 50 m bend at 10 m/s, read top to bottom over a thirtieth of a second, aimed 45° from the bend's centre towards the direction of travel. Three posts 3 m tall, 12, 25, 60 m out along the camera's axis at the first frame, followed through sixteen frames; each frame's lean is the single-frame law at the post's own range and bearing then. The 12 m post: from 12.0 to 8.9 m, bearing −16.3° at the last frame, lean 23.52 to 50.49 thousandths; the 25 m post: from 25.0 to 21.6 m, bearing −3.2° at the last frame, lean 5.07 to 8.96 thousandths; the 60 m post: from 60.0 to 56.4 m, bearing 2.3° at the last frame, lean −5.06 to −4.93 thousandths. A camera looking at the centre moves across its posts and barely changes their range; one looking ahead closes on them, and their leans sweep. The slider turns the camera.020406003691215frame, a thirtieth of a second apartthe post's lean, thousandthspost 12 m outpost 25 m outpost 60 m outa 50 m bend at 10 m/s, aimed 45°sixteen frames, half a second
Fig. 1 Posts 12, 25 and 60 m out along the camera’s axis, followed through sixteen frames, the camera aimed 45° ahead of the bend’s centre. The 12 m post closes from 12.0 to 8.9 m and its lean grows from 23.5 to 50.5 thousandths, 2.15 times. The slider turns the camera; aimed at the centre, the same post goes from 12.0 to 12.8 m and its lean falls from 39.05 to 37.15 thousandths.

The earlier essay’s camera looked straight at the bend’s centre, sideways out of the car. The slider shows what that means for a followed post: the car moves across the post’s line of sight, not along it. In half a second the post twelve metres out drifts from 12.0 to 12.8 metres away and seventeen degrees across the picture, and its lean falls from 39.1 thousandths to 37.2, five per cent. The post at 25 metres changes by two per cent; the one at 60, near the bend’s centre, by nothing. Followed through sixteen frames, a post seen by that camera does not sweep the line in one over range. It sits on one point of it.

Turned forty-five degrees towards the direction of travel, the camera looks along the road as well as across it, and the car closes on its posts. The twelve-metre post comes in to 8.9 metres and its lean more than doubles, to 50.5 thousandths. That is the sweep the earlier essay expected, and it happens only for a camera that looks ahead.

Why one camera sweeps and the other does not

The difference between the two cameras is the angle at which the car’s travel meets the line of sight, the same angle that turning and travelling blur different worlds found deciding which kind of motion a picture records. A post’s range changes at the car’s speed times the cosine of that angle. Aimed at the bend’s centre, the line of sight is square to the direction of travel, the cosine is zero, and the range changes only at second order — by the square of the distance travelled over twice the range, which for five metres of travel and a post twelve metres out is about a metre. Aimed forty-five degrees ahead, the cosine is 0.71 and the car closes on the post at seven metres a second; in half a second that is three and a half metres, and a post at twelve metres comes in to under nine.

The lean depends on the range through one over it, so the change that matters is in the reciprocal, and that is largest for the nearest posts: the twelve-metre post’s reciprocal range grows by more than a third as the forward camera closes on it, while the sixty-metre post’s grows by six per cent. Far posts barely sweep for either camera. What sweeps the line is a near post seen by a camera that is approaching it.

One lean is one ratio

A post’s lean is a·(1/Z − 1/R): a slope a, set by the car’s speed and the rows’ readout, times the difference between the post’s reciprocal range and the bend’s. One lean is one number, and it fixes the ratio of the speed to the radius, not either alone. The earlier essay’s eight posts fitted both, from eight points at eight ranges; one post at one range cannot.

With the speed unknown, one post followed by a camera aimed at the centre gives no radius — 64.8 m (28.6–∞) — and one followed by a camera aimed 45° ahead gives 47.5 m (40.4–62.2)One post 12 m out, sixteen frames, tops to half a pixel, the radius and the speed fitted together, 100 trials of each. Aimed at the centre (dark): the fits lie along a curve where a faster car on a gentler bend leans the post as a slower one on a tighter bend does, and 38 of 100 fall outside this window; the radius reads 64.8 m (28.6–∞). Aimed 45° ahead (light): the post's lean sweeps as the car closes on it, the sweep separates the two, and the fits gather near 50 m and 10 m/s, 3 outside; 47.5 m (40.4–62.2). A post that keeps its range is one lean, and one lean is a ratio of the speed to the radius; a post that changes its range is a line, and a line has two numbers.010203050100150the radius fitted (m)the speed fitted (m/s)aimed at the centre(dark)aimed 45° ahead(light)one post 12 m out, sixteen framesthe truth: 50 m, 10 m/s
Fig. 2 One post 12 m out, sixteen frames, tops read to half a pixel, radius and speed fitted together, 100 trials each. Aimed at the centre (dark): the fits spread along a curve where a faster car on a gentler bend leans the post alike; the radius reads 64.8 m with quartiles from 28.6 to unbounded. Aimed 45° ahead (light): the fits gather near 50 m and 10 m/s; 47.5 m (40.4–62.2).

The two clouds make the point. With the camera aimed at the centre, the sixteen readings of one post are sixteen readings of one lean, and a faster car on a gentler bend gives the same lean as a slower one on a tighter bend; the fits spread along that trade, and the radius comes back as 64.8 metres with an upper quartile at infinity. With the camera aimed ahead, the post’s sixteen leans are sixteen points along a stretch of the line, and a stretch of a line has a slope and an intercept: the radius comes back as 47.5 metres, quartiles 40.4 to 62.2 — about what eight posts in one frame gave, from one post.

So the earlier essay’s question has two answers, by camera. A forward-looking camera can read a bend from one followed post, because the car closes on it. A sideways camera cannot, because it passes it.

What knowing the speed buys

A car knows its speed: its wheels count it. Given the speed, the slope of the lean’s line is known, and one lean gives the radius directly.

With the car's speed known, one post 12 m out followed through 16 frames reads the bend as 49.9 m (48.1–52.9) — closer than eight posts in one frame, 49.5 m (44.6–57.3)One post 12 m out followed through 1, 2, 4, 8, 16, 32 frames, its top read to half a pixel in each, the radius fitted with the car's speed known — as an odometer knows it — 100 trials a point. Aimed at the centre: 48.9 m (42.5–59.2) over 1, 50.4 m (45.6–57.5) over 2, 49.7 m (45.9–55.5) over 4, 49.6 m (46.7–53.8) over 8, 49.9 m (48.1–52.9) over 16, 49.9 m (48.0–51.3) over 32. Aimed 45° ahead: 48.9 m (42.4–59.4), 50.4 m (45.6–57.3), 49.6 m (45.8–55.5), 49.6 m (46.7–53.4), 50.0 m (48.4–52.4), 49.8 m (48.9–50.8). Eight posts from 12 to 150 m in a single frame, the speed known, read 49.5 m (44.6–57.3) (the band). A near post leans most and is read best, and each frame adds an independent reading of it; with the speed known, one lean is one radius, and the frames average the reading error away.12481632406080frames the one post is followed through (log scale)the radius read back (m): median and quartilesaimed at the centreaimed 45° aheadeight posts, one frameone post 12 m out, tops to 0.5 px, speed known100 trials a point
Fig. 3 One post 12 m out followed through 1 to 32 frames, the speed known, 100 trials a point. Aimed at the centre: 48.9 m (42.5–59.2) from one frame, 49.9 m (48.1–52.9) from sixteen, 49.9 m (48.0–51.3) from thirty-two. Aimed 45° ahead: much the same. Band: eight posts in one frame, speed known, 49.5 m (44.6–57.3).

With the speed known, one post twelve metres out, read in a single frame, gives the radius as 48.9 metres with quartiles from 42.5 to 59.2 — already about as well as eight posts in one frame with the speed known, which give 49.5 (44.6–57.3). Followed through sixteen frames it gives 49.9 (48.1–52.9), and through thirty-two, 49.9 (48.0–51.3). Each frame is a fresh reading of nearly the same lean, and averaging fresh readings narrows the answer as the square root of their number.

Where the camera points hardly matters here. Aimed ahead, the post’s lean sweeps, and with the speed known the sweep adds little the averaging did not: 50.0 (48.4–52.4) from sixteen frames. The sweep is what separates the speed from the radius; once the speed is known, there is nothing left for it to separate.

A roadside against one post

Aimed at the centre, eight posts followed through sixteen frames read the bend as 50.0 m (46.5–54.2) with the speed unknown and 49.6 m (48.0–51.7) with it knownThe camera aimed at the bend's centre, tops read to half a pixel, 100 trials each; each bar is the middle half of the radius read back, labelled with its median and quartiles. Eight posts, one frame, speed known: 49.5 m (44.6–57.3); Eight posts, one frame, speed unknown: 47.5 m (38.6–74.7); One post, sixteen frames, speed known: 49.9 m (48.1–52.9); One post, sixteen frames, speed unknown: 64.8 m (28.6–∞); Eight posts, sixteen frames, speed known: 49.6 m (48.0–51.7); Eight posts, sixteen frames, speed unknown: 50.0 m (46.5–54.2). The posts nearly keep their ranges, so following them is close to averaging them as the earlier essay did, and what the speed adds is the slope of their leans' line: known, it lets one near post do what eight in one frame could not.eight posts, one frame, speed known49.5 meight posts, one frame, speed unknown47.5 mone post, sixteen frames, speed known49.9 mone post, sixteen frames, speed unknown64.8 meight posts, sixteen frames, speed known49.6 meight posts, sixteen frames, speed unknown50.0 maimed at the centre, 100 trialsbar: the middle half of the radius read
Fig. 4 The camera aimed at the centre, 100 trials each; bars: the middle half of the radius read. Eight posts in one frame: 49.5 m (44.6–57.3) with the speed known, 47.5 m (38.6–74.7) without. One post through sixteen frames: 49.9 m (48.1–52.9) known, 64.8 m (28.6–∞) unknown. Eight posts through sixteen frames: 49.6 m (48.0–51.7) known, 50.0 m (46.5–54.2) unknown.

The sideways camera’s six cases line up into one rule. Without the speed, a camera needs posts at several ranges, and following them through frames is close to what averaging them did in the earlier essay: eight posts through sixteen frames give 50.0 metres (46.5–54.2), against 50.9 (47–55) from the earlier essay’s averaging of the same posts as if they stood still. The posts nearly keep their ranges, so following them changes nothing the averaging missed. With the speed, a camera needs one near post; the rest of the roadside improves the answer only from 49.9 (48.1–52.9) to 49.6 (48.0–51.7).

That answers the earlier essay’s last question in the camera’s favour, for a car that knows its speed. One lamp post, followed for half a second, reads a 50-metre bend to about three metres — better than a roadside of posts in a single frame.

What the earlier averaging got away with

The earlier essay’s averaging read each post’s lean in every frame and averaged as if the post had stayed at the range it had in the first. For a sideways camera that was nearly true, and the measurement here says how nearly: the nearest of its eight posts, at twelve metres, drifts out to 12.8 and leans five per cent less by the sixteenth frame, so its averaged lean is about two and a half per cent below the first frame’s, attributed to the first frame’s range. The other seven drift less. A lean read a little low for its range is a slightly larger radius, and the averaging’s 50.9 metres sits on that side of the truth, where following the posts at their own ranges gives 50.0 — consistent with the drift, though a difference of under a metre is inside both spreads and is not proof of it.

For a forward camera the same averaging would not have got away with it. Its twelve-metre post’s lean doubles in half a second, and averaging sixteen frames of it at the first frame’s range would put a lean half again too large on a range a sixth too long. Following the posts at their own ranges is not a refinement for a camera that looks ahead; it is the only reading that is right.

Which post to follow

The post to follow is the nearest: at 8 m it reads the radius to ±1.5 m, at 70 m to ±17One post followed through sixteen frames, its top read to half a pixel, the car's speed known, 100 trials a point: half the middle spread of the radius read back, for posts 8, 12, 18, 25, 35, 70 m out. Aimed at the centre: ±1.5 m, ±2.4 m, ±3.7 m, ±5.2 m, ±7.5 m, ±16.7 m. Aimed 45° ahead: ±1.2 m, ±2.0 m, ±3.4 m, ±5.0 m, ±7.2 m, ±16.0 m. A post's lean is a·(1/Z − 1/R), so it carries the radius only through the difference between the post's own reciprocal range and the bend's; a near post has the larger lean and more rows to read it over, and so is read best. A post near the bend's centre leans almost nothing and is worth almost nothing.81218253570125102050how far out the one followed post stands (m, log scale)half the middle spread of the radius (m, log scale)aimed at the centreaimed 45° aheadone post, sixteen frames, speed knownnearer is better
Fig. 5 One post through sixteen frames, the speed known, 100 trials a point: half the middle spread of the radius read back, for posts 8 to 70 m out. Aimed at the centre: ±1.5 m at 8 m, ±2.4 at 12, ±5.2 at 25, ±16.7 at 70. Aimed 45° ahead: ±1.2, ±2.0, ±5.0, ±16.0.

The nearest post is the one to follow. At eight metres it reads the radius to ±1.5 metres, at twelve to ±2.4, at twenty-five to ±5.2 and at seventy to ±17. A near post leans most — its reciprocal range is furthest from the bend’s — and it stands tallest in the picture, so its top is read over the most rows, and the reading error is the smallest share of its lean. A post near the bend’s centre, at fifty metres here, hardly leans at all and says almost nothing about the radius, which is the same reason a rolling frame on a bend is right at its centre: there the rolling frame and a global one agree.

Aimed ahead, every post does a little better than aimed at the centre — ±1.2 metres at eight, ±2.0 at twelve — because the car closes on it and its lean grows during the half-second. The gain is a fifth at most. For a car that knows its speed, the camera’s aim is a small matter and the post’s distance a large one.

As long as a post stays in view

Sixteen frames is a convenient half-second, but a post can be followed only while it stays in the picture, and a near post leaves sooner. Aimed at the centre, with a picture fifty degrees wide, the post eight metres out stays in view for fourteen frames, the twelve-metre post for twenty-three and the twenty-five-metre post for eighty-six, nearly three seconds. Aimed forty-five degrees ahead, the times are a little shorter: thirteen, twenty-one and fifty-six frames.

Followed for as long as each stays in view, with the speed known, the three posts end up nearly level. The eight-metre post, over its fourteen frames, reads the radius as 50.0 metres with quartiles from 48.4 to 51.6; the twelve-metre post over twenty-three, 50.3 (48.0–52.2); the twenty-five-metre post over eighty-six, 50.0 (47.9–52.2). A near post is read best per frame and a far one is read for longer, and over a post’s whole passage across the picture the two roughly cancel. The practical rule is then not to wait for the ideal post but to follow whatever upright thing the picture holds for as long as it can be held.

A slower readout reads better

The lean is made by the readout: the longer the sensor takes to read its rows, the further the car moves while it does, and the more each post leans. The reading error does not grow with it.

With the speed known, one post twelve metres out followed through sixteen frames reads the radius as 50.1 metres with quartiles from 43.3 to 64.0 when the frame is read in 8.3 milliseconds, (46.4–56.2) in 16.7, (48.1–52.9) in 33.3 and (49.0–51.4) in 66.7. The spread falls roughly in proportion to the readout time. The earlier essay found the same of eight posts in one frame: a slow sensor measures the road. A camera chosen to read bends from its own rolling shutter wants the slowest readout its pictures can tolerate, which is the opposite of what a camera is usually chosen for — and the opposite of what a turning frame can be straightened wanted, where the lean was an error to remove rather than a reading to keep.

What a car should do

Put together, the measurements say how a car’s camera should read a bend. If the car knows its speed, which it does, the camera should pick the nearest upright thing it can see clearly — a post, a sign, a lamp standard — and follow it for as many frames as it stays in view; the radius comes out to a few per cent in half a second. If for some reason the speed is not trusted, a forward-looking camera can still read the bend from one post it is closing on, and a sideways camera needs posts at several ranges, as the earlier essay found.

A camera on a bend is sharp on a circle began this sequence by finding that a car’s motion blur vanishes on one circle; the earlier essay found that a rolling frame’s leans measure that circle coarsely. What following the posts adds is not more geometry but the car’s own knowledge of itself. A rolling frame measures the ratio of the car’s motion to the bend; the car supplies the motion, and the ratio becomes the bend.

What was assumed

The posts are plumb and straight. As in the earlier essay, a lean is read off a post’s top against its foot. A post that leans by itself adds a constant to every frame’s lean, which following the post cannot average away; a near post that leans by a degree carries a bias of the same order as the lean being measured, and the reading would need posts known to be plumb or several posts whose own leans average out.

The car’s speed is known exactly. An odometer’s error of a per cent is a slope one per cent wrong, and since one over the radius is one over the post’s range less the lean over the slope, it moves one over the radius by a per cent of the difference between the two reciprocals — for the twelve-metre post, about three per cent of the radius, comparable to the spreads above. A followed near post needs the speed to a fraction of a per cent before its reading is limited by the posts rather than by the odometer.

The bend is a circle and the car follows it. A car that changes its line, or a bend that tightens, changes the slope and the intercept from frame to frame; half a second is short enough that neither matters much here, and long enough that a sharp change of steering would.

Each frame’s reading error is independent. The top of a post read in consecutive frames by the same feature tracker carries correlated errors; with correlation the averaging over frames gains less than the square root of their number.

Still open: what a post’s own lean costs a followed reading

The reading here assumed every post exactly plumb. Real roadside posts are not: a steel column is plumb to a fraction of a degree, a timber pole or a sign post often to a degree or more, and a followed post carries its own lean into every frame unchanged.

The measurement that settles what that costs gives each post a random lean of a stated size and asks two things. First, how large a lean a followed near post can carry before its bias exceeds the spread above — a single post with a lean is a constant error that no number of frames removes. Second, whether following several posts and fitting each one’s own lean along with the radius — possible only for a camera that sweeps them, since a sideways camera sees each post’s lean as one number — recovers the radius as well as plumb posts did, and so whether a forward-looking camera is the more robust instrument even for a car that knows its speed.

Shares its objects with

Essays that name at least two of the same things, and that neither author linked.

Named objects

A flat tag is an object no other essay names yet.

camera trackExposureleast squaresMotion blurMoving viewpointSensor