The rectangle behind the lens

One pair of frames reads the speed and the bend from the roadside

A camera that reads one frame from the top down and the next from the bottom up turns every roadside pole's rolling-shutter lean round and leaves its own tilt where it was. Half the difference of each pole's two leans is the shutter's alone, and across a row of poles it lies on one straight line in one over the range: its slope is the car's speed and its crossing is the bend. So one pair of frames, a fifteenth of a second, reads both — the speed to 3 per cent and the bend to ±5.6 m from sixteen timber poles, whatever they lean. With the speed known, sixteen poles read the bend to ±2.4 m, a little better than one plumb post followed for sixteen frames. The nearest pole decides most of it.

Worth reading first: A frame is an interval · Every row is a different camera.

Frames read up and down part a post’s lean in one drive followed one roadside post through a drive round a 50-metre bend at ten metres a second, with a camera that read its rows from the top down on one frame and from the bottom up on the next. Reversing the readout reverses the rolling shutter’s lean and leaves the post’s own tilt alone, so the frames zigzag about the post’s tilt, and a fit of one tilt and one curvature parts them. Thirty-two frames read a timber pole leaning a quarter of a degree to ±1.8 metres — as well as two passes of sixteen frames by two cars driving the road in opposite directions.

Everything in that essay followed a single post through many frames. That essay ended by asking about the other way to use the roadside: not one post through time, but every post at once. A rolling frame on a bend is a coarse curvature gauge had found that the posts of a single frame give the bend only coarsely, and their own leans were much of the reason. In one frame the posts’ rolling leans lie on a straight line in one over the range — slope set by the speed, crossing set by the radius — and every post’s own tilt scatters them off it. A pair of frames read in opposite directions, a fifteenth of a second apart, removes every post’s tilt at once. Does one such pair read the speed and the bend from the roadside?

Half the difference is a straight line

The car and the bend are the earlier essays’: a camera rounding a 50-metre bend at ten metres a second, aimed at the bend’s centre, its rows read in a thirtieth of a second, eyes 1.5 metres up and a 50° lens. Beside the road stand timber poles, between eight and forty metres out and spread across the view, each leaning a quarter of a degree in a direction of its own. The camera takes one frame reading from the top down and the next reading from the bottom up.

Twelve timber poles in one top-down frame and the next bottom-up: half the difference of each pole's two leans falls on one line in one over its range, whose slope is the speed and whose crossing is the bend — 10.03 m/s and 49.9 m read from the pair, exact leansA camera rounding a 50 m bend at 10 m/s, aimed at the bend's centre, its rows read in a thirtieth of a second; twelve timber poles beside the road from 8 to 40 m out, spread across the view, each leaning a quarter of a degree in its own direction. Each pole's lean in the first frame, read from the top down (filled), and in the next, read from the bottom up (hollow): every pole's own tilt is in both, and the rolling shutter's lean is in both with opposite signs. Half their difference, ringed, takes away the tilts and leaves the shutter's lean alone, which is the image's speed across the picture times the readout: a constant times the car's speed times one over the pole's range less one over the bend's radius. So the half-differences lie on one straight line in one over the range — slope set by the speed, crossing zero at one over the radius — and the pair of frames reads both: 10.031 m/s and 49.85 m from exact leans, against 10 and 50. The small miss is each pole's tilt drawn a little differently in the two frames as it moves across the picture. Half the sum of each pole's two leans is its own tilt.-0.05000.050one over the pole's range, 1/mthe pole's lean in the picture01/401/201/10top-down framebottom-up framehalf the difference1/Rfilled: top-down · hollow: bottom-up · ringed: half the differencetwelve poles, one pair of frames
Fig. 1 Twelve timber poles’ leans in a top-down frame and the next bottom-up one, against one over each pole’s range; ringed, half the difference of each pole’s two leans, which falls on one line crossing zero at one over the bend’s radius.

In the top-down frame each pole leans by its own tilt plus the shutter’s lean; in the bottom-up frame, by its own tilt minus the shutter’s lean. Half the difference of the two is the shutter’s lean alone, and that is the image’s speed across the picture times the time between reading the pole’s head and its foot. Every row is a different camera is where that came from, and the earlier essays measured it: a constant, set by the camera, times the car’s speed, times one over the pole’s range less one over the bend’s radius. So the half-differences of a row of poles lie on one straight line in one over the range. Its slope is the car’s speed, and it crosses zero where one over the range equals one over the radius — at the range of a pole that stands on the bend’s own centre line, which the shutter does not lean at all.

Read from exact leans, twelve poles give 10.03 metres a second and 49.9 metres. The small miss is each pole’s tilt drawn a little differently in the two frames, since in a fifteenth of a second the pole moves across the picture and is seen from a slightly different angle. The reading itself is a small linear fit: every frame’s lean is the shutter’s lean for that frame’s readout direction plus the pole’s own tilt, and the unknowns — the speed, the speed over the radius, and every pole’s tilt — enter linearly.

Speed and bend together, from a fifteenth of a second

With every pole’s head read to half a pixel, the question is a spread.

One pair of frames reads the bend to ±9.0 m from eight poles and ±5.6 from sixteen, with the speed read alongside; with the speed known, ±2.4 — where one plumb post followed for sixteen frames, the speed known, gives ±2.7One top-down frame and the next bottom-up of a roadside of timber poles from 8 to 40 m out, each leaning a quarter of a degree in its own direction, every head read to half a pixel; 120 roadsides a point. Half the middle spread of the radius read. Speed and bend read together from the pair: 2 poles ±18.99 m, 3 poles ±17.11 m, 4 poles ±13.69 m, 6 poles ±13.44 m, 8 poles ±8.99 m, 12 poles ±6.91 m, 16 poles ±5.58 m. The speed given and the bend alone read: ±4.41, ±3.87, ±3.59, ±3.68, ±3.22, ±3.01, ±2.40. Dashed: one plumb post followed through sixteen frames read one way, the speed known, ±2.74 m. Each pair spends one equation of every pole on that pole's own tilt; what is left is one equation a pole for two numbers shared by all of them, so the spread falls as the number of poles grows, and the speed costs the bend a factor of about two.05101520234681216poles read in the pair of frameshalf the middle spread of the radius read, mspeed read with the bendspeed knowna plumb post followeddashed: one plumb post, sixteen frames, speed knownvalues above 20 m drawn at the top
Fig. 2 Half the middle spread of the radius read from one pair of frames, against how many poles are read, with the speed read alongside and with the speed known; dashed, one plumb post followed for sixteen frames with the speed known.

Two poles read the bend to ±19 metres, half the middle spread of 120 roadsides; four to ±14; eight to ±9.0; sixteen to ±5.6. Each pole gives two equations, one per frame, and spends one of them on its own tilt, so a roadside of n poles gives n equations for the two numbers the poles share. The spread falls roughly as one over the square root of the count, with a little extra from the near poles a larger roadside adds.

The same pair reads the car's speed to ±0.64 m/s from four poles and ±0.27 from sixteen — 3 per cent of the 10 m/s it is driving atThe speed read alongside the bend from one top-down frame and the next bottom-up, 2, 3, 4, 6, 8, 12, 16 timber poles from 8 to 40 m, every head to half a pixel, 120 roadsides a point: half the middle spread ±0.902, ±0.780, ±0.637, ±0.490, ±0.378, ±0.347, ±0.274 m/s, medians 9.95, 10.02, 10.07, 9.90, 9.95, 9.96, 9.92. The speed is the slope of the half-differences against one over the range, and the near poles carry it: the shutter leans a pole at 8 m twenty times as far as one at 40, which stands nearly on the line where the lean changes sign.00.2500.5000.7501234681216poles read in the pair of frameshalf the middle spread of the speed read, m/sone pair of framestimber poles 8 to 40 m out
Fig. 3 Half the middle spread of the car’s speed read from the same pair of frames, against how many poles are read.

The speed comes with it, and comes well. Four poles read it to ±0.64 metres a second, eight to ±0.38, sixteen to ±0.27 — three per cent of the ten metres a second the car is doing — with medians within a tenth of ten. The speed is the slope of the line, which the near poles fix: the shutter leans a pole at eight metres twenty times as far as one at forty, which stands close to the line’s zero.

That is the first answer to the question. One pair of frames reads the speed and the bend together, from the roadside alone, in a fifteenth of a second — and the bend it reads, from sixteen poles, is about twice as wide as a followed post’s.

Knowing the speed is worth a factor of two

The earlier essays read the bend from a followed post with the speed given, and that is the fair comparison the question asked for.

With the speed known, the pair reads the bend to ±4.4 metres from two poles, ±3.2 from eight and ±2.4 from sixteen. One plumb post followed one way through sixteen frames, the speed known, reads it to ±2.7 metres. Sixteen leaning timber poles in two frames do a little better than one perfectly plumb post in sixteen frames, and they do it whatever the poles lean — the earlier essays found that the followed post read one way lost the bend entirely to a quarter of a degree of lean.

The speed costs the bend a factor of about two at every count, because the speed and the curvature are read from the same line: the slope and the crossing of a line fitted to points spread over a limited stretch of one over the range are correlated, and an error in the slope moves the crossing with it. A car whose speed is known from its own wheels should be given it.

The nearest pole decides

The nearest pole sets the reading: eight poles from 5 to 40 m read the bend to ±7.2 m and the speed to ±0.17 m/s; from 15 to 40 m, ±11.7 m and ±1.42Eight timber poles in one pair of frames, spread over five spans of range, every head to half a pixel, 120 roadsides each. Half the middle spread of the bend read, in metres, and of the speed, in tenths of a metre a second: 5 to 40 m, ±7.21 m and ±0.172 m/s; 8 to 20 m, ±8.56 m and ±0.393 m/s; 8 to 40 m, ±8.99 m and ±0.378 m/s; 8 to 80 m, ±12.11 m and ±0.442 m/s; 15 to 40 m, ±11.68 m and ±1.424 m/s. The half-differences lie on a line in one over the range, and a line is fixed by its spread along that axis: one over 5 m is 0.2, one over 15 m is 0.067, and the far poles add little at the other end, since one over 40 m and one over 80 m are both near nothing. Poles further out than the bend's own radius sit on the other side of the line's zero.poles 5 to 40 m: the bend, ±m7.21the speed, ±dm/s1.72poles 8 to 20 m: the bend, ±m8.56the speed, ±dm/s3.93poles 8 to 40 m: the bend, ±m8.99the speed, ±dm/s3.78poles 8 to 80 m: the bend, ±m12.11the speed, ±dm/s4.42poles 15 to 40 m: the bend, ±m11.68the speed, ±dm/s14.24eight poles, one pair of framesblue: the bend · orange: the speed, tenths of m/s
Fig. 4 Half the middle spread of the bend and of the speed read from eight poles in one pair of frames, for poles spread over five spans of range.

Eight poles from 5 to 40 metres read the bend to ±7.2 metres and the speed to ±0.17 metres a second; from 8 to 40, ±9.0 and ±0.38; from 15 to 40, ±11.7 and ±1.42. Moving the far end barely matters — eight poles from 8 to 20 metres read the bend to ±8.6, from 8 to 80 to ±12.1. The line is in one over the range, and one over the range is spread almost entirely by the near poles: one over 5 metres is 0.2, one over 15 is 0.067, and one over 40 and one over 80 are both close to nothing. A roadside’s nearest poles are the ones that do the work, and a camera reading a bend from a pair of frames wants poles close to the road.

How far the poles lean does not matter

How far the poles lean makes no difference: eight poles read the bend to ±8.9 m plumb, ±9.0 leaning a quarter of a degree and ±9.3 leaning two degreesEight timber poles from 8 to 40 m in one pair of frames, every head to half a pixel, each pole leaning by 0, 0.25, 0.5, 1, 2° in a direction of its own, 120 roadsides each: half the middle spread of the bend read ±8.87, ±8.99, ±8.77, ±8.94, ±9.26 m, medians 49.14, 49.20, 49.21, 49.20, 49.84. Each pole's own tilt is the same in both frames and is one unknown of its own, so it is taken out whole whatever its size; the one-way reading the earlier essays measured lost the bend to a quarter of a degree, and the pair does not lose it to two.02.5057.501000.2500.50012how far every pole leans, degrees, each in its own directionhalf the middle spread of the radius read, meight poles, one pair of framesevery head to half a pixel
Fig. 5 Half the middle spread of the bend read from eight poles in one pair of frames, against how far every pole leans in a direction of its own.

Plumb poles read the bend to ±8.9 metres; poles leaning a quarter of a degree, ±9.0; a degree, ±8.9; two degrees, ±9.3. Each pole’s tilt is the same in both frames and is an unknown of its own, so it is taken out whole whatever its size. The one-way reading the earlier essays measured lost the bend to a quarter of a degree of lean — a timber pole read from one direction read the bend to ±11.7 metres — and the pair does not lose it to two degrees. That is the point of reversing the readout. A roadside is full of poles nobody has plumbed, and the pair does not need anyone to.

What it does not take out is the part of a lean that changes between the two frames. A pole leaning towards or away from the camera is drawn with a lean that grows as the camera rounds the bend and sees it more obliquely, and a fifteenth of a second is long enough for a near pole’s view to change a little, and the medians, which wander a metre or so either side of fifty, carry that change.

The marks set the scale

The reading scales with the marks: eight poles read the bend to ±4.2 m with every head to a quarter of a pixel, ±9.0 to a half and ±19.6 to a pixelEight timber poles from 8 to 40 m in one pair of frames, each leaning a quarter of a degree, every head read to 0.1, 0.25, 0.5, 1 px, 120 roadsides each: half the middle spread of the bend read ±1.65, ±4.21, ±8.99, ±19.64 m, and of the speed ±0.074, ±0.194, ±0.378, ±0.755 m/s. The reading is a linear fit to the leans, and its spread is in proportion to their reading error.010200.1000.2500.5001how finely each pole's head is read, pxhalf the middle spread of the radius read, meight poles, one pair of frameseach pole leaning a quarter of a degree
Fig. 6 Half the middle spread of the bend read from eight poles in one pair of frames, against how finely each pole’s head is read.

The reading is a linear fit to the leans, and its spread is in proportion to their reading error: eight poles read the bend to ±4.2 metres with every head read to a quarter of a pixel, ±9.0 to a half, ±19.6 to a pixel. Half a pixel is the reading the earlier essays used for a post’s head against the sky. A camera with twice the resolution, reading the same poles to the same fraction of a pixel, halves every figure here.

The poles’ tilts come with it, coarsely

Half the sum of each pole’s two leans is that pole’s own tilt, so the pair reads the roadside’s tilts as well as the bend. It reads them coarsely. A three-metre pole at twenty metres is about a hundred and ten pixels tall, and its lean read from the head’s place to half a pixel is good to about a third of a degree; the half-sum of two such readings is little better, and over 120 roadsides of eight poles each pole’s sideways tilt comes back to ±0.34°. That is too coarse to grade the quarter-degree leans the roadside’s timber poles have — a photograph grades its posts across the sight needed a building’s plumb corners and a sharper reading to do that.

The difference is what each pole is asked for. For the bend, every pole contributes one equation to two shared numbers, and eight or sixteen poles average their reading errors down. For its own tilt, each pole contributes only its own two readings. The pair reads the bend from the roadside, not the roadside’s poles; a survey of the poles themselves would follow each of them through many frames, as the earlier essays did.

Why the speed costs a factor of two

The line’s slope is the speed and its crossing is the bend, and the two are read from points spread over a limited stretch of one over the range. Tilt the line about the middle of that stretch and both the slope and the crossing move: a fitted line whose points lie between one over 40 and one over 8 has its slope and its crossing correlated, because the crossing — at one over 50, beyond the far end of the points — is an extrapolation. A known speed fixes the slope, and the crossing is then read from the line’s height alone, with no extrapolation along a guessed slope. That is the factor of two in the poles figure, and it is why a roadside with poles beyond the bend’s radius would do better: points on the far side of the crossing would turn the extrapolation into an interpolation. On a 50-metre bend those are poles more than fifty metres out, which a 50° lens sees small and reads coarsely.

The crossing has a name in the earlier essays. A pole at the bend’s radius is not leaned by the shutter at all, because its image does not move across the picture: a camera on a bend is sharp on a circle, and the circle passes through the bend’s centre. The pair reads where that circle is from poles that are not on it.

What the pair asks of the sensor and the road

The sensor reverses its readout between frames. Some sensors can be told which way to read their rows; many cannot. A sensor that reverses must also wait one exposure between frames — the row it read last is the row it reads first, and that row needs light — and the earlier essay measured what a gap costs a followed post. For a pair it costs only the drift of each pole across the picture during the gap.

The two readouts last equally long. The half-difference cancels each tilt because the top-down and bottom-up readouts lean a plumb pole by equal and opposite amounts. A sensor whose bottom-up readout is slower than its top-down one leaves part of the shutter’s lean in every tilt and reads the shutter’s lean itself short, and the earlier essay measured that mismatch for a followed post: the two readout times have to agree to about a per cent.

The poles are seen in both frames. Every pole here stays in view. A pole entering or leaving the frame between the pair, or hidden by a passing car in one of them, has one equation and contributes nothing.

The camera’s aim is known. Every pole’s shutter lean per unit of speed and curvature depends on where the pole stands in the picture and on which way the camera points relative to the bend, and the reading computes it for a camera aimed at the bend’s centre. A camera aimed partly along the road leans the poles by different amounts — a turning frame can be straightened; a travelling one cannot is the general reason the turn and the travel lean things differently — and a reading that assumed the wrong aim would put the difference into the speed and the radius. A car’s camera is bolted on, and its aim is a number measured once.

The bend is one circle. A road that tightens or eases under the car changes the radius between the frames; a fifteenth of a second at ten metres a second is under a metre of road, and any real road holds its curvature over that.

A frame is an interval, and two are a measurement

A frame is an interval began this line of reading with the observation that a rolling-shutter picture records a stretch of time, and a rolling frame on a bend is right at its centre and a tracked post reads the bend, if the speed is known turned that stretch into a measurement of the bend. Every reading since has needed something else to be known: the speed, or the post’s plumbness, or a second pass, or many frames of one post. The pair needs nothing but the roadside and a sensor that can read its rows both ways, and in exchange for a fifteenth of a second it returns both numbers the bend’s geometry has — and every pole’s tilt besides, as half the sum of its two leans. A post read both ways sets its lean aside found the same separation with two cars; this is the same separation with one camera, made once rather than followed.

Still open: whether a few pairs read a bend that changes

The pair reads one bend, one speed, at one moment. A real road’s curvature changes as the car drives it — a transition curve eases from straight into the bend, its radius falling steadily — and a car’s speed changes too. A drive of alternating frames is a sequence of pairs, each reading its own speed and radius from the poles then in view, a fifteenth of a second apart.

The measurement that settles what that is worth drives the camera along a transition curve whose radius falls at a stated rate, reads every consecutive pair of frames for its own speed and bend from the roadside then in view, and asks how well the sequence of pairs follows the curvature as it changes; whether pairs that share a frame — top-down then bottom-up, then bottom-up then top-down — read twice as many moments as pairs that do not, or merely the same moments twice; and whether fitting the curvature’s rate of change across several pairs reads it better than differencing the pairs’ own radii, since a rate read from noisy radii is the noisier quantity.

Shares its objects with

Essays that name at least two of the same things, and that neither author linked.

Named objects

A flat tag is an object no other essay names yet.

camera trackExposureIdentifiabilityleast squaresMoving viewpointSensor