The second eye

A car ahead costs a pair its speed, and a car that may drift costs a single camera everything

A stereo pair's last second of pictures ranged the still road twenty metres ahead to 4.5 per cent a pixel. A car twenty metres ahead is not still, and each old picture saw it somewhere else. Read together with its speed, a car keeping pace is ranged to 4.5 per cent all the same — it stood twenty metres from every picture, and reading its speed spends exactly what that was worth. A car that may also drift across the lane costs the pair a fifth more and takes a single wandering camera from 38 per cent to 185. A braking car caps the useful look at about a second.

Worth reading first: The image of the other eye · Depth is a reciprocal.

A stereo pair and a lane wander add as two readings of one depth put two cameras thirty centimetres apart across a car driving at fifteen metres a second and asked how well they range the road twenty metres straight ahead. From one moment’s two pictures, to 15.8 per cent of the depth for every pixel of reading error. From the last second’s sixty pictures, to 4.6, because every moment is another reading; and with the car’s ordinary drift of twenty centimetres either side of its lane, to 4.5, exactly what the pair’s look and the drift would give as two independent readings. A pair, it turned out, is already a moving pair, and its own history was worth more than the wander.

Every one of those readings was of a point on the road, which holds still. The essay ended on the thing a car most needs to range, which does not: the car in front. An old picture of a moving car is a picture of where it was, and the question was how many of the pair’s past pictures still help when each has to be read against the car’s place at its own moment — whether a pair that also reads the car’s speed from its pictures keeps most of its gain, how that falls as the gap closes faster, and whether the drift across the lane helps more or less with a moving target than with the road, since a moving target changes its own bearing and might lend the pictures a baseline of its own.

The pair keeps its gain, and pays for it with the car’s speed, almost exactly. The drift helps less, not more. And a moving target lends nothing, because its motion is one more thing to be read.

The car stood twenty metres from every picture

A car 20 m ahead keeping pace, its speed read from the pictures themselves, is ranged to 4.49% a pixel from a second's look — the still road, to 4.53%; free to drift across the lane as well, to 5.35%A pair of cameras 0.3 m apart on a car at 15 m/s that wanders ±0.2 m every 4 s, filmed at 30 frames a second; a vehicle 20 m straight ahead of it now, keeping pace. Every picture sees the vehicle where it was at that picture's own moment, and the reading fits the vehicle's position now together with its speed. The depth error a pixel of reading in every picture costs, median over the wander, for looks of 0.1, 0.25, 0.5, 1, 1.5, 2 s. The still road 20 m ahead: 8.45%, 6.23%, 5.24%, 4.53%, 4.27%, 4.15%. The car with its speed known: 7.88%, 5.22%, 3.87%, 2.61%, 2.06%, 1.73%. The car with its speed along the road read from the pictures: 10.9%, 7.81%, 6.06%, 4.49%, 3.76%, 3.29%. With a speed across the road read as well: 13.2%, 9.66%, 7.44%, 5.35%, 4.28%, 3.64%. A car keeping pace stays 20 m from every one of the pair's past pictures, where the still road was 35 m from the oldest of a second's; with its speed known that is worth more than half again, and reading the speed from the same pictures spends almost exactly what it was worth. The slider sets how fast the gap closes.0.010.020.050.10.200.50011.502how far back the pair looks, secondsdepth error a pixel costs 20 m ahead (log)the still roadthe car, its speed knownthe car, its speed readand free to drift acrossa pair 0.3 m apart, ±0.2 m every 4 s, 15 m/skeeping pace
Fig. 1 A pair 0.3 m apart on a car at 15 m/s wandering ±0.2 m every 4 s; a vehicle 20 m straight down the road. Depth error a pixel costs over looks of 0.1 to 2 s: the still road, 8.45% to 4.15%; the vehicle keeping pace with its speed known, 7.88% to 1.73%; its speed read, 10.9% to 3.29%; its speed and a drift across read, 13.2% to 3.64%. The slider sets how fast the gap closes.

The car and its pair are the earlier essay’s: fifteen metres a second, thirty frames a second, the lane wander of twenty centimetres either side every four seconds. Twenty metres straight down the road, where the earlier essay ranged the road surface, there is now another vehicle. Every picture in the last second saw it where it was at that picture’s moment, and the reading places it now by fitting all of them together, with as much of its motion as is not known fitted beside its position. The figure gives the depth error a pixel of reading in every picture costs, as a share of the twenty metres, for looks from a tenth of a second to two.

The dashed line is the still road, the earlier essay’s reading: 4.53 per cent from a second, 4.15 from two. The dotted line is a vehicle keeping pace, whose speed is known — told by the vehicle itself over a radio link, say. It is ranged far better than the road: 2.61 per cent from a second, 1.73 from two. The reason is the one the earlier essay found limiting its own gain. A picture taken a second ago stood fifteen metres further back, and the road twenty metres ahead was thirty-five metres from it; a pair’s reading of depth costs the square of the distance, as depth is a reciprocal found for every pair, so that old picture, whose reading’s variance grows as the fourth power of its distance, was worth about a tenth of a new one. A car keeping pace was twenty metres from every picture. Its whole second of pictures counts at full weight.

The solid line is the case a car actually has: the vehicle ahead keeping pace, but nobody has said so, and its speed along the road is read from the same pictures. It costs 4.49 per cent from a second — the still road’s figure to within a twentieth of itself. Reading the speed spends almost exactly what the constant distance gained. Over shorter looks the read speed costs more than the road: 6.06 per cent from half a second against 5.24. Over longer looks it costs less: 3.29 from two seconds against 4.15, because the road’s oldest pictures stand fifty metres from it while the car’s stand twenty.

The fourth line lets the vehicle drift across the lane at some steady speed too, which a car about to change lanes does. It costs 5.35 per cent from a second, a fifth more than the speed alone.

The slider changes how fast the gap closes. A car pulling away was nearer to the old pictures than to the new, and is ranged better; a car being caught up was further, and is ranged worse.

The faster the gap closes, the further back the old pictures saw

The faster the gap closes, the further back the old pictures saw the car, and the worse it is ranged: 3.22% a pixel pulling away at 10 m/s, 4.49% keeping pace, 5.39% closing at 10, its speed readThe pair and car of the look figure, a second's look, a vehicle 20 m ahead now and the gap closing at -10, -5, 0, 5, 10, 15 m/s; at 15 m/s the vehicle is standing still and is the still road. Depth error a pixel costs: its speed known, 1.19%, 1.94%, 2.61%, 3.34%, 3.96%, 4.53%; its speed along the road read, 3.22%, 3.92%, 4.49%, 4.97%, 5.39%, 5.77%; its speed across the road read as well, 3.67%, 4.56%, 5.35%, 5.94%, 6.52%, 7.06%. A second ago a car pulling away at 10 m/s was 10 m nearer than it is now, and a stopped one 15 m further; a pair's reading of depth costs the square of the distance at which each picture saw it, so the old pictures of a car that is pulling away are worth more than the new ones, and those of a stopped car less. Reading the speed costs most where the known-speed reading is best: nearly three times the known-speed error for a car pulling away at 10 m/s, over half again for one keeping pace, a quarter again for one standing still, because the old pictures that make a receding car well ranged are the ones a speed has to be read from as well.0.010.020.050.1-10-5051015how fast the gap closes, m/s (15: the vehicle is standing still)depth error a pixel costs, a second's look (log)its speed knownits speed readand its drift acrossa pair 0.3 m apart, a second's look, 20 m aheadright-hand end: the still road
Fig. 2 A second’s look, the vehicle 20 m ahead now and the gap closing at −10 to 15 m/s; at 15 the vehicle is standing still. Depth error a pixel costs: speed known, 1.19% to 4.53%; speed read, 3.22% to 5.77%; speed and drift read, 3.67% to 7.06%.

The closing speed sets where the old pictures saw the car. A car pulling away at ten metres a second was ten metres nearer a second ago; a car standing still on the road was fifteen metres further, as the road itself was. With the speed known, a car pulling away at ten is ranged to 1.19 per cent from a second, one keeping pace to 2.61, a stopped one to 4.53 — the still road, as it must be.

With the speed read, the line is flatter: 3.22 per cent pulling away, 4.49 keeping pace, 5.77 standing still. Reading the speed costs most where the known-speed reading was best, nearly three times the error for a car pulling away and only a quarter again for one standing still. That is because the old pictures do both jobs. They place the car, and they are the only record of how its distance has changed, which is what a speed is. A car pulling away is well ranged by its old pictures because they saw it near; reading its speed from them asks the same pictures for something else — how the distance changed between them — and a depth that has to serve as one end of a slope cannot also be averaged with its neighbours as if they were readings of one number. The two uses compete, and the competition is fiercest where the pictures are best.

A stopped car standing in the road is the still road read by someone who has not been told it is still. It costs 5.77 per cent against the road’s 4.53, a quarter more: the price of not knowing that the thing ahead is parked.

The speed is read as well, in a second

A pair 0.3 m apart reads the speed of the car ahead to 30 m/s a pixel from a tenth of a second, 1.41 from a second and 0.52 from two — falling nearly as the look's length to the power of one and a halfThe along-road speed of a vehicle 20 m ahead keeping pace, read together with its position from the pair's pictures over looks of 0.1, 0.25, 0.5, 1, 1.5, 2 s, for pairs 0.12, 0.3, 0.6 m apart; the error a pixel of reading in every picture costs, m/s, median over the wander. 0.12 m: 75.6, 23.0, 10.2, 2.8, 1.4, 0.791; 0.3 m: 30.1, 8.9, 3.8, 1.4, 0.783, 0.524; 0.6 m: 15.0, 4.4, 1.9, 0.690, 0.383, 0.258. A speed is a change of depth over time, and each moment's depth is read to the pair's one-moment error; a line fitted through n readings spread over a time T has a slope error that falls as one over T times the square root of n, and n grows with T, so the error falls nearly as T to the power of one and a half. A wider pair reads it better in proportion to its width, as it reads each moment's depth. A tenth of a second tells nothing about the car's speed; a second tells it to under a metre a second.0.10.250.511.520.3131030100how far back the pair looks, seconds (log)error of the car's speed read, m/s a pixel (log)a pair 0.12 m aparta pair 0.3 m aparta pair 0.6 m aparta car 20 m ahead keeping pacethe slope: about −1.4
Fig. 3 The speed along the road of a vehicle 20 m ahead keeping pace, read with its position from looks of 0.1 to 2 s: the error a pixel costs, m/s. A pair 0.3 m apart: 30 from a tenth of a second, 1.4 from a second, 0.52 from two. Pairs 0.12 and 0.6 m apart: 2.8 and 0.69 from a second.

The speed comes out of the reading as well as costing it. From a tenth of a second of pictures, a pair thirty centimetres apart reads the car’s speed to thirty metres a second a pixel, which is no reading at all. From a second, to 1.4 metres a second; from two, to half a metre a second. The error falls nearly as the look’s length to the power of one and a half, the rate at which a straight line fitted through more and more points over a longer and longer stretch narrows its slope: the stretch counts once, and the number of points under it counts as its square root. A wider pair reads it better in proportion to its width — 2.8 metres a second from a second’s look for a pair twelve centimetres apart, 0.69 for one sixty centimetres apart — because each moment’s depth is read in proportion to the width, and the speed is a slope through those depths.

A metre and a half a second is not fine. It is the difference between a car keeping pace and one losing a car-length every three seconds, and a pixel of matching error is a modest one; a matcher that reads to a fifth of a pixel reads the speed to three tenths of a metre a second from the same second. But it is enough to say whether the gap is closing quickly, which is the question a car following another asks most often, and it comes from the same pictures that range the car rather than from any extra instrument.

A target that may drift takes a single camera’s wander away

A car free to drift across the lane takes the wander's whole help from one camera — 38.0% a pixel becomes 184.5% — and a pair keeps most of its reading: 4.49% becomes 5.35%A second's look at 15 m/s with a wander of ±0.2 m every 4 s, 20 m ahead, median over the wander; one camera, and pairs 0.12 and 0.3 m apart. The depth error a pixel costs: one camera: the still road, 22.8%; a car, its speed read, 38.0%; and its drift across, 184.5%; a pair 0.12 m apart: the still road, 9.73%; a car, its speed read, 10.5%; and its drift across, 12.0%; a pair 0.3 m apart: the still road, 4.53%; a car, its speed read, 4.49%; and its drift across, 5.35%. One camera gets its depth from how the road ahead shifts across its picture as the wander carries it sideways, and a vehicle that may itself be moving sideways at some steady speed explains most of that shift by its own motion. The pair keeps the depth each moment's two pictures give, which no sideways motion of the vehicle can touch, and loses only the pairings between one moment's picture and another's.one camera: the still road22.8%a car, its speed read38.0%and its drift across184.5%a pair 0.12 m apart: the still road9.73%a car, its speed read10.5%and its drift across12.0%a pair 0.3 m apart: the still road4.53%a car, its speed read4.49%and its drift across5.35%depth error a pixel costs 20 m ahead, a second's lookbar length: logarithmic
Fig. 4 A second’s look, wander ±0.2 m every 4 s, 20 m ahead; one camera, and pairs 0.12 and 0.3 m apart. Depth error a pixel costs for the still road, a vehicle with its speed read, and with a drift across read as well. One camera: 22.8%, 38.0%, 184.5%. Pair 0.12 m: 9.73%, 10.5%, 12.0%. Pair 0.3 m: 4.53%, 4.49%, 5.35%. Bar length logarithmic.

The earlier essay’s last question supposed that a moving target, by changing its own bearing, might lend the pictures a baseline of its own. It does not, and the reason is short. A baseline is a known separation between the places pictures were taken from. A target’s motion is not known; it has to be read, and every part of it that has to be read is a direction in which the pictures can explain what they see without the depth.

The figure measures that for three rigs. One camera alone, wandering, ranges the still road to 22.8 per cent a pixel from a second — the drift essay’s figure. A car ahead with its speed read costs it 38.0, because one camera’s depth comes from how the thing ahead shifts across the picture as the wander carries the camera sideways, and the car’s own change of distance has to be read from the same small shifts. Let the car drift across the lane at some steady speed as well, and one camera’s reading falls apart: 184.5 per cent. Its whole depth came from a sideways movement of the camera, and a sideways movement of the target, which nobody has measured, explains almost all of it.

A pair loses far less, because each moment’s two pictures range the car whatever it is doing; no motion of the target touches the disparity between two pictures taken at the same instant. A pair twelve centimetres apart goes from 10.5 per cent to 12.0 when the car may drift, one thirty centimetres apart from 4.49 to 5.35. What the pair loses is the pairings between moments — the left camera now against the right camera a moment ago — which the earlier essay found adding to the pair when the wander was large. Those pairings are where a target’s drift and the camera’s drift can be confused, and with the drift free they stop counting.

That leaves the wander itself with less to do. For the still road, a pair thirty centimetres apart went from 4.61 per cent with no wander to 3.89 with a wander of half a metre either side. For a car ahead with its speed read, the same pair goes from 4.40 to 4.20: the wander’s sideways movement buys a twentieth, where it bought a sixth. A narrow pair, twelve centimetres apart, gains more for the road — 11.5 to 5.5 — and less for the car: 11.0 to 7.4. The drift was a bonus for the still road and is a smaller one for the moving car, the reverse of what the question expected.

A braking car caps the look

A car braking at 3 m/s², read as if its speed were steady, is placed 1.39% out from a second's look and 8.63% from two; the look that keeps the bias below a pixel's cost is about 1.5 s, and 1 s for a car braking hardThe pair and car of the look figure, a vehicle 20 m ahead that was keeping pace and is braking at 3 or 6 m/s², read by a fit that assumes its speed steady. The depth error a pixel costs (solid, the same at both): 10.9%, 7.81%, 6.06%, 5.06%, 4.49%, 4.04%, 3.76%, 3.29% for looks of 0.1, 0.25, 0.5, 0.75, 1, 1.25, 1.5, 2 s. The depth bias of the steady-speed reading: braking at 3 m/s², 0.01%, 0.08%, 0.31%, 0.75%, 1.39%, 2.57%, 3.60%, 8.63%; at 6, 0.02%, 0.16%, 0.64%, 1.59%, 3.09%, 6.16%, 9.45%, 31.5%. A braking car was faster a second ago, by the braking times the time, and the pictures that saw it then place it where a steady car would not have been; that error grows as the square of the look, while the reading error falls as its square root. The longest useful look is where the two meet.10⁻⁴0.0010.010.100.50011.502how far back the pair looks, secondsshare of the depth, 20 m ahead (log)a pixel's costbias, braking 3 m/s²bias, braking 6 m/s²a pair 0.3 m apart, a car 20 m aheadread as if its speed were steady
Fig. 5 A vehicle 20 m ahead that was keeping pace and is braking at 3 or 6 m/s², read as if its speed were steady. The depth error a pixel costs falls from 10.9% at a tenth of a second to 3.29% at two; the bias of the steady-speed reading grows, braking at 3 m/s², from 0.31% at half a second to 1.39% at one and 8.63% at two — at 6, 0.64%, 3.09%, 31.5%.

The readings above assumed the car ahead keeps a steady speed over the look. A car ahead that brakes does not, and a reading that assumes it does is wrong by more the further back it looks. A car braking at three metres a second squared — firm braking for traffic, not an emergency — was three metres a second faster a second ago, and the pictures taken then saw it at places a steady car would not have been. The steady-speed reading fits them anyway and places the car wrongly.

The figure sets the bias against the reading’s own error. At half a second’s look the bias is 0.31 per cent of the depth, six centimetres, and the error a pixel costs is 6.06 per cent: the braking is invisible. At a second the bias is 1.39 per cent, twenty-eight centimetres, against 4.49. At a second and a half they are equal, 3.60 against 3.76. At two seconds the bias is 8.63 per cent, nearly two metres, two and a half times the reading error. The bias grows as about the square of the look, because a braking car’s departure from a steady one grows as the square of the time; the reading error falls only as about its square root. So there is a longest useful look, and it is about a second and a half for firm braking and a second for hard braking at six metres a second squared, where the bias at two seconds is a third of the depth.

A car can do better by reading the braking too, as one more unknown beside the speed — which would cost the reading what the speed did, and more — or by holding a look of about a second, which is where the pair’s gain had mostly arrived anyway: two seconds took the still road only from 4.53 per cent to 4.15, the arithmetic by which far enough away, a pair is one eye. The earlier essay found the second second of pictures nearly worthless for the road. For a car that may brake, it is worse than worthless.

What the pair’s history is worth for a moving car

Put together, a stereo pair’s past pictures are worth nearly as much for the car ahead as for the road, provided the car’s speed is read with them. The gain the earlier essay found — from 15.8 per cent a pixel at one moment to 4.5 from a second — survives for a car keeping pace, because a car keeping pace was at the same distance from every picture, and the speed it costs to read is paid from that. It shrinks for a car being caught up and grows for one pulling away. It shrinks by a fifth more if the car may be drifting across the lane. It must stop at about a second if the car may be braking. And the lane wander, which helped the still road, helps the moving car little.

The image of the other eye began this sequence with two pictures of a still courtyard and the point in each that is the other camera. The blind point of a car driving forwards, which an epipole in the picture leaves a blind disc found, is blind because every later picture stands on the same line as the first, and every essay since has been about breaking that line with a sideways separation of known size: a sway, a turn, a lever arm, a drift, a bracket. A moving target turns the question inside out. Its motion is a separation too, but not a known one, and an unknown separation is not a baseline; it is one more thing for the pictures to explain. What the pictures can still do is read it — the speed to a metre and a half a second from a second’s look — and that reading is paid for out of the depth.

A single camera, which steering swings a camera too little to see ahead and the drift essay tried to give a baseline, comes out of this worst. For the road its drift gave it 23 per cent a pixel; for a car whose motion is not known, 38; for one that may drift, nothing usable. A car that wants to range the car in front needs a bracket, because a bracket’s baseline is the one separation in the problem that nothing the other car does can mimic.

What the reading takes from outside the pictures

The car’s own motion is known. As in the earlier essay, every picture is placed where the camera was, from the car’s odometry and steering. A moving target makes that knowledge more important, not less: an error in the car’s own speed reads as an error in the other car’s speed, and the two are confused exactly as the target’s drift and the camera’s drift were.

The car ahead is a point. A vehicle is a body three or four metres long with a back that faces the pair. Its depth is read from many marks on that back, every one moving with it, which helps as more pixels help; it also turns when it changes lanes, and a turning back is not a point moving across the road.

The speed and the drift are steady over the look. The braking figure measured what a steady-speed reading costs when that fails along the road; nothing here measured a drift that starts mid-look, which is what a lane change is.

Every reading has a pixel of independent error. A matcher that follows the car ahead from frame to frame carries correlated errors, which make sixty pictures worth fewer than sixty readings, and which the speed reading — a slope through correlated depths — would feel first.

Still open: whether the car ahead’s own size reads its distance

A pair ranges the car in front from the disparity between its two pictures. A single camera has something the road did not offer: the car ahead has a size, and a car keeping pace keeps it, while a car being caught up grows in the picture. Its size gives its distance directly if the size is known, and its growth gives the time until the gap closes — the distance over the closing speed — even if the size is not, because both the distance and its rate of change scale with the same unknown size.

The measurement that settles what that is worth reads a single camera’s pictures of a car ahead of stated width, closing at stated speeds, and asks how well the time until the gap closes is read from the car’s growth over a second, whether it is read better than a pair reads distance over closing speed from its disparities, and how much a pair gains by using the car’s growth as well as its disparity — since the growth needs no baseline at all, and the blind point straight ahead, where the earlier essays found no depth, is exactly where a car ahead sits.

Shares its objects with

Essays that name at least two of the same things, and that neither author linked.

Named objects

A flat tag is an object no other essay names yet.

BaselineCovarianceDegenerate configurationDepth uncertaintyEpipoleMoving viewpointTriangulation