Might the first, supervised robocars be... well... boring?


Let me confess a secret fear. I suspect that the first "autopilot" functions on cars is going to be a bit boring.

I'm talking the offerings like traffic jam assist from Mercedes, super cruise from Cadillac and others. The faster highway assist versions which combine ADAS functions like lane-keeping and adaptive cruise control to keep the car in its lane and a fixed distance from the car in front of you. What Tesla has promoted and what scrappy startup "Cruise" plans to offer as a retrofit later this year. This is, in NHTSA's flawed "levels" document what could be called supervision type 2.

Some of them also offer lane change, if you approve the safety of the change.

All these products will drive your car, slow or fast on highways, but they require your supervision. They may fail to find the lane in certain circumstances, because the makers are badly painted, or confusing, or just missing, or the light is wrong. When they do they'll kick out and insist you drive. They'll really insist, and you are expected to be behind the wheel, watching and grabbing it quickly -- ideally even noticing the failure before the system does.

Some will kick out quite rarely. Others will do it several times during a typical commute. But the makers will insist you be vigilant, not just to cover their butts legally, but because in many situations you really do need to be vigilant.

Testing shows that operators of these cars get pretty confident, especially if they are not kicking out very often. They do things they are told not to do. Pick up things to read. Do e-mails and texts. This is no surprise -- people are texting even now when the car isn't driving for them at all.

To reduce that, most companies are planning what they call "countermeasures" to make sure you are paying attention to the road. Some of them make you touch the wheel every 8 to 10 seconds. Some will have a camera watching your eyes that sounds an alarm if you look away from the road for too long. If you don't keep alert, and ignore the alarms, the cars will either come to a stop in the middle of the freeway, or perhaps even just steer wild and run off the road. Some vendors are talking about how to get the car to pull off safely to the side of the road.

There is debate about whether all this will work, whether the countermeasures or other techniques will assure safety. But let's leave that aside for a moment, and assume it works, and people stay safe.

I'm now asking the harder question, is this a worthwhile product? I've touted it as a milestone -- a first product put out to customers. That Mercedes offered traffic jam assist in the 2014 S-Class and others followed with that and freeway autopilots is something I tell people in my talks to make it clear this is not just science fiction ideas and cute prototypes. Real, commercial development is underway.

That's all true, and I would like these products. What I fear though, is whether it will be that much more useful or relaxing as adaptive cruise control (ACC.) You probably don't have ACC in your car. Uptake on it is quite low -- as an individual add-on, usually costing $1,000 to $2,000, only 1-2% of car buyers get it. It's much more commonly purchased as part of a "technology package" for more money, and it's not sure what the driving force behind the purchase is.

Highway and traffic jam autopilot is just a "pleasant" feature, as is ACC. It makes driving a bit more relaxing, once you trust it. But it doesn't change the world, not at all.

I admit to not having this in my car yet. I've sat in the driver's seat of Google's car some number of times, but there I've been on duty to watch it carefully. I got special driver training to assure I had the skills to deal with problem situations. It's very interesting, but not relaxing. Some folks who have commuted long term in such cars have reported it to be relaxing.

A Step to greater things?

If highway autopilot is just a luxury feature, and doesn't change the world, is it a stepping stone to something that does? From a standpoint of marketing, and customer and public reaction, it is. From a technical standpoint, I am not so sure. Highway cruise products are being created out of existing ADAS tools -- like ACC, FCA (Forward Collision Avoidance) and Lane-keeping. Those tools are great, but they are almost entirely created from radars and camera systems (most commonly the MobilEye.)

You learn something from driving with those, and you push progress in machine vision, computer vision and radar, but I suspect that the real robocars will not be based on ADAS technologies, or even evolutions of ADAS technologies, not at first.

I am highly confident that standby and unsupervised cars will work with LIDAR as their primary sensor for localization and perception of other vehicles on the road. That's because LIDAR is quickly becoming cheap, and cameras are not yet able to delivery the reliability levels desired. Nobody, no matter how much they love vision based systems, is going to leave out LIDAR on the first vehicles just to save $500. The first car is the car of greatest risk, you will do all you can reasonably do to make it as safe as you can.

This is the error of the NHTSA and SAE "levels." These levels have a focus on the amount of human supervision a car needs to be safe. Level 2 is "Fully supervised." Level 3 is "Standby" -- a human is not supervising ordinarily but must be standing by to take control on modest (non-super-urgent) notice. Level 4/5 is "unsupervised."

NHTSA's 3 categories of supervision do have one valid ordering, in that doing 4 is harder than 3, and 3 is harder than 2. This is misleading, though, as they are not an evolution plan. Standby doesn't necessarily derive from the technologies used in fully supervised. Unsupervised will use some of the technologies of standby, but it also will invent some entirely different paths to the solution. SAE has even explicitly declared the numbers are not an evolution plan in their latest revision of their document.

Google has issued doubts about the Standby category. They built it and tested it with commuting employees, though told them to supervise just in case. They found the employees after a week or two of use quickly did things to make the team uncomfortable. The transition from standby mode to manual driving is a complex and risky one -- one that Google decided to simply eliminate in its next generation of prototypes.

The first commercial robocar was the Navia, which is in the Unsupervised category over private roads on a campus. It has no wheel, it was never sold to operate in supervised or standby modes. In spite of the ordering of the levels, it was the "level" 4 that came first, ahead of 2 and 3. (Level 1 is just regular ADAS and has been here for years.)

The Supervised category of products being released now still have their value, beyond the luxury they may offer their users. Driving huge numbers of road miles teaches us much, particularly learning about all the times the systems fail. While you won't build a standby or unsupervised system out of ADAS tools, the ADAS tools actually offer a great fallback approach if the superior systems fail. While it might be too risky to drive 100 miles on an ADAS derived system without supervision, driving 0.1 miles to pull off a road after failure of another system may be a reasonable safety decision.

By coming out first, these systems will actually get the most "practice," which is to say the most experience. The more failures, the more work that can be done to fix them, and the better ability to know what you can handle safely and what you can't.

Radar is also likely to be a tool of all systems -- it's just too useful, too superhuman in its abilities to not make use of it. The supervised systems are teaching us more lessons about how to use and not use radar. Particularly worthwhile are newer efforts to make radar work on stopped objects. Radar sees through the most dense fog, which nothing else does.


"I’m now asking the harder question, is this a worthwhile product?"

An autodrive system where I have to, in effect, still be driving the car just in case the autodrive system has a problem? Nope, not a useful product. The whole "occupant does not pay any attention at all" is what people want. If you have to monitor the system at all times then you might as well just drive the car yourself.

Sure, you can say "well the computer is a better driver than the human", but then why do we want the human to take over in an emergency if they're a worse driver than the computer...


People might suggest that the speed of highway travel would require this vigilance because situations would evolve rapidly, but I'd counter that by saying you could restrict speed. A car that goes 35 mph tops and you don't drive it yourself--something that is, basically, a personal taxi--would definitely be better received than a car that can autodrive at 80 mph but you have to keep your hands on the wheel and pedals.


Also, you keep getting upset at the slow uptake of ACC. But you identify the issue yourself--that ACC is still considered a luxury feature and is packaged in with the options for that trim level. It's like backup cameras were until a couple of years ago. The rapid increase in backup camera installations is not because consumers suddenly said "hey, backup cameras, we really love these things now", it's because automobile makers started putting them in the standard trim level.

Until the point that robocars stop requiring active
supervision, how do we deal with the risk that commercial
aviation is so well aware of - automation dependence and
loss of situational awareness? If control is going to be
handed over to a human pilot ^W driver, it would probably
be at a relatively confusing moment. In aviation, at least
pilots have some numbers of seconds to minutes to figure out
what's going on, to reengage their OODA loops. On the ground
at highway speeds, it could well be a small number of seconds,
if that. The possibility of control handover to an
unexpecting driver sounds like a disaster waiting to happen.

See this recent article in the Daily Mail (but with very convincing video) of a Romanian who figured out he can fool his car into unsupervised driving using a pop bottle tied to the steering wheel.

Admittedly, the video is not boring, and in the future, actual-driver detection will be more discerning. But the point is that right now, people are happy to turn over control to even the limited self-driving available today.

I think Google made the right decision in bypassing the supervised mode. It actually sounds dangerous and the benefits from learning from early failures (some of which could be fatal) could be outweighed by damage to the whole concept of completely unsupervised driving. I just don't trust humans to behave responsibly and be ready to take over as soon as the vehicle finds itself in trouble.
If "supervised" driving is shown to be too dangerous this could be used to make "unsupervised" driving sound even more risky (which is false logic but words and perceptions matter).
At risk of sounding way too cynical, it is possible that this perception could help the big automakers politically delay the introduction of unsupervised vehicles. The issue for the big automakers is that unsupervised vehicles allow for much more economical taxi services that could greatly reduce car ownership. How big automakers would react to the introduction of autonomous taxis services is a big unknown. Large corporations protecting their shareholders and people protecting their careers don't always behave with societies long term interests at heart. Tobacco companies vrs health and various taxi industries vrs Uber are examples of self interest on raw display.

I hope that it's effective... and I wish I'd had it last night on 880. I find that I drive less safely and more aggressively when I'm bored and stuck in traffic. The difficulty is exactly as you say, in the failure modes with "supervision", which humans are terrible at... though we're probably even worse at standing-by. Neither one is at all interesting, and we're lulled by our hind brains into a false sense of safety and distraction.

I wonder if some form of controlled distraction/entertainment could be added to the interface.
I'd prefer it to be done by a UX expert, and I don't think a car manufacturer (Tesla?) would be good at it, but the integration could make our response times much faster and more consistent.

Add new comment