On Tuesday I stopped by the Atlantic’s Big Science day where Chris Gerdes of Stanford’s CARS centre announced results of their race between a robocar and humans on a racetrack. The winner — the humans, but only by a small margin. The CARS team actually studied human driver actions to program their car, but found the human drivers have gotten very good at squeezing most of the available performance out of the vehicles, leaving little room for the robot to improve.
Another result reaffirmed studies of passenger reactions. People taken through the first lap were quite scared, but by the next lap they relaxed and gained confidence in the system. This result shows up time and time again, and has convinced me that while many people tell me they think robocars will not become popular because people will be too scared to ride them, those people are wrong, even about their own behaviour. Most of them, at least.
Also on the Stanford front, Bryant Walker Smith, who has decided to make robocar law a specialty, has released an analysis of the legality of robocars in the USA. The conclusion — robocars which have a human occupant who can take the wheel in the event of a problem are probably legal in almost all states, not just the states that have explicitly made them legal.
DARPA humanoid robot contest includes driving
DARPA ran the 3 grand challenges for robocars but stopped in 2007 after the urban challenge. Their latest challege contest involves making humanoid robots, but the DARPA Robotics Challenge includes a phase where your robot should be able to do a variety of tasks on rough terrain, including getting into a car and driving it. There are 4 tracks to the challenge. 3 are in the physical world, with either provided robots or team-built robots. The 4th is in the virtual world which will allow smaller teams to compete without the cost of working with a physical robot. I have written before about the opportunities of a robocar simulator for testing and contests, and so I am eager to see how this simulator develops.
Research in China has advanced. The National Natural Science Foundation has announced the goal of diong a short drive near Beijing and finally a long trip all the way to Shenzhen, 2400km away. This project primarily uses vision and radar, so it will be interesting to see if they can do this reliably without lasers.
Three big automaker announcements — and not about V2V even though the ITS World Congress is going on this week.
First, Nissan, whose self-parking Leaf I just wrote about has also announced a steer-by-wire system and tests of a car that will swerve to avoid a sudden obstacle. Of course almost all cars have power steering, but in a steer-by-wire car there is no mechanical linkage by default from the steering wheel to the steering motors. This allows a wheel to have “software defined feel” and is good for eventual robocars. In such cars a fail-safe restores a mechanical link if the main system fails.
However, the swerving car, which is demonstrated avoiding a cardboard pedestrian which jumps out into the road, is a new level of technology for major car makers. (Braking for these obstacles has been done for a while.)
Not much later, Jerusalem company MobilEye announced they had converted an Audi A7 to self-drive using 5 of their cameras as well as radar. MobilEye makes the vision system found in a lot of different cars — their specialty is a dedicated chip for vision processing. This article, which is in Hebrew outlines the car, which cost 588K NIS to build.
Volvo, which uses MobilEye, announced today that their 2014 cars would feature a traffic jam assist. Several companies have announced traffic jam assist (which is a low speed lane-keeping plus ACC) but Volvo has put a firm date on it. Also new in Volvo’s system is doing more than following lane markers — it also swerves to follow the car in front of it, as long as that car stays in the lane.
Of course, this does leave open the question of what happens if 2 or more of these start following one another, but that’s some time in the future and they have time to work on it.
In other news, the NHTSA has announced a grant to a team at Virginia Tech to research safety standards for robocar user interfaces. They have in the past stated they think the handoff between manual and automatic is an important safety function they might regulate.
And yes, there is lots of V2V news from the ITS world congress, but my skepticism for most forms of V2V remains high.
Nissan is showing a modified Leaf able to do “valet” park in a controlled parking lot. The leaf downloads a map of the lot, and then, according to Nissan engineers, is able to determine its position in the lot with 4 cameras, then hunt for a spot and go into it. We’ve seen valet park demonstrations before, but calculating position entirely with cameras is somewhat new, mainly because of the issues with how lighting conditions vary. In an indoor parking garage it’s a different story, and camera based localization under the constant lighting should be quite doable.
This other video from Engadget with a more detailed demo shows the view from the car’s cameras, which appear to be on the side mirrors as well as front and back for a synthetic 360 degree view. They also have an Android app for control and the ability to view through the cameras. Alas, chances are low you would get that bandwidth in the parking garage, but it’s a cool demo.
There was a huge raft of press coverage after last week’s signing of the California law. This ranged from polls showing strong acceptance of the tech to editorial critiques about the law being too fanciful or the technology taking jobs. (It is true that there will be job displacement, but at the same time, Americans spend about 50 billion hours driving which is a much larger sink on the GDP.)
Tonight I will be on a panel at the Palo Alto International Film Festival at 5pm. Not on robocars, but on the role of science fiction in movies in changing the world. (In a past life, I published science fiction and am on this panel by virtue of my faculty position at Singularity University.)
Tomorrow (Wed Sep 19) I will give a robocars talk at Dorkbot SF in San Francisco. Dorkbot is a regular gathering of “People doing strange things with electricity” and there will be two other sessions.
Last week, the SARTRE project announced it was concluding after a long period of work on highway platooning. Volvo lead the project which demonstrated platoons on test tracks and on some real roads. They also did a number of worthwhile users studies in simulation.
People have been interested in platooning for a while. The main upsides they are looking for are:
It’s much easier than a Robocar — the platoon is lead by a truck with a professional driver who handles everything with human intelligence
Putting the car at short spacings can result in a huge increase in highway capacity, though you tend to want somewhat larger headways around the convoys
There is fuel saving — about 10% or so for the lead vehicle, and up to 30% for following vehicles, at spacings of about 4 to 6m. This is not quite as much as people hoped but it is real.
The equipment in the following cars is simple — V2V radios and possibly some radar for backup.
Unfortunately, platooning comes with some downsides as well
If you have an accident, it can be catastrophic as you might crash a whole convoy of vehicles.
Non-platoon drivers may interfere with the convoy. The gaps must be kept small enough that nobody tries to enter them. A non-member in the middle of the convoy is bad news. You need small gaps to save fuel too.
Trucks must go only at the front of the convoy due to their longer stopping distance. New trucks must insert in the middle. Cars can insert more easily at the end of the convoy.
Convoys in the right lane can make it harder for people merging, and in general they can present a barrier to traffic.
Driving with a short gap is disconcerting. Behind a truck, you can’t even see the lane markers.
In rain, your windshield gets completely washed out with spray (and sometimes salt spray) which is even more disconcerting.
Following cars get hit by small stones and debris from the forward vehicle. After a long period of following, windshields are unacceptably chipped or cracked.
While radar is the primary means of tracking the car in front, and almost all vehicles do a nice radar reflection from the rear licence plate, many vehicles have other reflections further forward. You must avoid trying to follow 4m behind the front of a truck! To help this, vehicles in the tests had superior radar reflectors mounted on them.
For good workable convoys, some of these problems need to be solved. It could be that in rain convoys must spread out (losing a lot of the fuel saving) though there is the danger of cars cutting in.
Convoys with longer gaps can still increase road capacity a lot, but they probably have to be robocar convoys. Robocar convoys can handle cars trying to cut into the gaps. They may wish to start honking if somebody cuts-in (and the car in front might also flash its rear lights and slow slightly to make it very clear to the cut-in that they should not have done this.) This would be a problem when convoys are new, as people might not know what it all means, though they would have tried to go into a space that is clearly too small to safety enter. Cars in convoys might need to have a screen on the back that can display a sign “You have barged into a convoy, change lanes immediately or be reported to police.”
Robocars could handle the rain to some degree, but even their laser sensors would not like operating in heavy spray, though their radars would get excellent returns from a reflector on the vehicles.
The stone chip problem is harder to solve. Robocars capable of full auto operation could try to protect their windshields, but this is disconcerting to occupants. And the rest of the car gets stone chips too.
It could be that platooning is only practical with vehicles that are dedicated to it, such as highway commute vehicles and long distance highway vehicles. Built for this purpose, they would just accept the stone chips as part of life. They might come with extra heavy duty wipers or other ways to deal with the rain. And they would be full robocars, able to handle disconnects and independent operation.
This result will disappoint those who felt platoons were a good early technology. I have felt they also suffered from a critical mass problem. To use a platoon, you would need to find one, and until the density of lead vehicles was high enough, you might not find one. You could do it at rush hour with mobile apps that track the presence of lead vehicles so you can time your departure to find one — you might even have an appointment for every commute. And they might run only on nice clean highways on dry days and still be valuable. But less valuable, I am afraid.
On lower speed roads the fuel saving is not much, but the problems are less. There are traffic lights on most low speed roads though which present another problem.
A round-up of just some of the recent robocar news:
Stanford Shelly at 120mph
While the trip up Pikes Peak by Stanford’s Audi TT did not offer the high speeds we had hoped for, they have recently being doing some real race driving tests, clocking the car around a track at 120mph. Even more impressive because this car drives with limited sensors. Here the goal is to test computer driven high-speed tactics — rounding corners, climbing hills and more. While they didn’t quite reach the times of professional drivers, chances are someday they will, just from the perfect understanding of physics.
Driving this fast is hard in the real world because you’re going beyond the range of most sensors (radar and special lidars can go further, and cameras can see very far but are not reliable in all lighting.) The Stanford team had a closed track to they were able to focus on cornering and skidding.
KPMG report on self-driving cars
The consulting firm KPMG has released an extensive report on self-driving cars. While it doesn’t contain too much that is new to readers of this site and blog, it joins the group which believes that car-to-car communication is going to be necessary for proper deployment of robocars. I don’t think so, and in fact think the idea of waiting for it is dangerous.
Speaking of V2V communication
For some time the V2V developers have been planning a testbed project in Ann Arbor, MI. They’ve equipped 3000 cars with “here I am” transponders that will broadcast their GPS data (position and velocity) along with other car data (brake application, turn signals, etc.) using DSRC. It is hoped that while these 3000 civilian cars will mostly wander around town, there will be times when the density of them gets high enough that some experiments on the success of DSRC can be made. Most of the drivers of the cars work in the same zone, making that possible.
If they don’t prove the technology, they probably won’t get the hoped-for 2013 mandate that all future cars have this technology in them. If they don’t get that, the 75mhz of coveted spectrum allocated to DSRC will get other hungry forces going after it.
I owe readers a deeper analysis of the issues around vehicle-to-vehicle communications.
Google cars clock 300,000 miles
Google announced that our team (they are a consulting client) has now logged 300,000 miles of self-driving, with no accidents caused by the software. It was also acknowledged that the team has also converted a hybrid Lexus RX-450h in addition to the Toyota Prius. Certainly a more
comfortable ride and the new system has very nice looks.
Google will also begin internal testing with team members doing solo commutes in the vehicles. Prior policy is vehicles are always operated off-campus with two staff onboard, as is appropriate in prototype systems.
Political attack ad goes after robocars
Jeff Brandes pushed Florida’s legislation to allow robocar testing and operations in that state, 2nd after Nevada. Now his political opponents have produced an ad which suggests robocars are dangerous and you shouldn’t vote for Mr. Brandes because of his support of them. While we should expect just about anything in attack ads, this is a harbinger of the real debate to come. I doubt the authors of the ads really care about robocars — they just hope to find anything that might scare voters. My personal view, as I have said many times, is that while the technology does have to go through a period where it is less safe because it is being prototyped and developed, the hard truth is that the longer we wait to deploy the technology, the more years we rack up with 34,000 killed on the roads in the USA and 1.2 million worldwide. And Florida’s seniors are among the first on the list to need robocars. Is Jim Frishe’s campaign thinking about that?
Collision Warning strongly pushed in Europe
The EU is considering changing its crash-safety rules so that a car can’t get a 5-star rating unless it has forward collision warning, or even forward-collision mitigation (where the system brakes if you don’t.) These systems are already proving themselves, with data suggesting 15% to 25% reductions in crashes — which is pretty huge. While the law would not force vendors to install this, there are certain car lines where a 5-star rating is considered essential to sales.
I’m here in Newport beach at the Transportation Research Board’s conference on self-driving vehicles. Today in a pre-session there was discussion of pre-robocar technologies and in particular applications of “managed lanes” and what the might mean for these technologies. Managed lanes are things like HOV/carpool lanes, HOT (carpool+toll), reversible lanes etc. Many people imagine these lanes would be used with pre-robocar technologies like convoys, super-cruise, cooperative ACC, Bus Rapid Transit etc.
As I’ve said before the first rule of robocars is “you don’t change the infrastructure.” First you must make the vehicles operate fully on the existing infrastructure. And people are doing that. But we can also investigate what happens next.
Robocars as many envision them do not thus need dedicated lanes, even though some of the simpler technologies might. Earlier we talked about electrification which is a pretty expensive adaptation. Let’s talk about high speed lanes.
Robocars (or any car) would be of much greater interest to people if they could go very fast in them. On one hand, the ability to work, read, watch video and possibly sleep in a robocar will mean to some that trip time is less important than comfort, and they might actually be happy with a slower trip with fewer disturbances. But sometimes a faster trip is very important, particularly on the long haul.
Today people are working hard to make robocars safe. Eventually they should be able to make them safe even at higher speeds, particularly on freeways that were designed for fairly high speeds. Even human drivers routinely see over 100mph on the autobahns of Germany. Problem is if you want to go 120mph outside of Germany , there’s no road you can easily do that on. The other cars, going 65 to 80mph in the fast lane will get in the way, creating an uncomfortable ride and possibly dangerous situations.
Many of today’s “managed lanes” are primarily for use in rush hour, from 5am to 9am and 3pm to 7pm. In other hours, traffic is very light. What if that special lane does not just become an ordinary lane after rush hour, but instead is converted to another special purpose. There are a lot of different technologies that might be able to become viable with such a lane.
The most interesting one to me is high speed. If the carpool lane switched to being the high-speed-car lane at 9:30am, I actually think a lot of people might very well delay their commutes and shift their hours. A one-hour commute at 8am or a 15 minute trip at 9:30am — not a hard choice for many. And lots of people travel mid-day for various purposes.
The high-speed lane would actually mandate a minimum speed, perhaps 100mph when the road is clear. To get in this lane you would need a car that is certified safe at that speed or above. This might be a robocar, but it might also be a human-driven car with sufficient driver-assist technologies to certify it safe at that speed. The lane would probably only be open in good weather, and would probably revert to ordinary status in the event the main road got congested for whatever reason. Vehicles in the lane would have to be connected vehicles, ready to receive signals about changes to the dynamic status of the lane.
There probably would also be a requirement for efficient vehicles. Wind drag at 120mph costs 4 times as much fuel per mile as wind drag at 60mph. These cars would have to be highly aerodynamic designs. They might also be capable of platooning to further reduce drag, though you would want to wait a while to assure safety before platooning at 120mph. You might insist on alternate fuels or even that they be electric vehicles or other low emission vehicles. It doesn’t matter — I think there are a lot of people who would pay a lot of money to be able to go 120mph.
The lanes in general would need to be separated from the main lanes. Most carpool lanes are already like that, though most of the ones in the SF Bay Area are not this style. Ideally they would be the style that even has a special merge lane at the points where entry and egress from the main lanes are possible.
If such a program were a success we could see more. For example, one could imagine adding an extra lane to Interstate 5 in the California central valley and have it be a high speed lane most of the time. The planned California High Speed Rail, which probably will never be finished, is forecast to cost $68 Billion. 2 extra lanes on I-5 in the central valley south of Sacramento would cost well under a billion, and offer fairly high speed travel to those in the valley — faster door to door than the HSR. And my calculations even suggest that aerodynamic electric vehicles would use less energy per passenger-mile than the HSR. (Definitely if they are shared by as few as 2-3 people or when designed for a platoon.) These teardrop-shaped cars would also be much more efficient than today’s cars when they slow down and ply the ordinary highways and streets.
It is not trivial to go 120mph in a robocar though. Your sensors must be long range so you can stop if they see something. If you want to build infrastructure, here is where the road might have sensors which can report on road obstacles and other vehicles to assure safety. If you’re building a whole high speed lane this is not an issue. The first rule of robocars is written to avoid needing new infrastructure to do ordinary driving and get most places — not to prevent you from taking advantage of new spending that justifies itself.
An MIT team has been working on a car that is “hard to crash.” Called the intelligent co-pilot it is not a self-driving car, but rather a collection of similar systems designed to detect if you are about to hit something and try to avoid it. To some extent, it actually wrests control from the driver.
When I first puzzled over the roadmap to robocars I proposed this might be one of the intermediary steps. In particular, I imagined a car where, in a danger situation, the safest thing to do is to let go of the wheel and have the car get you to a safe state. This car goes further, actually resisting you if you try to drive the car off the road or towards an obstacle.
This is a controversial step, and the reasons are understood by the MIT team. First of all, from a legal liability standpoint, vendors are afraid of overriding the human. If a person is in control of a vehicle and makes a mistake, they are liable. If a machine takes over and saves the day, it’s great, but if the machine takes over and there is an accident — an accident the human could have avoided — there could be high risks to the maker of the machine as well as the occupant. In most designs, the system is set up so that the human has the opportunity for control at all times.
Actually, it’s even worse. A number of car makers are building freeway autopilots which still require attention from the driver in case the lane markers disappear or other problems ensue. One way some of them have built this is to require the driver to touch the wheel every so often to show they are alert. They will beep if the driver does not touch the wheel, and they will even disengage if the driver waits for too long after the beep. Consider what the companies have interpreted the liability system to require: That the right course of action, when the system is driving and the driver has her hands off the wheel, is to disengage and let the vehicle wander freely and possibly careen off the road! Of course, they don’t want the vehicle to do that, but they want to make it clear to the driver that they can’t depend on the system, can’t decide to type a long E-mail while it is running.
And this relates to the final problem of human accommodation. When a system makes people safer, they compensate by being more reckless. For example, anti-lock brakes are great and prevent wheel lock-up on slippery roads — but they cause drivers to feel they have invincible brakes and studies show they drive more aggressively because of them. Only a safe robocar avoids this problem; its decisions will always be based on a colder analysis of the situation.
A hard-to-crash car is still a very good idea. Before a full robocar is available, it can make a lot of sense, particularly for aging people and teens with new licences. But it may never come to market due to liability concerns.
There have been experiments with dedicated lanes in the past, including a special automated lane back in the 90s in San Diego. The problem is much easier to solve (close to trivial by today’s standards) if you have a dedicated lane, but this violates the first rule of robocars in my book — don’t change the infrastructure.
Aside from the huge cost of building the dedicated lanes, once you have built a lane you now have a car which can only drive itself in that dedicated lane. That’s a lot less valuable to the customer, effecitvely you are only get customers who happen to commute on that particular route, rather than being attractive to everybody. And you can’t self-drive on the way to or from the highway, so it is not clear what they mean when they say the driver sets a destination, other than perhaps the planned exit.
Yes, the car is a lot cheaper but this is a false economy. Robocar sensors are very expensive today but Moore’s law and volume will make them cheaper and cheaper over time. Highway lanes are not on any Moore’s law curve, in fact they are getting more expensive with time. And if the lane is dedicated, that has a number of advantages, though it comes with a huge cost.
Of course, today, nobody has a robocar safe enough to sell to consumers for public streets. But I think that by the early 2020s, when this study might recommend completing a highway, the engineers would open up the new lane and find that while it’s attractive for its regular nature and especially attractive if it is restricted and thus has lighter and more regular traffic, the cars are already able to drive on the regular lanes just fine.
A better proposal, once robocars start to grow in popularity, would be to open robocar lanes during rush hour, like carpool lanes. These lanes would not be anything special, though they would feature a few things to make the car’s job easier, such as well maintained markings, magnets in the road if desired, no changes in signage or construction without advance notice etc. But most of all they would be restricted during rush hour so that cars could take advantage of the smooth flow and predictable times that would come with all cars being self-driving. Unless humans kept taking over the cars and braking when they got scared or wanted to look at an accident in the other lanes, these lanes would be metered and remain free of traffic jams. However, you need enough robocar flow to justify them since if you only use half the capacity of a lane it is wasteful. On the other hand, such lanes could be driven by the more common “super cruise” style cars that just do lane following and ACC.
Hats off to the video embedded below, which was prepared for a futuristic transportation expo in my home town of Toronto.
Called the PAT (People and Things) this video outlines the UI and shows a period in the day of a robotic taxi/delivery vehicle as it moves around Toronto picking up people and packages.
I first learned about the video from a new blog on the subject of consumer self driving cars — as far as I know the second serious one to exist after this one. The Driverless Car HQ started up earlier this year and posts with a pretty solid volume. They are more comprehensive in posting various items that appear in the media than I am, and cover some areas I don’t, so you may want to check them out. (That’s a conscious choice on my part, as I tend not to post links to stories that I judge don’t tell us much new. An example would be that the SARTRE road train just did a demo in Spain last month, but it was not much different from demos they had done before.)
Of course, as I said earlier, sadly “Driverless Car” is one of my least favourite terms for this technology, but that doesn’t impede the quality of the blog. In addition, while I do report news on the Google car on this blog, I tend to refrain from commentary due to being on that team, and the folks at DCHQ are not constrained this way.
Face recognition of passengers as they approach the car
Automatic playing of media for the passengers (apparently resuming from media paused earlier in some cases)
Doing package delivery work when needed
Self-cleaning after each passenger
Optional ride-share with friends
In-car video conferencing on the car’s screens
Offering the menu of a cafe which is the destination of a trip. (Some suspect this is a location-based ad spam, but I think it’s a more benign feature because the passenger is picking up his ride-share friend at the cafe.)
And the UIs are slick, if a bit busy, and nicely done.
The concept vehicle at the Brickworks is fairly simple but does present some ideas I have felt are worthwhile, such as single passenger vehicles, face to face seating etc. It’s a bit too futuristic, and not aerodynamic. In the concept, it adjusts for the handicapped. I actually think that’s the reverse of what is likely to happen. Rather than making all cars able to meet all needs, it makes more sense to me to have specialized cars that are cheaper and more cost effective at their particular task, and have dedicated (more expensive) vehicles for wheelchairs. (For example, I like the hollow vehicles like the Kenguru.) I think you serve the disabled better for the same money by having these specialized vehicles — the wait may be slightly longer, but the vehicle can be much better at serving the individual’s needs.
Ford, which has already touted the value of robocars, has announced plans to do a traffic-assist autopilot system sometime mid-decade. Ford joins Mercedes, VW/Audi and Cadillac in announcing such systems. Ford’s vehicle will also offer automatic parking in perpendicular parking spots. For some time many cars have offered automated parallel parking. Since most people do not find perpendicular parking all that difficult, perhaps their goal here is very tight spaces (though that would require getting out of the car and blocking the rude driver, which I have found out only gets your car vandalized) or possibly parking in a personal garage that is very thin.
AUVSI and Mercedes
On the negative front, Mercedes appears to have backed off their plan to offer a traffic jam assistant in the 2013 S class. Earlier in June I attended the AUVSI “Driverless Car Summit” in Detroit, and Mercedes indicated that while they do have that technology in their F.800 concept car, this is only a prototype. As currently set up, the Mercedes system requires you to touch the wheel every 8 seconds. Honda was promoting this in 2006. Mercedes also showed their “6D” stereo vision based system which demonstrated impressive object tracking. They also claimed it does as well in differing light conditions, which would be a major breakthrough.
Some other notes from the conference:
There was effectively universal hate for the term “driverless car.” I join the haters, since the car has a driver, but it’s a computer. No other term won big support, though.
While AUVSI is about unmanned military vehicles, they put on a nicely demilitarized conference, which was good.
There were still a lot of fans of DSRC (a car data radio protocol) and V2V communications. Some from that community have now realized they went down the wrong path but a lot had made major career investments and will continue to push it, including inside the government.
The NHTSA is doing a research project on how they might regulate safety standards. They have not laid out a strategy but will be looking at sensor quality, low level control system squality, UI for the handoff between manual and self-driving and testing methodology.
I liked Mercedes’ terms for various modes of self-driving: Feet off, Hands off, Eyes off and Body out. The car companies are aiming at hands off, Google is working on Eyes Off but Body out (which means being so good that the car can operate without anybody in it or without any attention from the occupant) is the true robocar and the long term goal for many but not all projects.
Continental showed more about their own cruising system that combines lane-keeping and automatic cruise-control. They now say they have the 10,000 miles of on-road testing needed for the Nevada testing licence, but have not yet decided if they will get one. There is some question is what they are doing requires a licence under the Nevada regulations. (I suspect it does not.) However, they were quizzed as to whether they were testing in Nevada without a licence, which they deny. Continental says their system is built entirely from parts that will be “production parts” as of early 2013.
Legal and states panels showed progress but not too much news. States seem to be pleased so far.
The National Federation for the Blind showed off their blind driving challenge. They have become keen on building a car which has enough automation for a blind person to operate but still uses the blind driver’s skills (such as hearing and thinking) to make the task possible. This is an interesting goal for the feeling of autonomy, but I suspect it is more likely they will just get full-auto cars sooner, and they accept this is likely.
Know me by my flyer number and don’t repeat things to me I’ve already certified as knowing, like safety rules
Know my language (I input it, after all) and don’t bother me with announcements other than in my best understood language
Show me most things as text, perhaps in a crawl under my show. If need be, have me confirm I understand.
Tailor the message to my age and my location in the plane. Show me exits on the screen for my seat.
Cut back on the spam about how great your airline is, how wonderful the FF plan is or why I should buy duty free.
Today, instead you can see the visible frustration on the faces of flyers as their movie is interrupted so that they can here the translation into Russian of the long announcement they just heard in German and English.
Having good custom in-flight entertainment is good, and considered a major competitive feature, but already I see more and more people preferring to put out a tablet, even when they have a super-fancy system in the first-class seats. The tablet of course does not have the interruptions (even for the tiny number of real announcements such as in our case last week, “we can’t get the landing gear doors to close so we’re dumping fuel and returning to the airport”) and it also has, if you prepare it, customized entertainment that you know you want to watch.
Frankly, I am not sure who programs the video selections on many of the airlines but I have to suspect they don’t just try to get the best movies with good reviews. They either try to get the cheapest movies or have deals with certain studios — it’s amazing how few quality films they might have in a selection of 100 movies.
I also remain disappointed at how badly implemented most of the in-flight systems I have seen. They are all slow, with highly noticeable lags after keypresses, poor touchscreens, freezes and crashes. Any tablet or phone puts them to shame when it comes to UI and responsiveness. And to top it off, they are huge — on main airlines, many of the seats have reduced footroom to fit the box for the video system. (It also has other in-seat electronics I presume but still, it’s about 10x bigger than it needs to be.) This is odd particularly since in planes floor space and weight are at such a premium. A tablet computer, either fixed in the seat or on an anti-theft power/data tether, would provide a better system — smaller, lighter, better UI, cheaper, better screen — in just about every way. Of course when they first designed these seats years ago they did not have cheap tablets but there is little excuse to continue installing the old ones.
Wait, how could they have known? How could they have not known. It’s 2012. We’ve known for decades now that each year computer products get smaller, faster, cheaper and superior in major ways. When you are designing a system to install in the future, it’s a mistake to design it based on the current technology. You should bet that something better will be along and make your design adaptable to it. If nothing else your standard design is going to get faster and higher resolution — which makes the slow response time of the existing systems inexplicable.
Many airlines are starting to offer satellite TV. That’s better than the old limited selections (or in particular a single bad movie) but actually not too appealing. Aside from being full of commercials and ignoring your schedule, with TV the announcements and interruptions make you miss crucial parts of your show as they talk over them. More than once I’ve been watching a show on an airline to have them talk over the climax of the film.
I’m whining a lot but it’s because I do believe this is important. Truth is that on a flight you are often tired and cramped, and reading and working are not tremendously comfortable. I bring a book but read at a reduced speed. Having nice noise-cancelling headphones and a good in-flight entertainment system with quality content can make a make a flight much better, and it’s a shame that so many things are obviously wrong with the systems they have built. Today’s flights are stressful in any cabin, and a quiet and uninterrupted experience would do a lot to increase customer satisfaction.
There’s a lot of excitement about the potential of autonomous drones, be they nimble quadcopters or longer-range fixed wing or hybrid aircraft. A group of students from Singularity University, for example, has a project called MatterNet working to provide transportation infrastructure for light cargo in regions of Africa where roads wash out for half the year.
Closer to home, these drones are not yet legal for commercial use, while government agencies are using them secretly.
Here’s one useful idea: A small set of medical drones scattered around the city. Upon emergency call, they can fly, via a combination of autonomous navigation and remote-human-operated flying at the end, to any destination in the city within a couple of minutes. Call 911 and as soon as you say it’s a medical emergency the drone is on the way. When it gets there, the human operator lands it or even sends it in a balcony on tall buildings with balconies. Somebody has to carry it to the patient if they are far from the outside.
When it gets to the patient it has a camera and conferencing ability to a remote doctor can examine the patient and talk to people around the patient to ask them questions or give them instructions. It also could contain one of those “foolproof defibrillator” modules able to deal with many kinds of heart attacks. They are already in many buildings but this way they could be anywhere. It’s more useful than a taco.
The remote doctor could advise any medical staff who come, or give advice to the ambulance that’s on the way but not getting there for a few minutes. If a medicine that can be administered by a layperson is needed, there might be some in the drone but a second drone could be loaded and dispatched within a few minutes as well — that might take longer to fly but less time than an ambulance. You might not put any valuable medicines in the first drone to prevent people from summoning them just to steal them, though this might just happen for the valuable drone unless steps are taken to make that non-productive.
This should be combined with something I have felt is long overdue in the world of our mobile phones. People who are able to be on-call EMTs and doctors should have their phones updating their locations with a medical service while they are on call for such action. Then anybody with an emergency should be able to summon or get to the closest professional very quickly. (Of course there is no need to record this data after it changes, to avoid making a life-log of the doctor.) Nobody should ever have to ask “is there a doctor in the house?” 911 should be able to say, “There is a doctor 3 doors down, she’s been notified.” But the drone can always come, and bring a remote specialist if need be.
The other barrier to this is network dead zones. A map would need to be made of network dead zones and the drone would not fly into them, though it could fly through them. It would land just outside the dead zone and warn people not to carry it into one if the remote doctor’s services are needed.
Someday, the drone could contain a winner of the X-prize “Medical Tricorder” contest with sensors to diagnose all sorts of conditions, and it might even eventually be a robot able to administer emergency drugs — but the actual delivery and video feed is something we can do today.
One of my first rules of robocars is “you don’t change the infrastructure.” Changing infrastructure is very hard, very expensive, requires buy-in from all sorts of parties who are slow to make decisions, and even if you do change it, you then have a functionality that only works in the places you have managed to change it. New infrastructure takes many decades — even centuries, to become truly ubiquitous.
That’s why robocar enthusiasts have been skeptical of things like ITS plans for roadside to vehicle and vehicle to vehicle communications, plans for dedicated highway lanes with special markers, and for PRT which needs newly built guideways. You have to work with what you have.
There are some ways to bend this rule. Some infrastructure changes are not too hard — they might just require something as simple and cheap as repainting. Some new infrastructures might be optional — they make things better in the places you put them, but they are not necessary to operations. Some might focus on specific problem areas — like special infrastructure in heavy pedestrian areas or parking lots, enabling or improving optional forms of operation in those areas.
Another possiblility is to have robocars enable a form of new infrastucture, turning it upside down. The infrastructure might need the robocars rather than the other way around. I wrote about that sort of plan when discussing a solar panel on a robocar.
A recent proposal from Siemens calls for having overhead electric wires for trucks. Trolley buses and trams use overhead electric wires, and there are hybrid trolley buses (like the Boston T line) which can run either on the wires or on an internal diesel. These trucks are of that type. The main plan for this is to put overhead wires in things like shipping ports, where trucks are running around all the time, and they would benefit greatly from this.
I’ve seen many proposals for electrication of the roads. Overhead wires are problematic because they need to be high enough to go over the trucks and other high vehicles, but that makes them harder to reach by low vehicles. You need two wires and must get good contact. They are also damn ugly. This has lead to proposals for inductive power supplies buried in the road. This is very expensive as it requires tearing up the road. There are also inductive losses, and while you don’t need to make contact, precise driving is important for efficiency. In these schemes, battery-electric cars would be able to avoid using their batteries (and in fact charge them) while on the highway, vastly increasing their range and utility.
Robocars offer highly precise driving. This would make it easier to line up on overhead wires or inductive coils in the road. It even would make it possible to connect with rails in the roadbed, though right now people don’t want to consider having a high voltage rail on the ground, even on a highway.
It was proposed to me (I’m trying to remember by who — my apologies) that one new option would be a rail on the side of the highway. This lane would be right up against the guardrail, and normally would be the shoulder. In the guardrail would be power rails, and a connector would come from the left side of the vehicle. Only a robot would be able to drive so precisely as to do this safely. Even with a long pole and more distance I am not sure people would enjoy trying to drive like this. A grounding rail in the roadbed might also be an option — though again tearing up the roadbed is very expensive to do and maintain.
There is still the problem of having a live rail or wire at reachable height. The system might be built with an enclosed master cable and then segments of live wire which are only live when a vehicle is passing by them. Obviously a person doesn’t want to be there when a car is zooming through. This requires roboust switching eqiupment for the thousands of watts one wishes to transfer. You also have to face the potential that a car from the regular lanes could crash into the rail and wires, and while that’s never going to be safe you don’t want to make it worse. You also need switching if you are going to have accounting, so only those who pay for it get power. (Alternately it could be sold by a subscription so you don’t account for the usage and you identify cars that don’t have a subscriber tag who are sucking juice and fine them.)
There is also the problem that this removes the shoulder which provides safety to other cars and provides a breakdown lane. If a vehicle does have to stop in this lane for emergency reasons, sensors in the rail could make sure that all robocars would know and leave the lane with plenty of margin. They would all have batteries or engines and be able to operate off the power — indeed the power lines need not be continuous, you don’t have to build them in sections of the road where it’s difficult. If other cars are allowed to enter the lane, it must not be dangerous other than physically for them to brush the wires.
It’s also possible that the rail could be inductive. The robocar could drive and keep its inductor contact just a short distance from the coils in the rail. This is more expensive than direct contact, and not as efficient, but it’s a lot cheaper than burying inductors in the roadbed. It’s safe for pedestrians and most impacts, and while a hard impact could expose conductors, a ground fault circuit could interrupt the power. Indeed, because all vehicles on the line will have alternate power, interruption in the event of any current not returning along the return is a reasonable strategy.
For commuters with electric cars, there is a big win. You can get by with far less battery and still go electric. The battery costs a lot of money — more than enough to justify the cost of installing the connection equipment. And having less battery means less weight, and that’s the big win for everybody, as you make the vehicles more efficient when you cut out that weight. Of course, if this lane is only for use by electrified robocars, it becomes a big incentive to get one just to use the special lane.
The power requirements are not small. Cars will want 20kw to go at highway speed, and trucks a lot more. This makes it hard to offer charging as well as operating current, but smaller cars might be able to get a decent charge while driving.
I’m doing a former-cold-war tour this month and talking about robocars.
This Friday, May 11, I will be giving the 2301st lecture for the Philosophical Society of Washington with my new, Prezi-enabled robocars talk. This takes place around 8pm at the John Wesley Powell Auditorium. This lecture is free.
A week later it’s off to Moscow to enjoy the wonders of Russia.
There will be a short talk locally in between at a private charity event on May 14.
I have not intended for this blog to become totally about robocars but the news continues to flow at a pace more rapid than most expected.
Nevada has issued its first licence for an autonomous car — to Google, of course. This is a testing licence with a special red plate with an infinity symbol on it. It’s a cool looking licence but what’s really cool is that even in the 2000s when I would give talks on this technology and get called a ridiculous optimist, I never expected that we would see an official licenced robocar in the USA in the spring of 2012 — even if only for testing.
This is a picture of a car with a California plate. The new plate has licence number 001, you can see a picture here.
The Nevada law enabled both the testing of vehicles in the state and their eventual operation by regular owners. For testing, the vehicles need to have two people in them, as has been normal Google policy. They must do 10,000 miles first off of Nevada roads — either on test tracks, or in the case of the early vehicles, in other states that don’t have a 10,000 mile requirement. German auto and tire supplier Continental has said it’s been racking up the 10,000 miles and wants to apply, and press reports say other applicants are in the wings. As far as I know this is the first officially licenced car in the world, though several other research cars have gotten special one-off permits to allow them to be tested on the roads in places like Germany and China.
More information has come from the Google team (to which I am a consultant) at the Society of Automotive Engineers conference in Detroit. In a speech there, covered in the Detroit Free Press and many others Anthony Levandowski outlined how Google has been talking to all significant car manufacturers about how they might work together to produce cars with Google’s technology. Google is not looking to become a car manufacturer, but does want to see a real car on the roads — and not next decade.
At the same time, talks with insurance companies about how to provide insurance for self-driving cars are also going on. Insurance companies pay the cost of all accidents, either directly through policies bought by the driver, or indirectly through insurance sold to manufacturers, and of course all these policies and cars are really paid for by car owner/drivers. As long as accidents are lowered, and the cost per accident remains the same, it’s a win.
At the same time J.D. Power and Associates released a study on self driving car markets. This survey shows around a third of buyers would like to get self-driving functionality in their car, and about 20% would pay $3,000 for it. While advanced laser-based scanners cost much more than that today, I am confident that Moore’s Law and higher volumes can bring things down to that price. These numbers are quite high for such a radical new technology. Such technologies normally only require a small volume of early adopters to get them going. The varoius basic autopilots announced by car manufacturers which require you to still keep your attention on the road will sell for well under $3,000.
Sebastian Thrun, leader of the Google X Lab, recently appeared on Charlie Rose where he spoke about the car, about Glass, and mostly about Udacity, his personal online education project. Sebastian also publicly posted that he took one of the Google self-driving Lexus cars up to lake Tahoe this weekend. I do think those long vacation home drives will be a big driver of people to pay serious money for a self-driving car. Saving time on the average 30 minute commute is one thing, but the 4 hour drive to Lake Tahoe is a real change, especially if you can use the time to interact with your family or get in serious reading or video watching. Of course, right now, Sebastian was keeping his eyes on the road in case he needed to intervene, since this is still a prototype.
Finally, NHTSA has released a report saying that robocars could eliminate up to 80% of crashes. While they won’t get to that number right away, I think they can even do better in time. David Strickland, the head of NHTSA, has stated he has very high hopes for the technology, which is tremendous news, because it means that one my biggest fears in my early days of forecasting this technology — too much government opposition — seems less likely.
Some accidents are caused by mechanical failures (like tire blowouts or bad brakes) freak weather and other situations a self-driving car can’t do much about. We may never get to zero. But this should still be the biggest lifesafer in the developed world until somebody cures some of the biggest diseases.
While Mercedes has been reported as promising a traffic-jam autopilot in the 2013 S class due later this year, I was surprised to learn that Honda briefly made claims that their 2006 “Accord ADAS” in the UK was a self-driving car.
However this car is, as the name suggests, an ADAS car with Honda’s lane-keeping system which will nudge the car back into the lane if you drift out of it. Such lane keeping systems have indeed been around for a while. This car notices if you keep your hands off the wheel for more than a short time, and sounds an alarm. In order to “self-drive” the demonstrator keeps his hands close to the wheel and touches it every so often to avoid the alarm. You get the impression that he and others have been using the car in this fashion.
It is no idle alarm. The LKAS nudge is not quite powerful enough to steer the car in any kind of real turn, and the camera finding lane markers of course occasionally fails to find them. This, again is common in fancy ADAS cars. What is interesting is that Honda allowed this to be pitched as an attempt at self-driving. They have not done this recently, though lane-keep ADAS systems have continued to be available since then from Honda and other vendors.
Honda has been generally not too active in announcements of self-driving cars. They have shown concept cars that listed self-driving as one of the features, but these were concept cars, not actual implementations. Toyota and Nissan have both made various announcements. The smaller Japanese companies (Mazda, Mitsubishi and Subaru/Fuji) also have no public projects.
On a second note, I will be speaking Wednesday morning at the MLOVE Conference in Monterey on self-driving cars. Then I will be heading over to the Asilomar Microcomputer Workshop — a 35 year old conference I’ve been going to for decades which happens to be in the same place at the same time.
In the Cadillac video below, they explain the system as a combination of ACC, lane-keeping and GPS. This is similar to the other announced plans from many other car companies, including Mercedes, BMW, VW/Audi and others. The use of GPS suggests the car may also use map information, which is not known to be used by the other announced products, but is heavily used by Google and the various eyes-free projects.
It is pure speculation, but perhaps they are building maps of where the lane markers are reliable enough and where they have faded out so that they can refuse to super-cruise when approaching those zones. They might also use the GPS to assure you super-cruise only on the highway or other limited areas.
In the video, which shows a demo at about the 1:10 mark, they are driving on a test track, and always next to a blue line along the lane markers. Obviously a real product could not depend on special lane striping if it wants to be broadly usable, but this may assist them in testing their system with confidence. (ie. compare what their lane-finder detects to what an independent system that tracks the blue line detects.)
GM has had various self-driving projects, including the futuristic EN-V and the sponsorship of BOSS in the Darpa Urban Challenge. The Cadillac brand is well positioned. Self-driving is initially going to be a luxury feature, but companies that sell sporty performance cars don’t want to detract from their image as selling a fun driving experience. A pure luxury brand like Cadillac does not have as much of that problem as BMW and Mercedes have. At the same time, the video insists that they don’t want to take away from driving.