brad's blog

Nate Silver is Not God and other political musings

In the wake of the election, the big nerd story is the perfect stats-based prediction that Nate Silver of the 538 blog made on the results in every single state. I was following the blog and like all, am impressed with his work. The perfection gives the wrong impression, however. Silver would be the first to point out he predicted Florida as very close with a slight lean for Obama, and while that is what happened, that's really just luck. His actual prediction was that it was too close to call. But people won't see that, they see the perfection. I hope he realizes he should try to downplay this. For his own sake, if he doesn't, he has nowhere to go but down in 2014 and 2016.

But the second reason is stronger. People will put even more faith in polls. Perhaps even not faith, but reasoned belief, because polls are indeed getting more accurate. Good polls that are taken far in advance are probably accurate about what the electorate thinks then, but the electorate itself is not that accurate far in advance. So the public and politicians should always be wary about what the polls say before the election.

Silver's triumph means they may not be. And as the metaphorical Heisenberg predicts, the observations will change the results of the election.

There are a few ways this can happen. First, people change their votes based on polls. They are less likely to vote if they think the election is decided, or they sometimes file protest votes when they feel their vote won't change things. Vice versa, a close poll is one way to increase turnout, and both sides push their voters to make the difference. People are going to think the election is settled because 538 has said what people are feeling.

The second big change has already been happening. Politicians change their platforms due to the polls. Danny Hillis observed some years ago that the popular vote is almost always a near tie for a reason. In a two party system, each side regularly runs polls. If the polls show them losing, they move their position in order to get to 51%. They don't want to move to 52% as that's more change than they really want, but they don't want to move to less than 50% or they lose the whole game. Both sides do this, and to some extent the one with better polling and strategy wins the election. We get two candidates, each with a carefully chosen position designed to (according to their own team) just beat the opposition, and the actual result is closer to a random draw driven by chaotic factors.

Well, not quite. As Silver shows, the electoral college stops that from happening. The electoral college means different voters have different value to the candidates, and it makes the system pretty complex. Instead of aiming for a total of voters, you have to worry that position A might help you in Ohio but hurt you in Florida, and the electoral votes happen in big chunks which makes the effect of swing states more chaotic. Thus poll analysis can tell you who will win but not so readily how to tweak things to make the winner be you. The college makes small differences in overall support lead to huge differences in the college.

In Danny's theory, the two candidates do not have to be the same, they just have to be the same distance from a hypothetical center. (Of course to 3rd parties the two candidates do tend to look nearly identical but to the members of the two main parties they look very different.)

Show me the money?

Many have noted that this election may have cost $6B but produced a very status quo result. Huge money was spent, but opposed forces also spent their money, and the arms race just led to a similar balance of power. Except a lot of rich donors spent a lot of their money, got valuable access to politicians for it, and some TV stations in Ohio and a few other states made a killing. The fear that corporate money would massively swing the process does not appear to have gained much evidence, but it's clear that influence was bought.

I'm working on a solution to this, however. More to come later on that.

Ballot Propositions

While there have been some fairly good ballot propositions (such as last night's wins for Marijuana and marriage equality) I am starting to doubt the value of the system itself. As much as you might like the propositions you like, if half of the propositions are negative in value, the system should be scrapped. Indeed, if only about 40% are negative, it should still be scrapped because of the huge cost of the system itself.

Larry Niven and Greg Benford on "Bowl of Heaven" and Big, Dumb Objects

Last month, I invited Gregory Benford and Larry Niven, two of the most respected writers of hard SF, to come and give a talk at Google about their new book "Bowl of Heaven." Here's a Youtube video of my session. They did a review of the history of SF about "big dumb objects" -- stories like Niven's Ringworld, where a huge construct is a central part of the story.

Topic: 

Nissan's Self-Parking Leaf

Nissan is showing a modified Leaf able to do "valet" park in a controlled parking lot. The leaf downloads a map of the lot, and then, according to Nissan engineers, is able to determine its position in the lot with 4 cameras, then hunt for a spot and go into it. We've seen valet park demonstrations before, but calculating position entirely with cameras is somewhat new, mainly because of the issues with how lighting conditions vary. In an indoor parking garage it's a different story, and camera based localization under the constant lighting should be quite doable.

Topic: 

Science Fiction movies at Palo Alto Film Festival, and Robocars legal in California

I haven't bothered quickly reporting on the robocar story every other media outlet covered, the signing by Jerry Brown of California's law to enable robocars. For those with the keenest interest, the video of the signing ceremony has a short talk by Sergey Brin on some of his visions for the car where he declares that the tech will be available for ordinary people within 5 years.

Panorama of Shuttle fly-by at Moffett Field

Today marked the last trip through the air for the space shuttle, as the Endeavour was carried to LA to be installed in a museum. The trip included fly-overs of the Golden Gate bridge and many other landmarks in SF and LA, and also a low pass over Nasa Ames at Moffett Field, where I work at Singularity University. A special ceremony was done on the tarmac, and I went to get a panoramic photo.

Topic: 

Armstrong and the heroes of the 20th century

For years I have posed the following question at parties and salons:

By the 25th century, who will be the household names of the 20th century?

My top contender, Armstrong, has died today. I pick him because the best known name of the 15th century is probably Columbus, also known as the first explorer to a major location -- even though he probably wasn't the actual first.

Topic: 

Olympic high-speed watching and other notes

MythTV

I'm watching the Olympics, and my primary tool as always is MythTV. Once you do this, it seems hard to imagine watching them almost any other way. Certainly not real time with the commercials, and not even with other DVR systems. MythTV offers a really wide variety of fast forward speeds and programmable seeks. This includes the ability to watch at up to 2x speed with the audio still present (pitch adjusted to be natural) and a smooth 3x speed which is actually pretty good for watching a lot of sports. In addition you can quickly access 5x, 10x, 30x, 60x, 120x and 180x for moving along, as well as jumps back and forth by some fixed amount you set (like 2 minutes or 10 minutes) and random access to any minute. Finally it offers a forward skip (which I set to 20 seconds) and a backwards skip (I set it to 8 seconds.)

MythTV even lets you customize these numbers so you use different nubmers for the Olympics compared to other recordings. For example the jumps are normally +/- 10 minutes and plus 30 seconds for commercial skip, but Myth has automatic commercial skip.

A nice mode allows you to go to smooth 3x speed with closed captions, though it does not feature the very nice ability I've seen elsewhere of turning on CC when the sound is off (by mute or FF) and turning it off when sound returns. I would like a single button to put me into 3xFF + CC and take me out of it.

Anyway, this is all very complex but well worth learning because once you learn it you can consume your sports much, much faster than in other ways, and that means you can see more of the sports that interest you, and less of the sports, commercials and heart-warming stories of triumph over adversity that you don't. With more than 24 hours a day of coverage it is essential you have tools to help you do this.

I have a number of improvements I would like to see in MythTV like a smooth 5x or 10x FF (pre-computed in advance) and the above macro for CC/FF swap. In addition, since the captions tend to lag by 2-3 seconds it would be cool to have a time-sync for the CC. Of course the network, doing such a long tape delay, should do that for you, putting the CC into the text accurately and at the moment the words are said. You could write software to do that even with human typed captions, since the speech-recognition software can easily figure out what words match once it has both the audio and the words. Nice product idea for somebody.

Watching on the web

This time, various networks have put up extensive web offerings, and indeed on NBC this is the only way to watch many events live, or at all. Web offerings are good, though not quite at the quality of over-the-air HDTV, and quality matters here. But the web offerings have some failings

Topic: 

Vernor Vinge on Group Minds (plus in person tomorrow night at SU at Milton Friedman centennial)

A month ago I hosted Vernor Vinge for a Bay Area trip. This included my interview with Vinge at Google on his career and also a special talk that evening at Singularity University. In the 1980s, Vinge coined the term "the singularity" even though Ray Kurzweil has become the more public face of the concept of late.

Topic: 

Meter to show speakers when they are losing the audience

Any speaker or lecturer is familiar with a modern phenomenon. A large fraction of your audience is using their tablet, phone or laptop doing email or surfing the web rather than paying attention to you. Some of them are taking notes, but it's a minority. And it seems we're not going to stop this, even speakers do it when attending the talks of others.

A 120mph robocar-mostly lane in the off-hours?

I'm here in Newport beach at the Transportation Research Board's conference on self-driving vehicles. Today in a pre-session there was discussion of pre-robocar technologies and in particular applications of "managed lanes" and what the might mean for these technologies. Managed lanes are things like HOV/carpool lanes, HOT (carpool+toll), reversible lanes etc. Many people imagine these lanes would be used with pre-robocar technologies like convoys, super-cruise, cooperative ACC, Bus Rapid Transit etc.

Topic: 

Japanese robocar lanes

A study is underway in Japan to build dedicated lanes for self-driving cars.

There have been experiments with dedicated lanes in the past, including a special automated lane back in the 90s in San Diego. The problem is much easier to solve (close to trivial by today's standards) if you have a dedicated lane, but this violates the first rule of robocars in my book -- don't change the infrastructure.

Topic: 

Nice concept UI for robotic taxi and delivery, plus a new blog

Hats off to the video embedded below, which was prepared for a futuristic transportation expo in my home town of Toronto.

Called the PAT (People and Things) this video outlines the UI and shows a period in the day of a robotic taxi/delivery vehicle as it moves around Toronto picking up people and packages.

Topic: 

Pages