A recent story today about discussions for an official defense Botnet in the USA prompted me to post a question I've been asking for the last year. Are some of the world's botnets secretly run by intelligence agencies, and if not, why not?

Here's my latest assembled panorama, of the main square of Munich, known as Marienplatz, taken from the St. Peter's Church bell tower just to the south.

It seems that half the programs I try and install under Windows want to have a "daemon" process with them, which is to say a portion of the program that is always running and which gets a little task-tray icon from which it can be controlled. Usually they want to also be run at boot time. In Windows parlance this is called a service.

I learned today that there is an exhibit about my father in the famous creation museum near Cincinnati. This museum is a multi-million dollar project set up by creationists as a pro-bible "natural history" museum that shows dinosaurs on Noah's Ark, and how the flood carved the Grand Canyon and much more. It's all completely bullocks and a number of satirical articles about it have been written, including the account by SF writer John Scalzi.

I'm scanning my documents on an ADF document scanner now, and it's largely pretty impressive, but I'm surprised at some things the system won't do.

Double page feeding is the bane of document scanning. To prevent it, many scanners offer methods of double feed detection, including ultrasonic detection of double thickness and detection when one page is suddenly longer than all the others (because it's really two.)

PCs can go into standby mode (just enough power to preserve the RAM and do wake-on-lan) and into hibernate mode (where they write out the RAM to disk, shut down entirely and restore from disk later) as well as fully shut down.

I've been ranting of late about the dangers inherent in "Data Portability" which I would like to rename as BEPSI to avoid the motherhood word "portability" for something that really has a strong dark side as well as its light side.

But it's also important to come up with an alternative. I think the best alternative may lie in what I would call a "data deposit box" (formerly "data hosting.") It's a layered system, with a data layer and an application layer on top. Instead of copying the data to the applications, bring the applications to the data.

A data deposit box approach has your personal data stored on a server chosen by you. That server's duty is not to exploit your data, but rather to protect it. That's what you're paying for. Legally, you "own" it, either directly, or in the same sense as you have legal rights when renting an apartment -- or a safety deposit box.

Your data box's job is to perform actions on your data. Rather than giving copies of your data out to a thousand companies (the Facebook and Data Portability approach) you host the data and perform actions on it, programmed by those companies who are developing useful social applications.

As such, you don't join a site like Facebook or LinkedIn. Rather, companies like those build applications and application containers which can run on your data. They don't get the data, rather they write code that works with the data and runs in a protected sandbox on your data host -- and then displays the results directly to you.

To take a simple example, imagine a social application wishes to send a message to all your friends who live within 100 miles of you. Using permission tokens provided by you, it is able to connect to your data host and ask it to create that subset of your friend network, and then e-mail a message to that subset. It never sees the friend network at all.

Been getting a bunch of calls from reporters this weekend. Our good friend spam turns 30 in a couple of days, and a few years ago I did some research and became an authority on the history of the term and the phenomenon. Since everybody else is doing it, I though I should point to my various articles on the history of spam, as well as some updates I just wrote for the 30th.

I've spoken about the Web 2.0 movement that is now calling itself "data portability." Now there are web sites, and format specifications and plans are underway to make it possible to quickly export the personal data you put on one social networking site to another. While that sounds like a good thing -- we like interoperability, and cooperation, and low barriers to entry on new players -- I sometimes seem like a lone voice warning about some of the negative consequences of this.

Ok, this would be a cool application for iPhones, Pocket PC and the like -- a dialer which presents an old style rotary phone dial, and you have to put your finger in it and spin it around the center, and then it slowly twists back and plays the sound of a dial returning. A bit like how you control an iPod, but slower.

Completely useless, other than for having fun and explaining to kids why we call it "dialing" a phone.

With sadness I must report the passing of William C. Tate, my stepfather, on Thursday. Bill and my mother met and fell in love when I was a young teenager. He was a neighbour, and I had met him, and even stayed over at his house with his son before they would meet, which is a bit unusual. He was kind and generous and supported her and our family for many decades. While he died from cancer, it came upon him quite suddenly and he was fortunately strong until near the end.

Ok, admit it, who likes blogging in to a vacuum. You want to know how many people are actually reading your blog.

I have created a simple Perl script that scans your blog's log file and attempts to calculate how many people read the blog and the RSS feeds.

You can download the feed reader script. I release it under GPL2.

Recently, while keynoting the Freedom 2 Connect conference in Washington, I spoke about some of my ideas for fiber networks being built from the ground up. For example, I hope for the day when cheap kits can be bought at local stores to fiber up your block by running fiber through the back yards, in some cases literally burying the fiber in the "grass roots."

It was good to see a major newsmagazine like Time do its cover story on the corn ethanol scam this week. I've been worried about corn as a source of biofuel for some time. So far, it makes no sense, and is only used because of the power of the corn lobby and senators from agricultural states. I've read various arguments (all with political agendas) about just how much petrofuel is burned in order to make corn based ethanol.

No, I don't mean dissolve congress. Rather I propose a different way to run a legislature in the modern world.

Note to new readers: This article explores the consequences of using so much fuel to produce our food. If you come out of it thinking it's telling you to drive rather than get some exercise, you didn't read it! But if you like surprising numbers like this, check out the rest of my Going Green section and other sections.

Pundits like to point out when some new media technology changes seriously changed politics. When I was young, everybody talked about how the Kennedy-Nixon debates ushered in the era of the TV candidate and changed politics forever. (It did indeed seem unlikely a candidate in a wheelchair from polio could win today, but in fact in Bob Dole and John McCain we have two candidates without full use of their arms.)

No doubt when radio came into play there was similar commentary.

Quite some time ago, I challeged readers to come up with a better word than The Singularity to describe the phenomenon, famously named and described by Vernor Vinge, of a technological gulf so wide that it is impossible to understand and predict beyond it.

While it's stupid that the biggest story to come out of South by Southwest (SXSW) Interactive was the gossip over the interview of Mark Zuckerberg by Sarah Lacy, the one "hook" that has kept the story going is the suggestion that it was the use of twitter, in particular snide comments on twitter, which turned the audience against Lacy, the interviewer from Business Week.

There have even been comments (from those who weren't even there) suggesting witch hunts and misogyny. Other bloggers used hyperbolic terms like "train-wreck" and "career-ending" which are serious exaggerations.

Short summary. In a "keynote" interview, Lacy, who has just finished a book about Facebook, was on stage to interview Zuckerberg. Zuckerberg was, as usual, a difficult interview subject, but for a variety of reasons the character of the interview changed as the audience turned against Lacy, cheering criticism of her. Most agreed they had not seen somebody lose an audience like this in some time.

Earlier I wrote an essay on the paradox of identity management describing some counter-intuitive perils that arise from modern efforts at federated identity. Now it's time to expand these ideas to efforts for portable personal data, especially portable social networks.

Partly as a reaction to Facebook's popular applications platform, other social networking players are seeking a way to work together to stop Facebook from taking the entire pie. The Google-lead open social effort is the leading contender, but there are a variety of related technologies, including OpenID, hcard and other microformats. The primary goal is to make it easy, as users move from one system to another, or run sub-abblications on one platform, to make it easy to provide all sorts of data, including the map of their social network, to the other systems.

Some are also working on a better version of this goal, which is to allow platforms to interoperate. As I wrote a year ago interoperation seems the right long term goal, but a giant privacy challenge emerges. We may not get very many chances to get this right. We may only get one.

The paradox I identified goes against how most developers think. When it comes to greasing the skids of data flow, "features" such as portability, ease of use and user control, may not be entirely positive, and may in fact be on the whole negative. The easier it is for data to flow around, the more it will flow around, and the more that sites will ask, and then demand that it flow. There is a big difference between portability between applications -- such as OpenOffice and MS Word reading and writing the same files -- and portability between sites. Many are very worried about the risks of our handing so much personal data to single 3rd party sites like Facebook. And then Facebook made it super easy -- in fact mandatory with the "install" of any application -- to hand over all that data to hundreds of thousands of independent application developers. Now work is underway to make it super easy to hand over this data to every site that dares to ask or demand it.