Science & Technology

The Long Tail of Forgotten Works

I’m currently reading Chris Anderson’s book The Long Tail, and he relates a story about how some books find an audience long after they’ve been published.

In 1988, a British mountain climber named Joe Simpson wrote a book called Touching the Void, a harrowing account of near death in the Peruvian Andes. Though reviews for the book were good, it was only a modest success, and soon was largely forgotten. Then, a decade later, a strange thing happened. Jon Krakauer wrote Into Thin Air, another book about a mountain-climbing tragedy, which became a publishing sensation. Suddenly Touching the Void started to sell again.

Booksellers began promoting it next to their Into Thin Air displays, and sales continued to rise. In early 2004, IFC Films released a docudrama of the story, to good reviews. Shortly thereafter, HarperCollins released a revised paperback, which spent fourteen weeks on the New York Times best-seller list. By mid-2004, Touching the Void was outselling Into Thin Air more than two to one.

What happened? Online word of mouth. When Into Thin Air first came out, a few readers wrote reviews on Amazon.com that pointed out the similarities with the then lesser-known Touching the Void, which they praised effusively. Other shoppers read those reviews, checked out the older book, and added it to their shopping carts. Pretty soon the online bookseller’s software noted the patterns in buying behavior–“Readers who bought Into Thin Air also bought Touching the Void“–and started recommending the two as a pair. People took the suggestion, agreed wholeheartedly, wrote more rhapsodic reviews. More sales, more algorithm-fueled recommendations–and a powerful positive feedback loop kicked in.

Particularly notable is that when Krakauer’s book hit shelves, Simpson’s was nearly out of print. A decade ago readers of Krakauer would never even have learned about Simpson’s book–and if they had, they wouldn’t have been able to find it. Online booksellers changed that. By combining infinite shelf space with real-time information about buying trends and public opinion, they created the entire Touching the Void phenomenon. The result: rising demand for an obscure book.

There is something interesting going on here. I’m wondering how many great works of art are simply lost in obscurity. These days, we’ve got the internet and primitive tools to traverse the long tail, so it seems that a lot of obscure works find a new audience when a new, similar work is released. But what happened before the internet? How many works have simply gone out of print because they never found an audience – how many works suffered the fate Touching the Void narrowly avoided?

Of course, I have no idea (that’s kinda the point), but one of the great things about the internet and the emerging infinite shelf space of online retailers is that some of these obscure works are rediscovered and new connections are made. For instance, I once came accross a blog post by Jonathon Delacour about this obscure Japanese horror film called Matango: Attack of the Mushroom People. The description of the film?

After a yacht is damaged in a storm and stranded on a deserted island, the passengers: a psychologist, his girlfriend, a wealthy businessman, a famous singer, a writer, a sailor and his skipper take refuge in a fungus covered boat. While using the mushrooms for sustenance, they find the ship’s journal describing the mushrooms to be poisonous, however some members of the shipwrecked party continue to ingest the mysterious fungi transforming them into hideous fungal monsters.

Sound familiar? As Delacour notes, a reviewer on Amazon.com sure thinks so:

Was this the Inspiration for Gilligan’s Island? …and that’s a serious question. It predated the premier of Gillian’s Island by several years. There’s a millionaire who owns a yacht that looks like the Minnow. On board is a professor, the captain, a goofy (though somewhat sinster in the film) first mate, a pretty but shy country girl named Okiko, and a singer/movie star. There are seven castaways in all. “Lovey” is replaced by another male character, a writer named Roy. The boat crashes into an island where they are castaways… Course on Gilligan’s Island they didn’t all turn into mutated mushrooms monsters. Rent or buy the DVD (one of my favorite films in Japanese cinema, finally getting its due…) and you tell me if Gilligan’s Island isn’t a complete rip-off of this film.

Several reviewers actually make the Gilligan’s Island connection, and one even takes time to refute the claim that Gilligan ripped off Matango:

Actually as stated on this DVD’s actor commentary Matango premiered in Japanese theaters in and around mid 1963. The Gilligan’s Island first pilot (with different actors as The Professor and Ginger)was made in late 1963 thus the Japanese film does not predate Gilligan by a few years as another poster here thinks.Schwartz could have heard about a Japanese film made with seven castaways (as Hollywood and Tokoyo’s Toho were in communication). But he definitely didn’t see the Japanese film before he pitched gI to the networks in early 63.

So perhaps this was just a happy coincidence… A commentor on Delacour’s post mentions that the movie is loosely based on a 1907 short story by William Hope Hodgson called The Voice in the Night, but while it certainly was the inspiration behind Matango, it probably didn’t inspire Gilligan’s Island…

I seem to have veered off track here, but it was an interesting diversion: from obscure Japanese horror film to Gilligan’s Island to William Hope Hodgson… would anyone have made these connections 20 years ago? It certainly would have been possible, but I doubt it would happen as quickly or efficiently as it did on the internet.

Again Cell Phones

About 2 years ago, I started looking around for a new cell phone. At the time, I just wanted a simple, no-frills type phone, but I kept an open mind and looked at some of the more advanced features that were becoming available. I eventually settled on a small, low-end Nokia. I instantly regretted the decision not to get a camera phone, but otherwise, the phone has performed admirably. The only other complaint I really have is that the call volume could stand to be a little louder. In any case, in the comments of one of the above linked posts, I mentioned:

I’m actually kinda surprised that cell phones aren’t… better than they are now. I figure in about 2 years, my dream phone will be more attainable, so for now, I’ll make do with what I got.

Well, it’s been 2 years, I’m once again looking into purchasing a new phone and… I’m still surprised that cell phones aren’t better than they are right now. Seriously, what the heck is going on? My priorities aren’t that unusual and have only changed a little since my last foray: I want a phone that has strong battery life, good call quality (with louder call volume), good usability (i.e. button placement, menu structure, etc…), and a quality camera (at least 1.3 megapixel). There are lots of secondary features and nice-to-haves, but those are the most important things. This is apparently difficult to achieve though, and I’m distinctly underwhelmed by my options. Actually there are a lot of decent phones out there, but I think I’ve fallen into the classic paradox of choice trap. Here are some phones I’m considering:

  • Sony Ericsson W810i: When I bought my last phone, I remarked that the Sony Ericsson W800i seemed really interesting because it was basically knocking out 3 birds with one stone: phone, camera, and mp3 player. At the time, it was obscenely expensive and it seemed to suffer from numerous glitches. The W810i is the successor to the W800i, and by all accounts Sony Ericsson has worked through a lot of the issues to produce a pretty solid phone. I have some minor concerns about the keypad, but everything else seems in order (and the phone looks great – 2 MP with a flash) and the price tag is pretty reasonable for such a fully-featured phone. The only thing that really goes against my requirements is the “staticky call quality” that’s referenced in the reviews. Also, I hate Sony. I really don’t want to give them my money.
  • Motorola SLVR: I’ve never been a big fan of clamshell phones, so I never really cared that much about the RAZR when it came out. Then Mororola released the SLVR, which seems like a decent phone at first glance. Decent battery life (not as good as the Sony Ericsson though), reasonable sound quality, and all the standard cell phone features. The one big problem for me is that the camera looks crappy. I believe the newer models are improving the camera, so we’ll see how that goes (in general, Motorola’s phones don’t seem to have great cameras though, even when they have decent resolutions). If they improve the camera, I’d gladly pick this over the Sony Ericsson.
  • Motorola KRZR: This is another interesting option, but once again, I’m a little turned off by the camera. It seems better than the camera on the SLVR, but still nowhere near the Sony Ericsson. There seem to be a lot of different versions of Motorola cell phones (no matter what variety), so it’s a little confusing going through them all and trying to figure out which one meets your needs. I don’t normally love flip phones, but I think this one’s pretty good. Aside from the camera, this one appears to be a little more expensive too, which is a bummer.
  • Nokia 5300 Xpress Music: Well, this one isn’t a real option just yet simply because it’s not available on Cingular or Verizon. That said, it’s a quality phone, and I’ve had good experiences with Nokia. Again, the camera seems decent but nowhere near the Sony Ericsson. The only other problem is that it seems the volume doesn’t go loud enough, and that’s one of my primary annoyances.
  • LG VX8600: This is the flip-phone version of the hip Chocolate phones, and it seems to have improved upon the Chocolate as well. This supposedly has one of the better cameras, but it has awful battery life.

There are some interesting phones coming. I’d love an iPhone, but I can’t justify the cost. I’m interested in the rumored Microsoft and Google phones, but I doubt they’ll be coming anytime soon. Of course, there are probably dozens of phones that would readily meet my needs, but they’re not available in the US. I’m hardly the first person to note this, but it is quite frustrating. I understand why this is happening (the US is a small, fractured market that utilizes a variety of technologies and frequencies that are different than what Europe & Asia use. So companies naturally focus on the larger, more homogenous European & Asian markets.), but it’s still annoying. I’m not sure how this will be rectified; perhaps we’ll just have to wait until 4G comes along (assuming everyone adopts the same 4G).

Update: Drool. Battery life looks lame, but otherwise it’s great. Not that it matters, as it ain’t available yet.

A System of Warnings

Josh Porter recently wrote about some design principles he uses. As Josh notes, people often confuse design with art. Art is a form of personal expression, while design is about use.

The designer needs someone to use (not only appreciate) what they create. Design doesn’t serve its purpose without people to use it. Design helps solve human problems. The highest accolade we can bestow on a design is not that it is beautiful, as we do in Art, but that it is well-used.

I think one of the most recognized and perhaps important designs of the past twenty years or so is the Nutrition Facts label. Instantly recognizable and packed with information, yet concise and easy to read and use. It’s not glamorous, but it works so well that we barely even notice it. It’s great design.

While nutrition is certainly an important subject worthy of a thoughtful design, I recently stumbled upon a design project that is intriguing, difficult and important. In the desert of Southeastern New Mexico lies the Waste Isolation Pilot Plant (WIPP), an undeground radioactive waste repository. Not a pleasant place. During the planning stages of the facility, a panel of experts were tasked with designing a 10,000-year marking system. It’s an intriguing design problem. The resulting report is an astounding, powerful and oddly poignant document (excerpts here, huge .pdf version of the full report here). They developed an interesting system here; note, they didn’t just create signs, the entire site (from the physical layout to the words and imagery used) was designed to communicate a message across multiple levels, with a high level of redundancy. It’s not just a warning, it’s a system of interconnected and reinforced warnings. The authors also attempted to anticipate a variety of potential attacks as well. What is the message they wanted to convey? Here’s a brief summary:

  • This place is a message… and part of a system of messages… pay attention to it!
  • Sending this message was important to us. We considered ourselves to be a powerful culture.
  • This place is not a place of honor… no highly esteemed deed is commemorated here… nothing valued is here.
  • What is here is dangerous and repulsive to us. This message is a warning about danger.
  • The danger is in a particular location… it increases toward a center… the center of danger is here… of a particular size and shape, and below us.
  • The danger is still present, in your time, as it was in ours.
  • The danger is to the body, and it can kill.
  • The form of the danger is an emanation of energy.
  • The danger is unleashed only if you substantially disturb this place physically. This place is best shunned and left uninhabited.
  • All physical site interventions and markings must be understood as communicating a message. It is not enough to know that this is a place of importance and danger…you must know that the place itself is a message, that it contains messages, and is part of a system of messages, and is a system with redundance.

As James Grimmelmann notes, this is “frightening, apocalyptic poetry.” I find the third bullet to be particularly evocative. The assumptions the authors had to make in working on this design are interesting to contemplate. They’re assuming that the audience for this design will be significantly different, perhaps not even human (in any case, the assumption is that something bad has happened and we’re no longer around). Again, this is an intriguing design problem. I think they’ve done a pretty good job thinking about the problem, even if some of their more exotic designs didn’t make it into the final system.

Link Dump

Various links for your enjoyment:

  • The Order of the Science Scouts of Exemplary Repute and Above Average Physique: Like the Boy Scouts, but for Scientists. Aside from the goofy name, they’ve got an ingenious and hilarious list of badges, including: The “my degree inadvertantly makes me competent in fixing household appliances” badge, The “I’ve touched human internal organs with my own hands” badge, The “has frozen stuff just to see what happens” badge (oh come one, who hasn’t done that?), The “I bet I know more computer languages than you, and I’m not afraid to talk about it” badge (well, I used to know a bunch), and of course, The “dodger of monkey shit” badge. (“One of our self explanatory badges.”). Sadly, I qualify for less of these than I’d like. Of course, I’m not a scientist, but still. I’m borderline on many though (for instance, the “I blog about science” badge requires that I maintain a blog where at least a quarter of the material is about science – I certainly blog about technology a lot, but explicitely science? Debateable, I guess.)
  • Dr. Ashen and Gizmodo Reviews The Gamespower 50 (YouTube): It’s a funny review of a crappy portable video game device, just watch it. The games on this thing are so bad (there’s actually one called “Grass Cutter,” which is exactly what you think it is – a game where you mow the lawn).
  • Count Chocula Vandalism on Wikipedia: Some guy came up with an absurdly comprehensive history for Count Chocula:

    Ernst Choukula was born the third child to Estonian landowers in the late autumn of 1873. His parents, Ivan and Brushken Choukula, were well-established traders of Baltic grain who– by the early twentieth century–had established a monopolistic hold on the export markets of Lithuania, Latvia and southern Finland. A clever child, Ernst advanced quickly through secondary schooling and, at the age of nineteen, was managing one of six Talinn-area farms, along with his father, and older brother, Grinsh. By twenty-four, he appeared in his first “barrelled cereal” endorsement, as the Choukula family debuted “Ernst Choukula’s Golden Wheat Muesli”, a packaged mix that was intended for horses, mules, and the hospital ridden. Belarussian immigrant silo-tenders started cutting the product with vodka, creating a crude mush-paste they called “gruhll” or “gruell,” and would eat the concoction each morning before work.

    It goes on like that for a while. That particular edit has been removed from the real article, but there appears to actually be quite a debate on the Talk page as to whether or not to mention it in the official article.

  • The Psychology of Security by Bruce Schneier: A long draft of an article that delves into psychological reasons we make the security tradeoffs that we do. Interesting stuff.
  • The Sagan Diary by John Scalzi (Audio Book): I’ve become a great fan of Scalzi’s fiction, and his latest work is available here as audio (a book is available too, but it appears to be a limited run). Since the book is essentially the diary of a woman, he got various female authors and friends to read a chapter. This actually makes for somewhat uneven listening, as some are great and others aren’t as great. Now that I think about it, this book probably won’t make sense if you haven’t read Old Man’s War and/or The Ghost Brigades. However, they’re both wonderful books of the military scifi school (maybe I’ll probably write a blog post or two about them in the near future).

Intellectual Property, Copyright and DRM

Roy over at 79Soul has started a series of posts dealing with Intellectual Property. His first post sets the stage with an overview of the situation, and he begins to explore some of the issues, starting with the definition of theft. I’m going to cover some of the same ground in this post, and then some other things which I assume Roy will cover in his later posts.

I think most people have an intuitive understanding of what intellectual property is, but it might be useful to start with a brief definition. Perhaps a good place to start would be Article 1, Section 8 of the U.S. Constitution:

To promote the Progress of Science and useful Arts, by securing for limited Times to Authors and Inventors the exclusive Right to their respective Writings and Discoveries;

I started with this for a number of reasons. First, because I live in the U.S. and most of what follows deals with U.S. IP law. Second, because it’s actually a somewhat controversial stance. The fact that IP is only secured for “limited times” is the key. In England, for example, an author does not merely hold a copyright on their work, they have a Moral Right.

The moral right of the author is considered to be — according to the Berne convention — an inalienable human right. This is the same serious meaning of “inalienable” the Declaration of Independence uses: not only can’t these rights be forcibly stripped from you, you can’t even give them away. You can’t sell yourself into slavery; and neither can you (in Britain) give the right to be called the author of your writings to someone else.

The U.S. is different. It doesn’t grant an inalienable moral right of ownership; instead, it allows copyright. In other words, in the U.S., such works are considered property (i.e. it can be sold, traded, bartered, or given away). This represents a fundamental distinction that needs to be made: some systems emphasize individual rights and rewards, and other systems are more limited. When put that way, the U.S. system sounds pretty awful, except that it was designed for something different: our system was built to advance science and the “useful arts.” The U.S. system still rewards creators, but only as a means to an end. Copyright is granted so that there is an incentive to create. However, such protections are only granted for “limited Times.” This is because when a copyright is eternal, the system stagnates as protected peoples stifle competition (this need not be malicious). Copyright is thus limited so that when a work is no longer protected, it becomes freely available for everyone to use and to build upon. This is known as the public domain.

The end goal here is the advancement of society, and both protection and expiration are necessary parts of the mix. The balance between the two is important, and as Roy notes, one of the things that appears to have upset the balance is technology. This, of course, extends as far back as the printing press, records, cassettes, VHS, and other similar technologies, but more recently, a convergence between new compression techniques and increasing bandwidth of the internet created an issue. Most new recording technologies were greeted with concern, but physical limitations and costs generally put a cap on the amount of damage that could be done. With computers and large networks like the internet, such limitations became almost negligible. Digital copies of protected works became easy to copy and distribute on a very large scale.

The first major issue came up as a result of Napster, a peer-to-peer music sharing service that essentially promoted widespread copyright infringement. Lawsuits followed, and the original Napster service was shut down, only to be replaced by numerous decentralized peer-to-peer systems and darknets. This meant that no single entity could be sued for the copyright infringement that occurred on the network, but it resulted in a number of (probably ill-advised) lawsuits against regular folks (the anonymity of internet technology and state of recordkeeping being what it is, this sometimes leads to hilarious cases like when the RIAA sued a 79 year old guy who doesn’t even own a computer or know how to operate one).

Roy discusses the various arguments for or against this sort of file sharing, noting that the essential difference of opinion is the definition of the word “theft.” For my part, I think it’s pretty obvious that downloading something for free that you’d normally have to pay for is morally wrong. However, I can see some grey area. A few months ago, I pre-ordered Tool’s most recent album, 10,000 Days from Amazon. A friend who already had the album sent me a copy over the internet before I had actually recieved my copy of the CD. Does this count as theft? I would say no.

The concept of borrowing a Book, CD or DVD also seems pretty harmless to me, and I don’t have a moral problem with borrowing an electronic copy, then deleting it afterwords (or purchasing it, if I liked it enough), though I can see how such a practice represents a bit of a slippery slope and wouldn’t hold up in an honest debate (nor should it). It’s too easy to abuse such an argument, or to apply it in retrospect. I suppose there are arguments to be made with respect to making distinctions between benefits and harms, but I generally find those arguments unpersuasive (though perhaps interesting to consider).

There are some other issues that need to be discussed as well. The concept of Fair Use allows limited use of copyrighted material without requiring permission from the rights holders. For example, including a screenshot of a film in a movie review. You’re also allowed to parody copyrighted works, and in some instances make complete copies of a copyrighted work. There are rules pertaining to how much of the copyrighted work can be used and in what circumstances, but this is not the venue for such details. The point is that copyright is not absolute and consumers have rights as well.

Another topic that must be addressed is Digital Rights Management (DRM). This refers to a range of technologies used to combat digital copying of protected material. The goal of DRM is to use technology to automatically limit the abilities of a consumer who has purchased digital media. In some cases, this means that you won’t be able to play an optical disc on a certain device, in others it means you can only use the media a certain number of times (among other restrictions).

To be blunt, DRM sucks. For the most part, it benefits no one. It’s confusing, it basically amounts to treating legitimate customers like criminals while only barely (if that much) slowing down the piracy it purports to be thwarting, and it’s lead to numerous disasters and unintended consequences. Essential reading on this subject is this talk given to Microsoft by Cory Doctorow. It’s a long but well written and straightforward read that I can’t summarize briefly (please read the whole thing). Some details of his argument may be debateable, but as a whole, I find it quite compelling. Put simply, DRM doesn’t work and it’s bad for artists, businesses, and society as a whole.

Now, the IP industries that are pushing DRM are not that stupid. They know DRM is a fundamentally absurd proposition: the whole point of selling IP media is so that people can consume it. You can’t make a system that will prevent people from doing so, as the whole point of having the media in the first place is so that people can use it. The only way to perfectly secure a piece of digital media is to make it unusable (i.e. the only perfectly secure system is a perfectly useless one). That’s why DRM systems are broken so quickly. It’s not that the programmers are necessarily bad, it’s that the entire concept is fundamentally flawed. Again, the IP industries know this, which is why they pushed the Digital Millennium Copyright Act (DMCA). As with most laws, the DMCA is a complex beast, but what it boils down to is that no one is allowed to circumvent measures taken to protect copyright. Thus, even though the copy protection on DVDs is obscenely easy to bypass, it is illegal to do so. In theory, this might be fine. In practice, this law has extended far beyond what I’d consider reasonable and has also been heavily abused. For instance, some software companies have attempted to use the DMCA to prevent security researchers from exposing bugs in their software. The law is sometimes used to silence critics by threatening them with a lawsuit, even though no copright infringement was committed. The Chilling Effects project seems to be a good source for information regarding the DMCA and it’s various effects.

DRM combined with the DMCA can be stifling. A good example of how awful DRM is, and how DMCA can affect the situation is the Sony Rootkit Debacle. Boing Boing has a ridiculously comprehensive timeline of the entire fiasco. In short, Sony put DRM on certain CDs. The general idea was to prevent people from putting the CDs in their computer and ripping them to MP3s. To accomplish this, Sony surreptitiously installed software on customer’s computers (without their knowledge). A security researcher happened to notice this, and in researching the matter found that the Sony DRM had installed a rootkit that made the computer vulnerable to various attacks. Rootkits are black-hat cracker tools used to disguise the workings of their malicious software. Attempting to remove the rootkit broke the windows installation. Sony reacted slowly and poorly, releasing a service pack that supposedly removed the rootkit, but which actually opened up new security vulnerabilities. And it didn’t end there. Reading through the timeline is astounding (as a result, I tend to shy away from Sony these days). Though I don’t believe he was called on it, the security researcher who discovered these vulnerabilities was technically breaking the law, because the rootkit was intended to protect copyright.

A few months ago, my windows computer died and I decided to give linux a try. I wanted to see if I could get linux to do everything I needed it to do. As it turns out, I could, but not legally. Watching DVDs on linux is technically illegal, because I’m circumventing the copy protection on DVDs. Similar issues exist for other media formats. The details are complex, but in the end, it turns out that I’m not legally able to watch my legitimately purchased DVDs on my computer (I have since purchased a new computer that has an approved player installed). Similarly, if I were to purchase a song from the iTunes Music Store, it comes in a DRMed format. If I want to use that format on a portable device (let’s say my phone, which doesn’t support Apple’s DRM format), I’d have to convert it to a format that my portable device could understand, which would be illegal.

Which brings me to my next point, which is that DRM isn’t really about protecting copyright. I’ve already established that it doesn’t really accomplish that goal (and indeed, even works against many of the reasons copyright was put into place), so why is it still being pushed? One can only really speculate, but I’ll bet that part of the issue has to do with IP owners wanting to “undercut fair use and then create new revenue streams where there were previously none.” To continue an earlier example, if I buy a song from the iTunes music store and I want to put it on my non-Apple phone (not that I don’t want one of those), the music industry would just love it if I were forced to buy the song again, in a format that is readable by my phone. Of course, that format would be incompatible with other devices, so I’d have to purchase the song again if I wanted to listen to it on those devices. When put in those terms, it’s pretty easy to see why IP owners like DRM, and given the general person’s reaction to such a scheme, it’s also easy to see why IP owners are always careful to couch the debate in terms of piracy. This won’t last forever, but it could be a bumpy ride.

Interestingly enough, distributers of digital media like Apple and Yahoo have recently come out against DRM. For the most part, these are just symbolic gestures. Cynics will look at Steve Jobs’ Thoughts on Music and say that he’s just passing the buck. He knows customers don’t like or understand DRM, so he’s just making a calculated PR move by blaming it on the music industry. Personally, I can see that, but I also think it’s a very good thing. I find it encouraging that other distributers are following suit, and I also hope and believe this will lead to better things. Apple has proven that there is a large market for legally purchased music files on the internet, and other companies have even shown that selling DRM-free files yields higher sales. Indeed, the emusic service sells high quality, variable bit rate MP3 files without DRM, and it has established emusic as the #2 retailer of downloadable music behind the iTunes Music Store. Incidentally, this was not done for pure ideological reasons – it just made busines sense. As yet, these pronouncements are only symbolic, but now that online media distributers have established themselves as legitimate businesses, they have ammunition with which to challenge the IP holders. This won’t happen overnight, but I think the process has begun.

Last year, I purchased a computer game called Galactic Civilizations II (and posted about it several times). This game was notable to me (in addition to the fact that it’s a great game) in that it was the only game I’d purchased in years that featured no CD copy protection (i.e. DRM). As a result, when I bought a new computer, I experienced none of the usual fumbling for 16 digit CD Keys that I normally experience when trying to reinstall a game. Brad Wardell, the owner of the company that made the game, explained his thoughts on copy protection on his blog a while back:

I don’t want to make it out that I’m some sort of kumbaya guy. Piracy is a problem and it does cost sales. I just don’t think it’s as big of a problem as the game industry thinks it is. I also don’t think inconveniencing customers is the solution.

For him, it’s not that piracy isn’t an issue, it’s that it’s not worth imposing draconian copy protection measures that infuriate customers. The game sold much better than expected. I doubt this was because they didn’t use DRM, but I can guarantee one thing: People don’t buy games because they want DRM. However, this shows that you don’t need DRM to make a successful game.

The future isn’t all bright, though. Peter Gutmann’s excellent Cost Analysis of Windows Vista Content Protection provides a good example of how things could get considerably worse:

Windows Vista includes an extensive reworking of core OS elements in order to provide content protection for so-called “premium content”, typically HD data from Blu-Ray and HD-DVD sources. Providing this protection incurs considerable costs in terms of system performance, system stability, technical support overhead, and hardware and software cost. These issues affect not only users of Vista but the entire PC industry, since the effects of the protection measures extend to cover all hardware and software that will ever come into contact with Vista, even if it’s not used directly with Vista (for example hardware in a Macintosh computer or on a Linux server).

This is infuriating. In case you can’t tell, I’ve never liked DRM, but at least it could be avoided. I generally take articles like the one I’m referencing with a grain of salt, but if true, it means that the DRM in Vista is so oppressive that it will raise the price of hardware… And since Microsoft commands such a huge share of the market, hardware manufacturers have to comply, even though a some people (linux users, Mac users) don’t need the draconian hardware requirements. This is absurd. Microsoft should have enough clout to stand up to the media giants, there’s no reason the DRM in Vista has to be so invasive (or even exist at all). As Gutmann speculates in his cost analysis, some of the potential effects of this are particularly egregious, to the point where I can’t see consumers standing for it.

My previous post dealt with Web 2.0, and I posted a YouTube video that summarized how changing technology is going to force us to rethink a few things: copyright, authorship, identity, ethics, aesthetics, rhetorics, governance, privacy, commerce, love, family, ourselves. All of these are true. Earlier, I wrote that the purpose of copyright was to benefit society, and that protection and expiration were both essential. The balance between protection and expiration has been upset by technology. We need to rethink that balance. Indeed, many people smarter than I already have. The internet is replete with examples of people who have profited off of giving things away for free. Creative Commons allows you to share your content so that others can reuse and remix your content, but I don’t think it has been adopted to the extent that it should be.

To some people, reusing or remixing music, for example, is not a good thing. This is certainly worthy of a debate, and it is a discussion that needs to happen. Personally, I don’t mind it. For an example of why, watch this video detailing the history of the Amen Break. There are amazing things that can happen as a result of sharing, reusing and remixing, and that’s only a single example. The current copyright environment seems to stifle such creativity, not the least of which because copyright lasts so long (currently the life of the author plus 70 years). In a world where technology has enabled an entire generation to accellerate the creation and consumption of media, it seems foolish to lock up so much material for what could easily be over a century. Despite all that I’ve written, I have to admit that I don’t have a definitive answer. I’m sure I can come up with something that would work for me, but this is larger than me. We all need to rethink this, and many other things. Maybe that Web 2.0 thing can help.

Update: This post has mutated into a monster. Not only is it extremely long, but I reference several other long, detailed documents and even somewhere around 20-25 minutes of video. It’s a large subject, and I’m certainly no expert. Also, I generally like to take a little more time when posting something this large, but I figured getting a draft out there would be better than nothing. Updates may be made…

Update 2.15.07: Made some minor copy edits, and added a link to an Ars Technica article that I forgot to add yesterday.

iPhone

iPhoneA couple of years ago, I was in the market for a new phone. After looking around at all the options and features, I ended up settling on a relatively “low-end” phone that was good for calls and SMS and that’s about it. It was small, simple, and to the point, and while it has served me well, I have kinda regretted not getting a camera in the phone (this is the paradox of choice in action). I considered the camera phone, as well as phones that played music (three birds with one stone!), but it struck me that feature packed devices like that simply weren’t ready yet. They were expensive, clunky, and the interface looked awful.

Enter Apple’s new iPhone. Put simply, they’ve done a phenominal job with this phone. I’m impressed. Watch the keynote presentation here. Some highlights that I found interesting:

  • Just to mention some of the typical stuff: it’s got all the features of a video iPod, it’s got a phone, it’s got a camera, and it’s got the internet. It has an iPod connector, so you can hook it up to your computer and sync all the appropriate info (music, contacts, video, etc…) through iTunes (i.e. an application that everyone is already familiar with because they use it with their iPod.) It runs Mac OSX (presumably a streamlined version) and has a browser, email app, and widgets. Battery life seems very reasonable.
  • Ok enough of the functionality. The functionality is mostly, well, normal. There are smart phones that do all of the above. Indeed, one of the things that worries me about this phone is that by cramming so much functionality into this new phone, Apple will also be muddying the interface… but the interface is what’s innovative about this phone. This is what the other smart phones don’t do. In short, the interface is a touch screen (no physical keyboard, and no stylus; it takes up the majority of the surface area of a side of the phone and you use your fingers to do stuff. Yes, I said fingers, as in multiple. More later.) This allows them to tailor the interface to the application currently in use. Current smart phones all have physical controls that must stay fixed (i.e. a mini qwerty keyboard, and a set of directional buttons, etc…) and which are there whether you need them for what you’re doing or not. By using a touch screen, Apple has solved that problem rather neatly (Those of you familiar with this blog know what’s coming, but it’ll be a moment).
  • Scrolling looks fun. Go and watch the demo. It looks neat and, more importantly, it appears to be consistent between all the applications (i.e. scrolling your music library, scrolling through your contacts, scrolling down a web page, etc…). Other “multi-touch” operations also look neat, such as the ability to zoom into web page by squeezing your fingers on the desired area (iPhone loads the actual page, not the WAP version, and allows you to zoom in to read what you want – another smart phone problem solved (yes, yes, it’s coming, don’t worry)). The important thing about the touch interface is that it is extremely intuitive. You don’t need to learn that much in order to use this phone, and the touch screen interface.
  • The phone does a few interesting new things. It has a feature they’re calling “visual voicemail” which lets you see all of your voicemail, then select which one you want to listen to first (a great feature). It also makes conference calls a snap, too. This is honestly something I can’t see using that much, but the interface to do it is better than any other conference call interface I’ve seen, and it’s contextual in that you don’t have to deal with it until you’ve got two people on the phone.
  • It’s gyroscopic, dude. It has motion sensors that detect the phone’s orientation. If you’re looking at a picture, and you turn the phone, the picture will turn with you (and if it’s a landscape picture, it’ll fill more of the screen too). It senses the lighting and adjusts the screen’s display to compensate for the environment (saves power, provides better display). When you put the phone by your ear to take a call, it senses that, and deactivates the touchscreen, saving power and avoiding unwanted “touches” on the screen (you don’t want your ear to hang up, after all). Another problem solved (wait for it). Unfortunately, the iPhone does not also feature Wiimote functionality (wiiPhone anyone?)
  • Upgradeable Interface: One of the most important things that having a touch screen interface allows Apple to do is provide updates to installed software and even new applications (given that it’s running a version of OS X, this is probably a given). Let’s say that the interface for browsing contacts is a little off, or the keyboard is spaced wrong. With a physical keyboard on a smart phone, you can’t fix that problem without redesigning the whole thing and making the customer purchase a new piece of hardware. The iPhone can just roll out an update.
  • Apple could put Blackberry out of business with this thing, provided that the functionality is there (it appears that it is for Yahoo mail, but will it work with my company? I can’t tell just yet.). Blackberries always seemed like a fully featured kludge to me. The iPhone is incredibly elegant in comparison (not that it isn’t elegant all by itself). This would also mitigate the whole high price issue: companies might pay for this thing if it works as well as it seems, and people are always more willing to spend their companies money than their own.

Ok, you know what’s coming. Human beings don’t solve problems. They trade one set of problems for another, in the hopes that the new are better than the old. Despite the fact that I haven’t actually used the iPhone, what are some potential issues?

  • The touchscreen: Like the iPod’s clickwheel, the iPhone’s greatest strength could prove to be it’s greatest weakness. Touch screens have been in use for years and have become pretty well understood and revised… but they can also be imprecise and, well, touchy. When watching the demo, Steve didn’t seem to be having any problem executing various options, but I’m not sure how well the device will be able to distinguish between “I want to scroll” and “I want to select” (unless selecting was a double-tap, but I don’t think it was). Designing a new touch screen input interface is a tricky human factors problem, and I’m willing to be it will take a little while to be perfected. Like the scrollwheel, I can see it being easy to overshoot or select the wrong item. I could certainly be wrong, and I look forward to fiddling with it at the local Mac store to see just how responsive it really is (it’s hard to comment on something you’ve never used). However, I’m betting that (again like the scrollwheel) the touchscreen will be a net positive experience.
  • Durability: Steven Den Beste hits (scroll down) on what I think may be the biggest problem with the touch screen:

    I have some serious concerns about long term reliability of the touch panel. When it’s riding inside a woman’s purse, for instance, how long before the touch panel gets wrecked? Perhaps there’s a soft carrying case for it — but a lot of people will toss that, and carry the phone bare. Nothing protects that panel, and it covers one of the two largest faces on the unit. There are a thousand environmental hazards which could wreck it: things dropped onto it, or it being dropped onto other things. And if the touch panel goes bad, the rest of the unit is unusable.

    Indeed. iPods are notorious for getting scratched up, especially the screens. How will that impact the display? How will it impact the touch screen?

  • Two hands? It looks like you need to use two hands to do a lot of these touch screen operations (one to hold, the other to gesture). Also, when writing an email, a little qwerty keyboard appears on the touch screen… which is nice, but which also might be difficult to use with one hand or without looking (physical keyboards allow you to figure out what key you’re on by touch, and also have little nubs – home keys – which don’t translate to the touch screen). I don’t know how much of an issue this will be, but it will affect some people (I know someone who will type emails on their Blackberry with one hand, while driving. This is an extreme case, to be sure, but it doesn’t seem possible with the touch screen).
  • Zooming: The zooming feature in web browsing is neat, but the page they used in the demo (the NY Times homepage) has 5 columns, which seems ideal for zooming. How will other pages render? Will zooming be as useful? The glimpses at this functionality aren’t enough to tell how well it will handle the web… (Google Maps looked great though)
  • Does it do too much? This phone looks amazing, but it’s price tag is prohibitive for me, especially since I probably won’t use a significant portion of the functionality. I love that it does video, and while the 3.5″ screen is bigger than my iPod’s screen, I have to admit that I’ve never used the iPod video to watch something (maybe if I travelled more…) Brian Tiemann notes:

    If it weren’t for the phone, I would buy this in a heartbeat. As it is, I wish (as does Damien Del Russo) that there were a way to buy it without the Cingular plan, so you could just use it as an iPod with wireless web browsing and e-mail and the like.

    Again, there is a worry that a device that tries to do everything for everyone will end up being mediocre at everything. However, I think Apple has made a very admirable attempt, and the touch screen concept really does cut down on this by allowing applications their own UIs and also allowing updates to those UIs if it becomes necessary. They’ve done as good a job as I think is possible at this time.

  • Battery Life: This goes along with the “does it do too much” point. I mentioned above that the battery life seems decent, and it does. However, with a device that does this much, I have a feeling that the 5 hours of use they claim will still feel a little short, especially when you’re using all that stuff. This is one of the reasons I never seriously considered getting a music/camera/phone a while back: I don’t want to run out my batteries playing music, then not be able to make an important call. This is a problem for mobile devices in general, and battery technology doesn’t seem to be advancing as rapidly as everything else.
  • Monopoly: This phone will only further cement iTunes’ dominant position in the marketplace. Is this a good thing or a bad thing? I go back and forth. Sometimes Apple seems every bit as evil as Microsoft, but then, they also seem a lot more competant too. The Zune looks decent, but it’s completely overshadowed by this. We could have a worse monopoly, I guess, but I don’t like stuff like DRM (which is reasonable, yes, but still not desirable except insofar as it calms down content owners) and proprietary formats that Apple won’t license. Will third parties be able to develop apps for the iPhone? It could certainly be worse, but I’m a little wary.

All in all, it’s quite impressive. Most of the potential issues don’t seem insurmountable, and I think Apple has a hit on their hands. It should also be interesting to see if other cell phone makers respond in any way. The cell phone market is gigantic (apparently nearly a billion cell phones were sold last year), and it seems like a lot of the best phones are only available overseas. Will we start to see better phones at a cheaper price? Unfortunately, I don’t think I’ll be getting an iPhone anytime soon, though I will keep a close eye on it. Once they work out the bugs and the price comes down, I’ll definitely be tempted.

Updates: Brian Tiemann has further thoughts. Kevin Murphy has some thoughts as well. Ars Technica also notes some issues with the iPhone, and has some other good commentary (actually, just read their Infiinite Loop journal). I think the biggest issue I forgot to mention is that the iPhone is exclusive to Cingular (and you have to get a 2 year plan at that).

Link Dump

Time is short this week, so a few quick links:

  • The 1,000 Greatest Films: Aggregated from 1,193 individual critics’ and filmmakers’ top-ten lists. They’ve got all sorts of different ways to look at the numbers, including a way to keep track of which ones you have seen. As you might expect, the list is diverse and somewhat contentious, with lots of foriegn films and some very questionable choices. There are tons of films I’ve never even heard of. The list is somewhat skewed towards older films, as they use some older lists (some of the lists used are as old as 1952), but then, that’s still to be expected. Older films tend to get credit for their importance, and not as much because of their entertainment value today (I’m horribly understating this issue, which could probably use a blog entry of its own). As an aside, the list sometimes reads like the Criterion Collection catalog, which is pretty funny. I used the listkeeper site (which is pretty neat and might help make these type of memes a little easier to deal with), and I’ve apparently seen somewhere around 16% of the list. Given the breadth of the films covered in the list, I think that’s pretty impressive (though I’ll probably never get past 30%).
  • Shuttle Launch Seen From ISS: Photos of a Space Shuttle launch as seen from the International Space Station. Neato.
  • A Million Random Digits with 100,000 Normal Deviates: Ok, so this is a book comprised solely of a bunch of random numbers, and that’s it. Nothing funny or entertaining there, except the Amazon reviewers are having a field day with it. My favorite review:

    The book is a promising reference concept, but the execution is somewhat sloppy. Whatever algorithm they used was not fully tested. The bulk of each page seems random enough. However at the lower left and lower right of alternate pages, the number is found to increment directly.

    Ahhh, geek humor. [via Schneier]

  • BuzzFeed: A new aggregator that features “movies, music, fashion, ideas, technology, and culture” that are generating buzz (in the form of news stories and blog posts, etc…). It’s an interesting idea as it’s not really a breaking news site, but it seems to have it’s finger on the pulse of what folks are talking about (on the homepage now are sections on the Wii, PS3, Borat, and (of course Snoop Dogg’s new line of pet clothing). It’s not like Digg or Reddit, and thus it doesn’t suffer from a lot of their issues (unless they branch out into politics and religion). I’m sure some people will try to game the system, but it seems inherently more secure against such abuse.

That’s all for now.

Update: This Lists of Bests website is neat. It remembers what movies you’ve seen, and applies them to other lists. For example, without even going through the AFI top 100, I know that I’ve seen at least 41% of the list (because of all the stuff I noted when going through the top 1000). You can also compare yourself with other people on the site, and invite others to do so as well. Cool stuff.

Magic Design

A few weeks ago, I wrote about magic and how subconscious problem solving can sometimes seem magical:

When confronted with a particularly daunting problem, I’ll work on it very intensely for a while. However, I find that it’s best to stop after a bit and let the problem percolate in the back of my mind while I do completely unrelated things. Sometimes, the answer will just come to me, often at the strangest times. Occasionally, this entire process will happen without my intending it, but sometimes I’m deliberately trying to harness this subconscious problem solving ability. And I don’t think I’m doing anything special here; I think everyone has these sort of Eureka! moments from time to time. …

Once I noticed this, I began seeing similar patterns throughout my life and even history.

And indeed, Jason Kottke recently posted about how design works, referencing a couple of other designers, including Michael Bierut of Design Observer, who describes his process like this:

When I do a design project, I begin by listening carefully to you as you talk about your problem and read whatever background material I can find that relates to the issues you face. If you’re lucky, I have also accidentally acquired some firsthand experience with your situation. Somewhere along the way an idea for the design pops into my head from out of the blue. I can’t really explain that part; it’s like magic. Sometimes it even happens before you have a chance to tell me that much about your problem!

[emphasis mine] It is like magic, but as Bierut notes, this sort of thing is becoming more important as we move from an industrial economy to an information economy. He references a book about managing artists:

At the outset, the writers acknowledge that the nature of work is changing in the 21st century, characterizing it as “a shift from an industrial economy to an information economy, from physical work to knowledge work.” In trying to understand how this new kind of work can be managed, they propose a model based not on industrial production, but on the collaborative arts, specifically theater.

… They are careful to identify the defining characteristics of this kind of work: allowing solutions to emerge in a process of iteration, rather than trying to get everything right the first time; accepting the lack of control in the process, and letting the improvisation engendered by uncertainty help drive the process; and creating a work environment that sets clear enough limits that people can play securely within them.

This is very interesting and dovetails nicely with several topics covered on this blog. Harnessing self-organizing forces to produce emergent results seems to be rising in importance significantly as we proceed towards an information based economy. As noted, collaboration is key. Older business models seem to focus on a more brute force way of solving problems, but as we proceed we need to find better and faster ways to collaborate. The internet, with it’s hyperlinked structure and massive data stores, has been struggling with a data analysis problem since its inception. Only recently have we really begun to figure out ways to harness the collective intelligence of the internet and its users, but even now, we’re only scraping the tip of the iceberg. Collaborative projects like Wikipedia or wisdom-of-crowds aggregators like Digg or Reddit represent an interesting step in the right direction. The challenge here is that we’re not facing the problems directly anmore. If you want to create a comprehensive encyclopedia, you can hire a bunch of people to research, write, and edit entries. Wikipedia tried something different. They didn’t explicitely create an encyclopedia, they created (or, at least, they deployed) a system that made it easy for large amount of people to collaborate on a large amount of topics. The encyclopedia is an emergent result of that collaboration. They sidestepped the problem, and as a result, they have a much larger and dynamic information resource.

None of those examples are perfect, of course, but the more I think about it, the more I think that their imperfection is what makes them work. As noted above, you’re probably much better off releasing a site that is imperfect and iterating, making changes and learning from your mistakes as you go. When dealing with these complex problems, you’re not going to design the perfect system all at once. I realize that I keep saying we need better information aggregation and analysis tools, and that we have these tools, but they leave something to be desired. The point of these systems, though, is that they get better with time. Many older information analysis systems break when you increase the workload quickly. They don’t scale well. These newer systems only really work well once they have high participation rates and large amounts of data.

It remains to be seen whether or not these systems can actually handle that much data (and participation), but like I said, they’re a good start and they’re getting better with time.

YALD

Time is short this week, so it’s time for Yet Another Link Dump (YALD!):

  • Who Writes Wikipedia? An interesting investigation of one of the controversial aspects of Wikipedia. Some contend that the authors are a small but dedicated bunch, others claim that authorship is large and diverse (meaning that the resulting encyclopedia is self-organizing and emergent). Aaron Swartz decided to look into it:

    When you put it all together, the story become clear: an outsider makes one edit to add a chunk of information, then insiders make several edits tweaking and reformatting it. In addition, insiders rack up thousands of edits doing things like changing the name of a category across the entire site — the kind of thing only insiders deeply care about. As a result, insiders account for the vast majority of the edits. But it’s the outsiders who provide nearly all of the content.

    And when you think about it, this makes perfect sense. Writing an encyclopedia is hard. To do anywhere near a decent job, you have to know a great deal of information about an incredibly wide variety of subjects. Writing so much text is difficult, but doing all the background research seems impossible.

    On the other hand, everyone has a bunch of obscure things that, for one reason or another, they’ve come to know well. So they share them, clicking the edit link and adding a paragraph or two to Wikipedia. At the same time, a small number of people have become particularly involved in Wikipedia itself, learning its policies and special syntax, and spending their time tweaking the contributions of everybody else.

    Depending on how you measure it, many perspectives are correct, but the important thing here is that both types of people (outsiders and insiders) are necessary to make the system work. Via James Grimmelman, who has also written an interesting post on Wikipedia Fallacies that’s worth reading.

  • Cyber Cinema, 1981-2001: An absurdly comprehensive series of articles chronicling cyberpunk cinema. This guy appears to know his stuff, and chooses both obvious and not-so-obvious films to review. For example, he refers to Batman as “a fine example of distilled Cyberpunk.” I probably wouldn’t have pegged Batman as cyberpunk, but he makes a pretty good case for it… Anyway, I haven’t read all of his choices (20 movies, 1 for each year), but it’s pretty interesting stuff. [via Metaphlog]
  • The 3-Day Novel Contest: Well, it’s too late to partake now, but this is an interesting contest where entrants all submit a novel written in 3 days. The contest is usually held over labor day weekend (allowing everyone to make the most of their long holiday weekend). The Survival Guide is worth reading even if you don’t intend on taking part. Some excerpts: On the attitude required for such an endeavor:

    Perhaps the most important part of attitude when approaching a 3-Day Novel Contest is that of humility. It is not, as one might understandably and mistakenly expect, aggression or verve or toughness or (as it has been known) a sheer murderous intent to complete a 3-Day Novel (of this latter approach it is almost always the entrant who dies and not the contest). Let’s face it, what you are about to do, really, defies reality for most people. As when in foreign lands, a slightly submissive, respectful attitude generally fares better for the traveller than a self-defeating mode of overbearance. As one rather pompous contestant confessed after completing the contest: “I’ve been to Hell, and ended up writing about it.”

    On outlines and spontaneity:

    Those without a plan, more often than not, find themselves floundering upon the turbulent, unforgiving seas of forced spontaneous creativity. An outline can be quite detailed and, as veterans of the contest will also tell you, the chances of sticking to the outline once things get rolling are about 1,000 to 1. But getting started is often a major hurdle and an outline can be invaluable as an initiator.

    Two things that interest me about this: plans that fall apart, but must be made anyway (which I have written about before) and the idea that just getting started is important (which is something I’ll probably write about sometime, assuming I haven’t already done so and forgot).

    On eating:

    Keep it simple, and fast. Wieners (straight from the package—protein taken care of). Bananas and other fruit (vitamin C, potassium, etc.). Keep cooking to a minimum. Pizzas, Chinese—food to go. Forget balance, this is not a “spa”, there are no “healing days”. This is a competition; a crucible; a hill of sand. Climb! Climb!

    Lots of other fun stuff there. Also, who says you need to do it on Labor day weekend. Why not take a day off and try it out? [via Web Petals, who has some other interesting quotes from the contest]

That’s all for now. Sorry for just throwing links at you all the time, but I’ve entered what’s known as Wedding Season. Several weddings over the next few weekends, only one of which is in this area. This week’s was in Rhode Island, so I had a wonderful 12-13 hours of driving to contend with (not to mention R.I.’s wonderful road system – apparently they don’t think signs are needed). Thank goodness for podcasts – specifically Filmspotting, Mastercritic, and the Preston and Steve Show (who are professional broadcasters, but put their entire show (2+ hours) up, commercial free, every day).

Shockingly, it seems that I only needed to use two channels on my Monster FM Transmitter and both of those channels are the ones I use around Philly. Despite this, I’ve not been too happy with my FM transmitter thingy. It get’s the job done, I guess, but I find myself consistently annoyed at its performace (this trip being an exception). It seems that these things are very idiosyncratic and unpredictible, working in some cars better than others (thus some people swear by one brand, while others will badmouth that same brand). In large cities like New York and Philadelphia, the FM dial gets crowded and thus it’s difficult to find a suitable station, further complicating matters. I think my living in a major city area combined with an awkward placement of the cigarrette lighter in my car (which I assume is a factor) makes it somewhat difficult to find a good station. What would be really useful would be a list of available stations and an attempt to figure out ways to troubleshoot your car’s idiosyncracies. Perhaps a wiki would work best for this, though I doubt I’ll be motivated enought to spend the time installing a wiki system here for this purpose (does a similar site already exist? I did a quick search but came up empty-handed). (There are kits that allow you to tap into your car stereo, but they’re costly and I don’t feel like paying more for that than I did for the player… )

Does Magic Exist?

I’m back from my trip and it appears that the guest posting has fallen through. So a quick discussion on magic, which was brought up by a friend on a discussion board I frequent. The question: Does magic exist?

I suppose this depends on how you define magic. Arthur C. Clarke once infamously said that “Any sufficiently advanced technology is indistinguishable from magic.” And that’s probably true, right? If some guy can bend spoons with his thoughts, there’s probably a rational explanation for it… we just haven’t figured it out yet. Does it count as magic if we don’t know how he’s doing it? What about when we do figure out how he’s doing it? What if it really was some sort of empirically observable telekinesis?

After all, magicians have been performing for hundreds of years, relying on slight of hand and misdirection1 (amongst other tricks of the trade). However, I suspect that’s not the type of answer that’s being sought.

One thing I think is interesting is the power of thought and how many religious and “magical” traditions were really just ways to harness thought in a productive fashion. For example, crystal balls are often considered to be a magical way to see the future. While not strictly true, it was found that those who look into crystal balls for a long period of time end up entering a sort of trance, similar to hypnosis, and the human mind is able to make certain connections it would not normally make2. Can such a person see the future? I doubt it, but I don’t doubt that such people often experience a “revelation” of sorts, even if it is sometimes misguided.

However, you see something similar, though a lot more controlled and a lot less hokey, in a lot of religious traditions. For instance, take Christian Mass and prayer. Mass offers a number of repetitive aspects like singing combined with several chances for reflection and thought. I’ve always found that going to mass was very helpful in that it put things in a whole new perspective. Superficial things that worried me suddenly seemed less important and much more approachable. Repetitive rituals (like singing in Church) often bring back powerful feelings of the past, etc… further reinforcing the reflection from a different perspective.

Taking it completely out of the spiritual realm, I see very rational people doing the same thing all the time. They just aren’t using the same vocabulary. When confronted with a particularly daunting problem, I’ll work on it very intensely for a while. However, I find that it’s best to stop after a bit and let the problem percolate in the back of my mind while I do completely unrelated things. Sometimes, the answer will just come to me, often at the strangest times. Occasionally, this entire process will happen without my intending it, but sometimes I’m deliberately trying to harness this subconscious problem solving ability. And I don’t think I’m doing anything special here; I think everyone has these sort of Eureka! moments from time to time. Once you remove the theology from it, prayer is really a similar process.

Once I noticed this, I began seeing similar patterns throughout my life and even history. For example, Archimedes. He was tasked with determining whether a given substance was gold or not (at the time, this was a true challenge). He toiled and slaved at the problem for weeks, pushing all other aspects of his life away. Finally, his wife, sick of her husband’s dirty appearance and bad odor, made him take a bath. As he stepped into the tub, he noticed the water rising and had a revelation… this displacement could be used to accurately measure volume, which could then be used to determine density and ultimately whether or not a substance was gold. The moral of the story: Listen to your wife!3

Have I actually answered the question? Well, I may have veered off track a bit, but I find the process of thinking to be interesting and quite mysterious. After all, whatever it is that’s going on in our noggins isn’t understood very well. It might just be indistinguishable from magic…

1 – Note to self: go see The Illusionist! Also, The Prestige looks darn good. Why does Hollywood always produce these things in pairs? At least it looks like there’s good talent involved in each of these productions…

2 – Oddly enough, I discoved this nugget on another trip through the library stacks while I was supposed to be studying in college. Just thought I should call that out in light of recent posting

3 – Yes, this is an anecdote from the movie Pi.