For the last ten years, obsessive record collectors in Usenet have been working on the Whitburn Project — a huge undertaking to preserve and share high-quality recordings of every popular song since the 1890s. To assist their efforts, they've created a spreadsheet of 37,000 songs and 112 columns of raw data, including each song's duration, beats-per-minute, songwriters, label, and week-by-week chart position. It's 25 megs of OCD, and it's awesome.

As far as I know, this is the first time the project and its data have ever been discussed outside of Usenet. Despite its illegality, they've created a wonderful resource and you can do some fun things with the data. For the next three days, I'm going to publish some analysis and insights gleaned from their work.

Continuing the series of portrayals of technology from the VHS era, here's another contribution from Martin Brewer, who brought us the first episode of The Net. This is another BBC Two show, an episode of Horizon from 1993 on "The Electronic Frontier."

The broad theme of the episode is the information economy, and it's a whirlwind tour of influential people and tech in the pre-Web 1990s. They focus heavily on Microsoft, Apple, and General Magic, with interviews from key players from each. (Plus, great footage of their headquarters and workspaces.) There's plenty of footage of vintage '90s tech in here, including giant cell phones, Windows NT 3.1, the Newton, General Magic's Magic Cap, Corbis, Encarta on CD-ROM, interactive TV and software agents. Some of the highlights, with screenshots, after the video below.

Note: Like all the other materials I post here, this video is completely out-of-print and unavailable commercially, digitized from an old VHS tape. If it ever comes back into print, or the copyright holders contact me, I'll take it down immediately.

For the last few weeks, I've been spending every Friday with a small group of brilliant geeks — Rael Dornfest, Asha Dornfest, Chris Anderson, Greg Borenstein, and Adam Greene — for a weekly one-day hackathon. We call it Bottlecap Labs, a place to bounce around ideas, support each other's work, and occasionally whip up a project.

The first is ZombieURL, a TinyURL-clone with a twist.

Put in a URL, send it to a friend, and enjoy. Keep a camera nearby to capture the fun. (Here's a Zombie-fied version of Waxy, for example.)

(Warning: We're not responsible for emotional scarring, concussions, or heart failure as a result of using ZombieURL.)

From an anonymous source close to the company, I've found myself in possession of the "Infocom Drive" — a complete backup of Infocom's shared network drive from 1989. This is one of the most amazing archives I've ever seen, a treasure chest documenting the rise and fall of the legendary interactive fiction game company. Among the assets included: design documents, email archives, employee phone numbers, sales figures, internal meeting notes, corporate newsletters, and the source code and game files for every released and unreleased game Infocom made.

For obvious reasons, I can't share the whole Infocom Drive. But I have to share some of the best parts. It's just too good.

So let's start with the most notorious — Milliways: The Restaurant at the End of the Universe, the unreleased sequel to Infocom's The Hitchhiker's Guide to the Galaxy. For the first time, here's the full story: with never-before-seen design documents, internal emails, and two playable prototypes. Sit back, this might take a while.

Note: I've pieced together this history from emails and notes from the Infocom Drive. I haven't contacted any of the people mentioned, so if you're a primary source or authority, please get in touch so I can make corrections.

Update: Don't miss the comments section. Infocom alumni Dave Lebling, Steve Meretzky, Amy Briggs, and Tim Anderson all comment on the story, Zork co-author Marc Blank helps correct an error, and writer Michael Bywater provides an alternative view of the events.

April 24: Michael Bywater just announced in the comments that he's going to fleshing out his story of Restaurant's development as an article for Wired!

One of the biggest criticisms of Google's App Engine have been cries of lock-in, that the applications developed for the platform won't be portable to any other service. This morning, Chris Anderson, the Portland-based cofounder of the Grabb.it MP3 blog service, just released AppDrop — an elegant hack proving that's not true.

AppDrop is a container for applications developed with the Google App Engine SDK, running entirely on Amazon's EC2 infrastructure. Just like Google's Appspot, anyone can use a modified SDK to deploy their App Engine apps directly to Amazon EC2 instead of Google, and they work without modification.

This proof-of-concept was built in only four days and can be deployed in virtually any Linux/Unix hosting environment, showing that moving applications off Google's servers isn't as hard as everyone thought.

How does it work? Behind the scenes, AppDrop is simply a remote installation of the App Engine SDK, with the user authentication and identification modified to use a local silo instead of Google Accounts. As a result, any application that works with the App Engine SDK should work flawlessly on AppDrop. For example, here's Anderson's Fug This application running on Google App Engine and the identical code running on EC2 at AppDrop.

Of course, this simple portability comes at the cost of scalability. The App Engine SDK doesn't use BigTable for its datastore, instead relying on a simple flat file on a single server. This means issues with performance and no scalabity to speak of, but for apps with limited resource needs, something as simple as AppDrop would work fine.

I spoke to Chris this morning about his project and where he wants it to go. "AppDrop is open-source just like the Google SDK, so I'm hoping someone will come along and take it to the next level," he said. "It wouldn't be hard for a competent hacker to add real database support. It wouldn't be that hard to write a Python adapter to MySQL that would preserve the BigTable API. And while that wouldn't be quite as scalable as BigTable, we've all seen that MySQL can take you pretty far. On top of that, you could add multiple application machines connecting to the central database, and load-balancing, and all that rigamarole."

While this is only a hack, it demonstrates that App Engine developers don't need to live in fear of Google's reprisal. "The upshot is that if you put a lot of time into an App Engine app, and then run afoul of Google, you have alternatives, even if they are more work."

Update: Chris announced the project on his own blog, with some design notes.

April 20, 2008: Addressing concerns with data lock-in, Google announced that large-scale data import and export for will be coming soon to App Engine.

For lack of a better name, let's call them supercuts. (Thanks, Ryan.)

Here are some examples I could find, but I'm sure there must be more. Post 'em in the comments and I'll add them. Bonus points for supercuts with the most clips, the shortest clips, and in additional genres (sports? politics?).

Film

Glengarry Glen Ross - Obscenity Count
Ship, Computer, and Sauce in the first six Star Trek films
Shia LaBeouf in "No No No No"
Requiem for a Dream, montage of every drug montage (meta!)
Big Lebowski, every "fuck"
Casino, every "fuck"
Big Lebowski, Every "dude"
True Romance, every kill from the finale
True Romance, every "fuck"
Rushmore, handjob references (thx, Matt)
Scarface, every "fuck" (thx, oscar)
The Departed, every "fuck" (thx, oscar)
Jay and Silent Bob Strike Back, every "fuck" (thx, MeatFarley)
All the pauses and silence in His Girl Friday from 1940 (thx, progosk)
The Incredibles, buttons, doors, and explosions (thx, Joshua)
Fargo, every "yeah" (thx, Doobybrain)
Charles Bronson Death Wish Bodycount (thx, Dave)
Chris Hefner's Talking Picture (The Road to Ruin), removes all words from a 1938 film (thx, Jamie)
Boondock Saints, every "fuck" (thx, Brandon)
Midnight Run, every "fuck" (thx, Lakawak)

TV

Every "What?" from the LOST series
Legend of Zelda TV show, Excuse Me, Princess!
Knight Rider - Turbo Boosts
CSI: Miami, Caruso's One-Liners
The Simpsons, every couch intro
The Sopranos, Every single whacking
Ojamajo Doremi, every transformation
Star Trek: The Next Generation, Last 10 seconds of every episode of season 1
Every Dragonball Z transformation
Mighty Morphin' Power Rangers, every finishing move from Season 1
Deadwood, every curse in Episode 1, 2, and 3 (thx, Brian W)
LOST, Sawyer says "Son of a Bitch" (thx, Jordan)
Rozen Maiden, every "Desu" (527 times! More context, thx Jason)
Buffy the Vampire Slayer, every mention of "Buffy" from Season 1 (Chuck Jones)
Battlestar Galactica, every "frak" from season 1 (thx, Nowak)
Big Brother's Julie Chen, every "but first" (thx, Cardhouse)
House M.D., every "lupus" reference (thx, engtech)
LOST, Sawyer's nicknames in the first three seasons (thx, oscar)
Rachael Ray, "Mmm!"
MTV's Newport Harbor, 82 "like"s in one episode (thx, Jamie)
Red Dwarf, every "smeg" reference in all 52 episodes (thx, arto)
LOST, Desmond saying "Brother" (thx, cypher)
The Wire, Clay Davis' "Sheeeeeit" (thx, dunk3d)
24, Jack Bauer says "damn it" (thx, jonathan)
The Simpsons - Homer's D'ohs, excerpt from an official episode (thx, Scott)
Scrubs - Every Girls Name to J.D. from Dr. Cox (thx, oscar)
Naruto - Every Rasengan from the filler story arcs (thx, Binkley)
The Hills, without the dialogue (thx, Rex)
Bea Arthur says "Whoa!" on the Golden Girls (thx, BWE)

Games

Half-Life series, every G-Man sighting (and part 2)
Every Famicon (NES) Game Title Screen

Miscellaneous Sources

Various films, Wilhelm Screams
Various films, The Slow Clap
Various films, NOOO!
Steve Jobs says "Boom!" in Mac keynotes (thx, Jeff)
Clip from Christian Marclay's "Telephones" from 1995 (thx, progosk)
iPhone "Hello" ad, heavily inspired by "Telephones" (thx, progosk)
Phil Collins' "In the Air Tonight," every "Oh Lord" (thx, oscar)
2008 State of the Union, without any speech

Audio

Only the inhaling from an hour of NPR's All Things Considered (Chuck Jones)
Loveline, every question asked by the hosts (Chuck Jones)
Loveline, every name mentioned in alphabetical order (Chuck Jones)
Loveline, every "Yes" and "No" (Chuck Jones)
Loveline, every number (Chuck Jones)
Loveline, interjections (Chuck Jones)
Loveline, dead air (Chuck Jones)
NWA's Straight Outta Compton, obscenities only (thx, oscar)

Honorable Mention

A commenter points to the work of Chicago artist Chuck Jones, who's created a number of excellent audio and video supercuts he calls Isolation Studies. I've listed them all above.

The "Most Obsessive" award goes to artists Jennifer & Kevin McCoy for their work Every Shot, Every Episode from 2001, a 277 DVD set compiling 10,000 clips from Starsky & Hutch, arranged by categories like "Every Dead Body," "Every Mirror," "Every Gunshot," and "Every Affirmative Response." Other work of theirs includes I Number the Stars, a shot-by-shot index of the first 20 Star Trek episodes in 120 categories, How I Learned, a 10,000 shot inventory of the show Kung Fu in over 100 categories, and Every Anvil, cataloging the violence in 100 Looney Tunes cartoons. Mind-blowing. (Thx, Buzzfeed!)

For the first time since I started blogging in 2002, I've redesigned Waxy.org. Over the last six years, I've grown pretty sick of the old design but never found the time to rework it. Mostly, the changes are cosmetic. Cleaner design, new logo, bigger type, headlines, better iPhone support, and more space devoted to Waxy Links.

I've also taken the opportunity to change my URL structure, removing some cruft and giving some additional length to the slugs. All old URLs should redirect, thanks to some mod_rewrite magic and a little PHP.

One change that might affect you is that you'll now be seeing all of my longer articles in the Waxy Links feed, so you might want to unsubscribe from the main feed to avoid getting duplicates. Since I generally only post once a day, and I try to only write things I'd want to link to, this seems like a good alternative to linking to my own posts. If you really don't like this change, please let me know privately and I'll work something out.

What do you think? Nothing's permanent, so I'm all ears.

Update: You're probably seeing some weirdness in the RSS feed. Links appearing in the articles RSS feed, tons of old entries, and links pointing directly to Waxy.org instead of the sites I was linking to. All of these problems are fixed! But feedreaders take time to update, so it'll be resolved as soon as your RSS reader of choice sees the updated feed. Sorry!

Earlier today, I received an email from Steve Ducharme, the producer/director of the Internet Power series that I digitized last month. "I produced, edited and narrated that video many years ago," he wrote. "Thanks for digging it out. I haven't seen it in years. We really have come a long way since then."

In the comments, several people pointed out a noticeable mistake in the video in which the narrator claims Mosaic was developed in 1934. As it turns out, this was fixed in later editions. "I actually came out with a corrected version of that tape," said Ducharme. "In a later version, it was changed to the correct year of 1936. (Kidding, of course, 1993.)"

He also gives some insight into how hard it was to capture video in the early '90s. "We had to rent this gigantic VGA to NTSC converter for about $500 a day to capture those screens," said Ducharme. "It was huge, had to be rolled in and had an operator to work it. Must go now. Am feeling old. Thanks again."

Thanks for the info, Steve! And with that, it's on to Volume 2...

Internet Power Volume 2: Discover the World of Online Education

"Many people believe that the Internet will have the same impact on society as the invention of the printing press did! It will change our world dramatically by making vast amounts of information available to everyone worldwide... if you know how to use it!"

With those breathless words, we start the second volume of Internet Power, the video tutorial series about the Internet from 1995. While the last episode focused on Entertainment, this one teaches you about Education -- museums, libraries, and other research tools.

It's very similar to the first episode with an almost-identical structure, but focusing on a new set of vintage websites. Microsoft's Bret Arsenault appears again, and they focus on Yahoo! again.

Highlights

03:21. Using Yahoo circa 1995 to search for "civil war" sites. The results are in alphabetical order by category name, rather than any attempt at ordering by relevancy.

"We click on the hypertext link, the Civil War Gallery. The URL address for this site is hidden in the link and it automatically takes us to the Civil War Gallery." Updated September 25, 1995!

05:55. "A reminder to you that clicking on links and moving from site to site usually will take a few seconds depending on the speed of your computer's modem. For the purposes of this video, we are moving instantly to each screen with the help of video editing."

06:30. Downloading a 1MB JPG from the Library of Congress and viewing it in ImageView for Windows.

10:15. Listening to a WAV audio greeting from Michael Heyman, the Secretary of the Smithsonian Museum. 40 seconds of filler!

11:35. "This will get you started, but the best thing to do is follow the hypertext links. Explore the Internet and discover your own favorite sites. It's kind of like going to a new city! The streets aren't familiar at first, but after traveling around for a while you'll discover your favorite places in the city that have the activities and interests you're looking for."

12:00. "The Internet has not forgotten about the children of the world." I love this line.

13:00. "This brings us to, of all places, the CIA Website. Don't worry! It's okay that we're here. They keep their top-secret files someplace else."

16:40. "Speaking of science projects, it's pretty difficult going all the way through school without having to do a science project. If this is the case for you, there are ideas on the Internet if you look for them."

20:20. Searching for tuition rates for the University of Washington. In 1994, $969 per quarter for full-time residents, $2,733 for non-residents. (Just for fun, I looked up the current rates. $2,129 for residents, $7,377 for non-residents.)

23:30. Browsing SPRY's Gopher server, explaining how to download JPG files with Gopher.

25:50. "But if you really want to see the power of the Internet for doing research and finding information, just click on the folder 'Libraries of the Internet.' Now hold onto your hats and click the icon that says 'Other Libraries around the US.' Up comes over 100 libraries that you can click on and get even more information of all kinds." He finally concludes, "Never again will you be able to use the excuse of 'Gee, I just couldn't make it to the library last night!'"

27:00. The big ending. "Not bad for 30 minutes, is it? We think you will agree after watching this video that the Internet will change the way we learn forever. Well, we're off to our next website and we hope you enjoy the Internet as much as we do. Remember, in the next century, the person with the most information wins. Good luck on your journey, surf wisely, and have a great time!"

URL Addresses for Websites We Visited

Here's a list of the URLs mentioned in the credits.

Smithsonian, http://www.si.edu
Virtual Science and Math Fair, http://www.educ.wsu.edu/fair_95 (misspelled as www.educ.wsu)
KidsWeb, http://www.npac.syr.edu:80/textbook/kidsweb
Yahoo!, http://www.yahoo.com
Internet College Exchange, http://www.usmall.com/college
University of Washington, http://www.washington.edu
Midlink, http://longword.cs.ucf.edu/~midlink
Web 66, http://web66.coled.umn.edu/schools.html
Welcome to the Planets, http://stardust.jpl.nasa.gov/planets
Library of Congress, http://www.loc.gov (misspelled as www.loc/gov)
Civil War Photo Gallery, http://www.magibox.net/~civilwar/harper.html

Just received word that Game Neverending is back online! This game was extremely innovative, but played by very few people during its limited beta test. One of the very first web-based MMOs, Game Neverending was eventually shut down as the Ludicorp team focused their efforts on Flickr.

Last year, Cal Henderson showed me an internal server running the original GNE code, but it wasn't accessible outside the company intranet. Over the last year, Cal and Myles have ported the old ASP codebase to PHP, and it's now live for anyone to play for the first time.

http://gne.flickr.com/

(You'll need to be signed in to Flickr for the link to work.)

Here's the April Fools-themed message that announced it publicly, a parody of Jerry Yang's internal emails. More than an April 1 prank, I've been told that it'll be around longer than today only but completely unsupported. Hooray!

Update: After much speculation, I'm happy to announce GNE is still alive on April 2. I spent all yesterday playing, got up to Level 7, built a lovely house in Fierov Heights, and had enough making points to build the final item of the game, a Game Neverending. Unfortunately, I was about $8 million short to buy the ingredients. (Stewart, Caterina, Ben, and five other Ludicorp employees must be purchased in the back room of a mash pub for $1M each.)

Everybody pooled their resources to buy the ingredients, and at about 8pm, a Game Neverending was created. We passed it around so everyone could hold it, and then handed it back to its creator so she could win the game. Screenshots here.

Update: GOD announced it's shutting down in an hour (about 11am PST). As yeoz said, "GNE is a shared temporary hallucination."

Aaand, it's gone. I managed to send it off by winning the game in the last four minutes. I captured video of building the GNE and using it to win the game. Striatic also captured the last few minutes of the game.

"As computer technology becomes part of everyday life, a new program comes to BBC2 now: be you beginner, buff, or somewhere in between."

Thanks to Martin Brewer, here's the first episode of The Net, a documentary series that ran for four seasons from 1994 to 1998. Despite the name, this first episode has very little to do with the Internet. Instead, it's an almost perfect video equivalent of the early Wired Magazine, covering a mish-mash of digital culture from video games to virtual reality.

This episode has five segments.