The geek blogosphere is currently going bananas over a revelation on John Battelle's Searchblog and The Wall Street Journal, viz: "Alexa, an Amazon-owned search company started by Bruce Gilliat and Brewster Kahle (and the spider that fuels the Internet Archive), is going to offer its index up to anyone who wants it. Alexa has about 5 billion documents in its index - about 100 terabytes of data. It's best known for its toolbar-based traffic and site stats, which are much debated and, regardless, much used across the web," writes Battelle.
In other words, Alexa and Amazon are turning the index inside out, and offering it as a web service that anyone can mashup to their hearts content. Entrepreneurs can use Alexa's crawl, Alexa's processors, Alexa's server farm....the whole nine yards.
This isn't free: there are "consumption fees": "One dollar per CPU hour consumed. $1 per gig of storage used. $1 per 50 gigs of data processed. $1 per gig of data uploaded".
Whether it will lead to some interesting applications is anyone's guess....
