16.08.2006
This is more boasting than anything else, but I DLed the AOL-logs myself, imported the data into my database, and tried a few queries.
After importing data, adding a few indexes (which took a long time to generate) most queries completed within seconds. That is, full text search as you can search with google, on a 40 million row table. Within seconds.
I like my database. I like Microsoft SQL Server 2005.
However, I just had to run the killer query of all killer queries. I intend to invetigate this DB further, but in the meantime, please check out my nice stats (and the top 100 searches) here.
For those too lazy to click the link, the most popular searches involve finding other search-engines, myspace and internet. Nice!