Badly Written Search Engines

Ramblings / March 13, 2007 / John / 0

So, I was having a look through my web activity stats (as you do) to see why I’d had a sudden upsurge in traffic over the past few weeks. Imagine my complete surprise to discover that it’s because Microsoft are crap programmers! Who knew?

So, my site – being largely content based – tends to get spidered by search engines pretty frequently. As an example, I’ve had 1204 hits, totalling 9Mb of traffic from Googlebot over two seperate sessions.

Just recently, however, I’ve been spidered by Microsoft’s new Live Search service. In typical Microsoft fashion, they’re taking a thuggish brutal approach to indexing. Over the same period as the above googlebot stats, Live generated 4602 hits and 28Mb of traffic. That’s over three times as much. Not only that, but it was over 28 seperate sessions.

So, if anyone out there is wondering why their bandwidth bill is going up, it’s because Microsoft are attempting to eat all the bandwidth in the universe with their inefficient brute-force search engine.

John

UNIX geek, wannabe cook, musician, book-lover, and all round good-guy.