Friday, October 19, 2007

MSNBOT has the munchies

As you know I run a pagan online store SacredKiln.com
This week we had a morning shutdown by our hosting company for going over our bandwidth. I was shocked since we don't ever use half of the bandwidth we're allowed in a month. (We could use more traffic here folks!) I sent off an email to our host and found out that the culprit is MSNBOT spidering or crawling our site. Now normally this is a good thing. Robots as they're called crawl your site going from link to link indexing what you have and putting you up on their search engines for all to find. BUT, and it's a big but, when they use 12.46 GB at a visit it puts you way over your bandwidth and shuts you down until your month is up and you get your new allowance.

My hosting company was sympathetic when he let me know the problem and generously gave us extra bandwidth for the month and promptly blocked MSNBOT from coming back anytime soon.

MSN, can you not run your bots with less bandwidth munching?
I compared this to Google for the same day and Google used 53 MB compared to MSN using 12.46 GB A huge difference.
.................

No comments:

Post a Comment