Microsoft To Begin Testing Updated Search Crawler

Microsoft has announced that they will be testing an updated MSNBot, the crawler for MSN/Live Search, in the coming weeks. The crawler will use the user agent string msnbot/2.0b (+http://search.msn.com/msnbot.htm) and will be crawling a slow speed during testing according to a post on the Live Search Webmaster Center Blog. No details were given as to what updates the crawler has received. MSNBot’s last update was in February when it began supporting HTTP compression and conditional gets.

Leave a Reply

Your email address will not be published.