New Crawler: MSNBot/2.0b by Live Search

Dec 15, 2008 | 2,576 views | by Navneet Kaushal
VN:F [1.9.20_1166]
Rating: 0.0/5 (0 votes cast)

The Live Search has come up with an entirely new search engine crawler that is named as msnbot/2.0b

According to The Live Search Blog,

“You’ll still see the current version msnbot/1.1 (+http://search.msn.com/msnbot.htm) as Live Search’s primary user agent. We intend to ensure that any robots exclusion protocol you are using is respected. As such, you don’t need to update your Robots.txt file. We plan on crawling at a slow speed during the tests with the updated version.”

The feature is currently on a test mode but will replace the old spider very soon! The new spider will respect the current robots.txt protocol set up for MSNBot, so the users will not find any kind of additional need to set up anything new in their robots.txt file.

Above all, Microsoft promised to crawl slowly in their msnbot/2.0b tests.

4.thumbnail New Crawler: MSNBot/2.0b by Live Search

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.
4.thumbnail New Crawler: MSNBot/2.0b by Live Search
4.thumbnail New Crawler: MSNBot/2.0b by Live Search