Dec 15, 2008 114 reads by Navneet Kaushal

The Live Search has come up with an entirely new search engine crawler that is named as msnbot/2.0b

According to The Live Search Blog,

“You’ll still see the current version msnbot/1.1 (+http://search.msn.com/msnbot.htm) as Live Search’s primary user agent. We intend to ensure that any robots exclusion protocol you are using is respected. As such, you don’t need to update your Robots.txt file. We plan on crawling at a slow speed during the tests with the updated version.”

The feature is currently on a test mode but will replace the old spider very soon! The new spider will respect the current robots.txt protocol set up for MSNBot, so the users will not find any kind of additional need to set up anything new in their robots.txt file.

Above all, Microsoft promised to crawl slowly in their msnbot/2.0b tests.

Navneet Kaushal

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.
Navneet Kaushal
Navneet Kaushal
FOLLOW US AND GET LATEST NEWS
125,891
Most popular Posts
Tweets
Upcoming Events
Events are coming soon, stay tuned!More