The Live Search has come up with an entirely new search engine crawler that is named as msnbot/2.0b
According to The Live Search Blog,
“You’ll still see the current version msnbot/1.1 (+http://search.msn.com/msnbot.htm) as Live Search’s primary user agent. We intend to ensure that any robots exclusion protocol you are using is respected. As such, you don’t need to update your Robots.txt file. We plan on crawling at a slow speed during the tests with the updated version.â€
The feature is currently on a test mode but will replace the old spider very soon! The new spider will respect the current robots.txt protocol set up for MSNBot, so the users will not find any kind of additional need to set up anything new in their robots.txt file.
Above all, Microsoft promised to crawl slowly in their msnbot/2.0b tests.
Recommend this story
Navneet Kaushal, CEO PageTraffic is a trusted authority in the search engine marketing industry. He is a featured author at Web Pro News, Search Newz, Promotionworld, Website Notes, DevWebPro, SEO Article and Web Help Now among many others.
Follow Navneet Kaushal on Google +.
@pagetraffic
{ 2 comments… read them below or add one }
is this bot on sematic search based or intent search, pls explain about its more working
Nice work man..keep it up.
{ 2 trackbacks }