MSRBot Bot & Microsoft Bot Behave Mysteriously On Some Servers!

Feb 26, 2008 | 1,928 views | by Navneet Kaushal
VN:F [1.9.20_1166]
Rating: 0.0/5 (0 votes cast)

Complaints are appearing at two different forums about the search engine crawlers from Microsoft. Reportedly, at WebmasterWorld , MSRbot, Microsoft's research bot is being said to crawl pages that don't even exist.

The MSRbot seems to ask for some non-existent pages, further the URLs it has supplied in UA string, simply can't reach anywhere, reports a WebmasterWorld member. "Note, before they were crawling from above.net, ip – 209.249.11.x and now they are coming from ip owned by microsoft. Since their behaviour is suspicious i banned them through .htaccess. anybody else seeing this?," said marodhum. Apparently, this issue isn't news, because as far back as April 2003 it was there and continues to be like that till today. At the same time it doesn't look to be linked with the Live Search team.

The other complaint features at the DigitalPoint Forums where, it's being noticed that MSNBot's quite busy on particular forum. "Hello, Has Live search gone mad, they have 10 things crawling my forum:Is there a reason for this, it has happened at least five times in the last two days with sudden spikes," says Calum.

The discussions continue at WebmasterWorld & DigitalPoint Forums.

4.thumbnail MSRBot Bot & Microsoft Bot Behave Mysteriously On Some Servers!

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.
4.thumbnail MSRBot Bot & Microsoft Bot Behave Mysteriously On Some Servers!
4.thumbnail MSRBot Bot & Microsoft Bot Behave Mysteriously On Some Servers!