Feb 26, 2008 113 reads by Navneet Kaushal

Complaints are appearing at two different forums about the search engine crawlers from Microsoft. Reportedly, at WebmasterWorld , MSRbot, Microsoft's research bot is being said to crawl pages that don't even exist.

The MSRbot seems to ask for some non-existent pages, further the URLs it has supplied in UA string, simply can't reach anywhere, reports a WebmasterWorld member. "Note, before they were crawling from above.net, ip – 209.249.11.x and now they are coming from ip owned by microsoft. Since their behaviour is suspicious i banned them through .htaccess. anybody else seeing this?," said marodhum. Apparently, this issue isn't news, because as far back as April 2003 it was there and continues to be like that till today. At the same time it doesn't look to be linked with the Live Search team.

The other complaint features at the DigitalPoint Forums where, it's being noticed that MSNBot's quite busy on particular forum. "Hello, Has Live search gone mad, they have 10 things crawling my forum:Is there a reason for this, it has happened at least five times in the last two days with sudden spikes," says Calum.

The discussions continue at WebmasterWorld & DigitalPoint Forums.

Navneet Kaushal

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.
Navneet Kaushal
Navneet Kaushal
Most popular Posts
Upcoming Events
Events are coming soon, stay tuned!More