As seen on Digital Point Forum and Webmaster World, there has been an increase in activity in Yahoo's crawler, Slurp.
Some of the remarks were, “I have too many Yahoo! Slurp spiders crawling my site frequently. Looks like more than the actual users / visitors in my community, these spiders are querying my forum database (MySQL) a lot causing it to reach the max_questions limit and reducing the performance of the site. Though I want yahoo spider to crawl and index my site, I want it to be done adequately without affecting site performance. â€
For a better knowledge, read threads at Digital Point Forum and Webmaster World.
Recommend this story
@pagetraffic










