Yahoo! Search Launches New Slurp Crawler

Jul 31, 2006 | 1,971 views | by Navneet Kaushal
VN:F [1.9.20_1166]
Rating: 0.0/5 (0 votes cast)

Yahoo! Search has updated its Slurp Crawler to crawl sites  faster. In addition, the new Crawler is more efficient at visiting websites, says David Simpson at a Yahoo! Search blog.

Site owners, as a result, will notice as much as a "25% reduction in the number of requests and bandwidth consumed by the crawler." As the bandwidth consumption lowers down, the new Yahoo Slurp gives an advantage to the web publishing and blogging community who struggle with bandwidth. With the change in Crawler, there will be some shuffling of the pages included in the index and some changes in ranking as well.

More from the Yahoo! Slurp team;
"While transitioning to the new crawler over the past few weeks, we had been running both crawlers in tandem. In some cases, this increased the frequency of Yahoo Search requests to websites. Now, with the new crawler in full production, we have turned off the old crawler and site owners should see a much lower crawl load without a loss in content coverage."

4.thumbnail Yahoo! Search Launches New Slurp Crawler

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.
4.thumbnail Yahoo! Search Launches New Slurp Crawler
4.thumbnail Yahoo! Search Launches New Slurp Crawler