Yahoo's New Crawl Behavior Seems To Be Impressing No One!

Aug 28, 2007 | 2,144 views | by Navneet Kaushal
VN:F [1.9.20_1166]
Rating: 0.0/5 (0 votes cast)

Just last week we reported about improvements in Yahoo's crawl, index and ranking systems.

The new crawl promised to " improve comprehensiveness and freshness of coverage while also enhancing crawl efficiency, which reduces spurious load on websites."

The new crawl did have a good start with some users who said:

  • Asia_Expat
  • “Yahoo traffic quadrupled today and now outstrips my Google traffic. I don't know if it's a blip but it appears to be an improvement in traffic from Yahoo across the board and not from a few specific keywords.”
  • SE_Magnets
  • “It looks like their crawler update has helped out with our indexing issue as well. We were recently working on an issue with Yahoo indexing our articles properly. We couldn't figure out what was going on because both Google and MSN had indexed them fine. So it looks like all is well now.”

Many others are saying,

"OK, this is completely bogus and helps nobody. The number of IPs that Slurp uses? WHO CARES…

The fact that Yahoo has multiple crawlers for every division that crawl independently and don't share the common cache, now THAT's a problem that needs to be fixed."

"Well Yahoo is a waste of bandwidth on one of my sites (a large directory). It hammers it almost every day and has only sent about 975 referrers this month. That is so low that I wonder if people even use Yahoo in Ireland for anything other than e-mail. I am strongly considering blocking it.”

Read the rest of the thread at Webmaster World.

4.thumbnail Yahoos New Crawl Behavior Seems To Be Impressing No One!

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.
4.thumbnail Yahoos New Crawl Behavior Seems To Be Impressing No One!
4.thumbnail Yahoos New Crawl Behavior Seems To Be Impressing No One!