Yahoo! Slurp finds a new home. Yahoo! Is moving its crawler from inktomisearch.com to crawl.yahoo.net.
Yahoo! Search blog informs, “The user-agent will continue to be Yahoo! Slurp, hence you do not need to make any changes to your robots.txt file. Nor are we changing the actual IP addresses of the crawler infrastructure during this transition. However, if you do any reverse DNS checks for the crawler identity or have any network access rules to allow inktomisearch.com, please also update them to allow for crawl.yahoo.net.”
The shifting has started on immediate basis. However, the complete transition may take a few weeks. So some might still see Yahoo! Slurp visits from inktomisearch.com.
Recommend this story
@pagetraffic










