Googlebot Crawls More Pages Than Existing Ones

Nov 11, 2006 | 148 views | by Navneet Kaushal
VN:F [1.9.20_1166]
Rating: 0.0/5 (0 votes cast)

In October Google had posted  Googlebot activity reports displaying  number of pages on the sites crawled in last three months by Googlebot. Some people then questioned Google about how crawled pages are higher than actual number of pages on sites. The official Google Webmaster Central blog clarifies the question. According to it there are many factors involved in determining crawling of pages by  Googlebot . The main factors are

  • Pages it already knows about
  • Links from other web pages (within your site and on other sites)
  • Pages listed in your Sitemap file
4.thumbnail Googlebot Crawls More Pages Than Existing Ones

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.
4.thumbnail Googlebot Crawls More Pages Than Existing Ones
4.thumbnail Googlebot Crawls More Pages Than Existing Ones