In October Google had posted Googlebot activity reports displaying number of pages on the sites crawled in last three months by Googlebot. Some people then questioned Google about how crawled pages are higher than actual number of pages on sites. The official Google Webmaster Central blog clarifies the question. According to it there are many factors involved in determining crawling of pages by Googlebot . The main factors are
- Pages it already knows about
- Links from other web pages (within your site and on other sites)
- Pages listed in your Sitemap file
Recommend this story
@pagetraffic










