Jan 17, 2017 113 readsby Ritu Sharma

In a recent blogpost Gary Illyes has explained crawl budget is, crawl limit, crawl demand, and factors that affect crawl budget.

Gary says, there is no single term to define crawl budget and it’s not something most publishers have to worry about. Prioritizing what to crawl, when to crawl and how much resource the server hosting site can allocate to crawling is more important to bigger sites or to the sites that auto-generate pages based on URL parameters.

  • Googlebot is designed to crawl the website pages without degrading user experience. Crawl rate may go up and down depending upon crawl health and limit set in Search Console.
  • Crawl demand means how much Googlebot crawls your pages depending upon the popularity of your website and the staleness of the URLs in the index.
  • Crawl rate and crawl demand together determine the Crawl Budget. “Taking crawl rate and crawl demand together we define crawl budget as the number of URLs Googlebot can and wants to crawl.”
Google Explains What Crawl Budget Means For Googlebot!, 5.0 out of 5 based on 1 rating
Ritu Sharma
Ritu from PageTraffic is a qualified Google Adwords Professional and Content Head at PageTraffic. She has been the spear head for many successful Search Marketing Campaigns and currently oversees Content Marketing operations of PageTraffic in India.
FOLLOW US AND GET LATEST NEWS
Most popular Posts
Tweets
Upcoming Events
  • Events are coming soon, stay tuned!
More