Jan 8, 2007 115 reads by Navneet Kaushal

The GoogleBot collects documents from the web to build a searchable index for the Google search engine. The recent debate at the SEO Refugee Forums has highlighted the topic,Goglebot is crawling CSS Files or not.

A member claims “I tested this a few months ago: Do search engines crawl CSS files? The test was simple enough: change the name of the CSS file and look for requests from Googlebot and from google.com. This test works around any caching of the CSS file, and also picks up any cloaked requests. End result? No crawling over a two-week period with thousands of Gbot requests for pages (it nicely coincided with a time when Gbot took a deep dive). I keep checking once in a while for the CSS file requests and nothing has come up.”

Another user wanted more CSS files. One is from ekstreme.com. However, he could not find any Googlebot request for that. He checked other sites and failed to find any requests there either. He concludes there is only a CSS file request by Googlebot.

Navneet Kaushal

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.
Navneet Kaushal
Navneet Kaushal
Most popular Posts
Upcoming Events
Events are coming soon, stay tuned!More