Sitemaps Autodiscovery Now Available With

Jul 18, 2007 | 2,884 views | by Navneet Kaushal
VN:F [1.9.20_1166]
Rating: 0.0/5 (0 votes cast) Adds Sitemaps Autodiscovery Support reports Barry Schwartz.
This was discovered thanks to Sean Carlos who posted a comment in search engine land:

"Ask has since documented sitemap support here:

While the ping mechanism does work, I haven't seen them actually crawl the file, but that could be attributed to their low overall crawling rate.

Before embracing sitemaps auto-discovery, one should ask the question: is it sensible to facilitate content scraping by providing a list of all of your URLs to the world? I believe it is wiser to stick with manual notification via Google's Webmaster Dashboard and Yahoo!'s Site Explorer. To the extent there are few major search engines, manual pinging is not a major issue for the others, which for now is limited to Ask as Microsoft has not yet begun supporting sitemaps."

On how to ping, find help at Webmaster Help documents. Here's another example of a ping attempt.

How to add sitemap autodiscovery?

Once you have prepared the sitemap, add the sitemap auto-discovery directive to robots.txt as follows:

SITEMAP: http://www.the URL of your sitemap here.xml

The sitemap location should be the full sitemap URL. Alternatively, you can also submit your sitemap through the ping URL: URL of your sitemap here.xml

Please note that sitemap submissions do not guarantee the indexing of URLs. To learn more about the protocol, please visit the Sitemaps web site at

For more updates and news on's sitemaps autodiscovery, watch this space.

4.thumbnail Sitemaps Autodiscovery Now Available With

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.
4.thumbnail Sitemaps Autodiscovery Now Available With
4.thumbnail Sitemaps Autodiscovery Now Available With