Mar 15, 2008 114 reads by Navneet Kaushal

Recently a post by Bill called 'Slow Down Nosy SEO's and Snooping Competitors' has been creating quite a wave at the Sphinn discussion thread. The post gives out techniques that can really affect the "lazy assed" SEOs from simply copying down your priced SEO techniques.

These are few of the techniques that he has listed in his post:

  • By blocking the, you can prevent people from snooping into your archive pages and stop them from knowing the details of your site. To block their crawler go to, User-agent: ia_archiver and Disallow: /
  • However, the snoopy crawler still would crawl your site, therefore it would be ideal to add the ia_archiver to your .htaccess file as a precautionary measure.

  • You can disable Search Engine Cache on your plus pages. Just insert the meta tag on top of all your web pages for stronger preventive action.
  • You can block competitive analysis tool like Xenu by adding it to the .htaccess file.
  • RewriteCond %{HTTP_USER_AGENT} ^ia_archive [OR]

    RewriteCond %{HTTP_USER_AGENT} ^Xenu

    RewriteRule ^.* – [F,L]

  • It will be smart to make your Domain Registration Private.
  • You can completely restrict the unauthorized tools from accessing your site by using white list methods and black list methods.
  • Use the nifty PHP bot speed trap or AntiCrawl to block bots and speeding crawlers.
  • You should not allow everyone to see your robots.txt file, instead prevent the snoopers by using a dynamic robots.txt file.
  • Another creative way that Bill advises is to cloak the meta tags. This will allow only the search engines see the tags, while you can easily prevent the "snooping" SEOs from seeing your meta keywords or description.

This post by Bill has become a hot topic on Sphinn and many webmasters have praised him for this effort. His post is certainly a very different take on things widely prevalent in the SEO marketing strategies. Also read, about – Varying Anchor Text, Is It Good Or Bad For SEO?

Navneet Kaushal

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.
Navneet Kaushal
Navneet Kaushal
Most popular Posts
Upcoming Events
Events are coming soon, stay tuned!More