Test robots.txt Files with the Updated robots.txt testing tool!

Jul 17, 2014 | 1,128 views | by Ritu Sharma
VN:F [1.9.20_1166]
Rating: 5.0/5 (2 votes cast)

Google has updated its robots.txt tool in Webmaster Tools to make it easier to maintain and make robots.txt files.

robots.txt file Test robots.txt Files with the Updated robots.txt testing tool!

Now Webmasters can see the robots.txt file and even test new URLs to check whether they're disallowed for crawling. The new tool will also highlight a specific directive that led to the final decision to guide your way through complicated directives. Webmasters can now test and make changes in the file by simply uploading the new version of the file to their server to make the changes take effect before making the file live.

In addition to the above feature, Webmasters will also be able to review the older versions of their robots.txt file, and check the past issues. 

Google has also recommended to double check the robot.txt files as there can be some errors or warnings displayed for your existing sites. Webmasters can now combine it with other parts of Webmaster Tools. robots.txt tester can be used to find out whether any blocked URLs are reported as well as improve that. Fixing problems coming from old robots.txt files that block JavaScript, CSS or mobile content is also essential once seen.

The updated tool will make it easier for Webmasters to maintain & test robots.txt file.

Test robots.txt Files with the Updated robots.txt testing tool!, 5.0 out of 5 based on 2 ratings
24.thumbnail Test robots.txt Files with the Updated robots.txt testing tool!
Ritu from PageTraffic is a qualified Google Adwords Professional and Content Head at PageTraffic. She has been the spear head for many successful Search Marketing Campaigns and currently overseas Content Marketing operations of Page Traffic in India.