Jul 17, 2014 113 reads by Ritu Sharma

Google has updated its robots.txt tool in Webmaster Tools to make it easier to maintain and make robots.txt files.

Test Robot.txt Tool with the Updated Robots.Txt Tool

Now Webmasters can see the robots.txt file and even test new URLs to check whether they're disallowed for crawling. The new tool will also highlight a specific directive that led to the final decision to guide your way through complicated directives. Webmasters can now test and make changes in the file by simply uploading the new version of the file to their server to make the changes take effect before making the file live.

In addition to the above feature, Webmasters will also be able to review the older versions of their robots.txt file, and check the past issues. 

Google has also recommended to double check the robot.txt files as there can be some errors or warnings displayed for your existing sites. Webmasters can now combine it with other parts of Webmaster Tools. robots.txt tester can be used to find out whether any blocked URLs are reported as well as improve that. Fixing problems coming from old robots.txt files that block JavaScript, CSS or mobile content is also essential once seen.

The updated tool will make it easier for Webmasters to maintain & test robots.txt file.

Test robots.txt Files with the Updated robots.txt testing tool!, 5.0 out of 5 based on 2 ratings
Ritu Sharma
Ritu from PageTraffic is a qualified Google Adwords Professional and Content Head at PageTraffic. She has been the spear head for many successful Search Marketing Campaigns and currently oversees Content Marketing operations of PageTraffic in India.
Most popular Posts
Upcoming Events
Events are coming soon, stay tuned!More