Archive for June, 2012

 

Website Robots.txt Validator

Always check if the robots.txt has got any errors once you upload it to the server. Below is a link where you can check for the robot.txt . Use the below free Robots.txt validator for analyzing the errors in the robots of the website.

http://tool.motoricerca.info/robots-checker.phtml

The robots should be taken care – so that search engines would be able to see the website robots, knows what to do with the page.