11 Robots.txt Generators & Validators

By CleverSage | January 27, 2008


If you would like to exclude certain pages or sections of your site, the easiest and most effective way to do this is by using a “robots.txt” file. At first it seems simple enough to create and upload one of these files to your website, if you aren’t careful you can accidentally block search engines from listing your website on their results! With that in mind below are a few great Robots.txt generators and validators:

Robots.txt Generators

  1. 1-Hit: Robot.txt generator
  2. 123Promotion: Robots.txt generator
  3. Clickability: Robots.txt builder
  4. Clockwatchers: Robots.txt creator tool
  5. GlobalPromoter: Create a Valid Robots.txt file
  6. McAnerin International: Robot control code generation tool
  7. SEO Chat Tools: Robots.txt generator
  8. Yellowpipe: robots.txt generator

Robots.txt Validators

  1. Motoricerca: Robots.txt checker
  2. SXW.org.uk: Robots.txt syntax checker
  3. Validators: Robots.txt validator

Topics: Accessibility, SEO, Usability |

Comments