I used to have a couple of desktop tools for generating my robots.txt files and had several templates that I would use, but with these handy sites offering FREE robots.txt generators why pay for software or templates as these will work for most website owners looking for a good robots.txt file.
- SEOBook Robots.txt Generator – Very basic
- Mcanerin International Robots.txt Generator – Very good / Excellent – This robots.txt generator has some basic functionality, but also allows you to block specific search engines, crawl delay, restricted directories along with some basic instruction for anyone new to using robots.txt files.
Why use FREE Robots.txt generators? Google says so: