Robots.txt syntax checker

Writing robots.txt files is relatively straightforward. However, its still
fairly common to get some small part of the syntax wrong, and then to find
that a robot has wandered all over your site because of it.