Google

Robots.txt

Robots.txt

Robots.txt robots.txt

Robots.txtrobots.txt

Robots.txt

Robots.txt

http://www.abc.com/robots.txt

Robots.txt

robots.txt robots.txt

googlebot
/cgi-bin/

robots.txtGooglecgigooglebot googlebotcgi

googlebot
/support

robots.txtgooglebot Googlebot

googlebot

googlebot(*)googlebot

*
/cgi-bin/

*robots.txtcgi cgi

robots.txt *

Webexcel(ISO 9001:2000) SEO