Robots.txt syntax a verifica

Scriere robots.txt dosar is relatively straightforward. Totu�i, s�u lini�tit
drept virgul� la spre a lua ni�te mic part de la syntax gre�eal�, �i apoi atunci la spre afl�
that un robot has a umbla tot �nc� o dat� al t�u site fiindc� de it.