Page 1 of 1
Posted: Tue Feb 26, 2008 9:17 am
by Ka-canor
A very useful site for this information leftyboys.
Robbots txt
Posted: Tue Feb 26, 2008 8:13 pm
by peterko
I never thought such site about robots txt exists. It seams to me pretty helpful.
Have a great day,
Peter
Posted: Tue Feb 26, 2008 10:00 pm
by Datasolutioninc
A very helpful site for this information.
Posted: Thu Apr 24, 2008 10:28 pm
by Sonal
Yes1 it is very useful website for robot. It also helpful to understand each and every thing about robot
Posted: Thu Apr 24, 2008 10:47 pm
by delhiseo
Its code like this :
user-agent:*
disallow:/abc/
Sitemap:
http://www.yourwebsitedomain.com/sitemap-filename.xml