Search Engine Forums, SEO Forum

Posted: **Thu Feb 23, 2012 4:45 am**

Hello! I want know what is robots txt and its using ? Any help would be highly appreciated here.

Posted: **Wed Feb 29, 2012 2:33 am**

robot.txt is the text file that can be used to restrict your webpage or link not to be crawled by spiders of search engine. It will help to prevent crawling of some pages that you dont want to show against search engine.

Search Engine Forums, SEO Forum

What is robots txt? Why we are using these? How i can genera

What is robots txt? Why we are using these? How i can genera

Re: What is robots txt? Why we are using these? How i can ge