Search Engine Forums, SEO Forum

Hello friends,

Why We Use robot.txt file In Seo..?

Robots.txt is mainly used for blocking purpose. If we don't want some pages to crawl by the search engine, then we can do this by robots.txt.

robot.txt is mainly used to call search engine robot on your website and you can also mentioned into that which page you want to list on engine and which not.
for more information please visit at http://trickstechtips.com/computer-tric ... -software/

Robot.txt is generally use in website to tell search engine that which url should be crawl or which one not.

Robot.txt is generally use in website to tell search engine that which url should be crawl or which one not.

We 'll have a high rank from robots.txt , if we optimize this.

we used this file for do follow or no follow for a particular web page. [http://www.entertainmentdose.com/upcomi ... hin-movie/][/url]