Search Engine Forums, SEO Forum

Posted: **Mon Apr 17, 2006 5:50 am**

Hi all, is Robot.txt is important? If so, then how to create it & where it must be placed in the website?
Please guide me.
Thanks,
Alex

[*extra link removed by moderator* only use the signature link in your posts, thanks]

Posted: **Sun May 17, 2009 6:10 pm**

Yes, it is important. Robots.txt tells the SE spider, which pages of your site should be indexed and which web pages should be ignored.