Robot.txt

[alex_us]

Hi all, is Robot.txt is important? If so, then how to create it & where it must be placed in the website?
Please guide me.
Thanks,
Alex

[*extra link removed by moderator* only use the signature link in your posts, thanks]

[rayter]

Yes, it is important. Robots.txt tells the SE spider, which pages of your site should be indexed and which web pages should be ignored.