Page 1 of 1
Posted: Sun Jul 30, 2006 3:36 am
I have put my forum into manual search engine. I have google bots come up on my forum and msn etc... can anyone tell me anything more about this?
Posted: Mon Jul 31, 2006 3:10 am
Hi mate, I'm not sure if I understand your question. Do you wanna know what the bots are and why they spider your site?
Posted: Mon Jul 31, 2006 5:49 am
Yeah, what does your question ask? Are you asking why the bots are there?
Posted: Tue Aug 15, 2006 6:57 am
It tells you congratulation
your site has been indexed by G.. M.. !!!
If you do not welcome these bots then
you may add a robots.txt with disallow function.
Posted: Tue Aug 15, 2006 8:06 am
Ok, i understand whats going on now. Im going to agree with link.ezer.com about this one and just put in the robots.txt file to disallows or allow the bots depending on what you want to be done!