Webmaster World using disallow in robots.txt?
Posted: Wed Nov 30, 2005 8:38 am
Did anyone else see this?
I was wondering why they started promoting and moving things to searchengineworld recently. Nasty bots! They must have been planning it, my guess is he got advice down at PubCon and made the decision to let WMW stand on its own popularity and brand recognition based on that advice and prior research. It should not hurt too much because of the traffic they get from links on other websites, and the many SERP's pages they already hold positions for. By the time all their WMW positions are gone in the SERP they can have a lot of ground covered on the searchengineworld site promotion and ranking in the SE's.
Anyone seeing a bot called "crawl 3 . exabot" in their logs?
This little guy eats up server resources daily and has been seen more and more popping its little head.
Read the whole Webmaster World, Brett Tabke Interview here: http://www.searchengineguide.com/search ... 06254.html
I was wondering why they started promoting and moving things to searchengineworld recently. Nasty bots! They must have been planning it, my guess is he got advice down at PubCon and made the decision to let WMW stand on its own popularity and brand recognition based on that advice and prior research. It should not hurt too much because of the traffic they get from links on other websites, and the many SERP's pages they already hold positions for. By the time all their WMW positions are gone in the SERP they can have a lot of ground covered on the searchengineworld site promotion and ranking in the SE's.
Anyone seeing a bot called "crawl 3 . exabot" in their logs?
This little guy eats up server resources daily and has been seen more and more popping its little head.
Read the whole Webmaster World, Brett Tabke Interview here: http://www.searchengineguide.com/search ... 06254.html