Googlebot

divengrabber · Post by **divengrabber** » Thu Aug 27, 2009 1:50 am

hi

Can u plz explain the googlebot? I have no idea regarding. I saw from many site they use this world, So plz share ur knowledge and give me more idea where i have learn more seo.

Thanks in advance

rayter · Post by **rayter** » Thu Aug 27, 2009 3:00 am

Google bot is the search engine robot of Google. It's the one that crawls the pages of a site.

Dave011 · Post by **Dave011** » Thu Aug 27, 2009 8:15 am

Googlebot is the search bot software used by Google, which collects documents from the web to build a searchable index for the Google search engine.

If a webmaster wishes to restrict the information on their site available to a Googlebot, or another well-behaved spider, they can do so with the appropriate directives in a robots.txt file,[1] or by adding the meta tag <meta name="Googlebot" content="nofollow" /> to the webpage.[1] Googlebot requests to Web servers are identifiable by a user-agent string containing "Googlebot" and a host address containing "googlebot.com".[2]

Currently Googlebot only follows HREF links and SRC links.[1] Googlebot discovers pages by harvesting all of the links on every page it finds. It then follows these links to other web pages. New web pages must be linked to from another known pages on the web in order to be crawled and indexed.

A problem which webmasters have often noted with the Googlebot is that it takes up an enormous amount of bandwidth.[citation needed] This can cause websites to exceed their bandwidth limit and be taken down temporarily. This is especially troublesome for mirror sites which host many gigabytes of data. Google provides "Webmaster Tools" that allow website owners to throttle the crawl rate.[3]

its from http://en.wikipedia.org/wiki/Googlebot

josiahstaggs · Post by **josiahstaggs** » Thu Aug 27, 2009 7:01 pm

A side Note.

If you have content that requires a username and password to see then this means that google's bot won't find those pages. You can give google a username and password to use though. The Documentation for this turns up frequently but i can seem to find it..

Hanratty · Post by **Hanratty** » Fri Sep 04, 2009 5:42 am

Googlebot is the search bot software used by Google, which collects documents from the web to build a searchable index for the Google search engine.

If a webmaster wishes to restrict the information on their site available to a Googlebot, or another well-behaved spider, they can do so with the appropriate directives in a robots.txt file,[1] or by adding the meta tag <meta name="Googlebot" content="nofollow" /> to the webpage.[1] Googlebot requests to Web servers are identifiable by a user-agent string containing "Googlebot" and a host address containing "googlebot.com".

dk4428 · Post by **dk4428** » Fri Sep 04, 2009 10:34 am

How often can I expect googlebot to crawl my site assuming I update it on a regular basis?

KrazyG · Post by **KrazyG** » Thu Sep 10, 2009 10:15 pm

leftybogs wrote:there's wiki about that: http://en.wikipedia.org/wiki/Google_Bot

THis should answer the question...

Thanks for the link leftybogs...

suneelkumar85 · Post by **suneelkumar85** » Sat Sep 12, 2009 1:21 pm

Googlebot is the search bot software used by Google, which collects documents from the web to build a searchable index for the Google search engine.
If a webmaster wishes to restrict the information on their site available to a Googlebot, or another well-behaved spider, they can do so with the appropriate directives in a robots.txt file,[1] or by adding the meta tag <meta name="Googlebot" content="nofollow" /> to the webpage.[1] Googlebot requests to Web servers are identifiable by a user-agent string containing "Googlebot" and a host address containing "googlebot.com".[2]
Currently Googlebot only follows HREF links and SRC links.[1] Googlebot discovers pages by harvesting all of the links on every page it finds. It then follows these links to other web pages. New web pages must be linked to other known pages on the web in order to be crawled and indexed.
---------------------------------------

gary · Post by **gary** » Sun Sep 13, 2009 2:22 am

thanks for that info and tips about googlebot...it helps me a lot with my site...continue posting quality topics for newbies like me...

mrandrei · Post by **mrandrei** » Sun Sep 13, 2009 7:14 pm

Googlebot: Google uses several user-agents to crawl and index content in the Google.com search engine. Googlebot describes all Google spiders. All Google bots begin with "Googlebot"; for example, Googlebot-Mobile: crawls pages for Google’s mobile index; Googlebot-Image: crawls pages for Google’s image index.

Source: http://searchenginewatch.com/define

seo.doc · Post by **seo.doc** » Mon Sep 14, 2009 5:10 am

* Googlebot, a web crawler that finds and fetches web pages.
* The indexer that sorts every word on every page and stores the resulting index of words in a huge database.
* The query processor, which compares your search query to the index and recommends the documents that it considers most relevant.

More to read here: http://www.googleguide.com/google_works.html

markjones123 · Post by **markjones123** » Mon Sep 14, 2009 8:49 pm

Googlebot are spiders and robots that are responsible for crawling and indexing your site.

cecille20 · Post by **cecille20** » Tue Sep 15, 2009 7:24 pm

As far as I know, generating new and quality content is probably the best way to inject some fresh visits from the googlebot.

online-internet-dating-se · Wed Sep 16, 2009 2:08 am

SEO is a strategical mind game between the machine (Google bot) and the human (SEO specialist).

Search Engine Forums, SEO Forum

Googlebot

Googlebot

How often

Who is online