Search Engine Forums, SEO Forum

hi

Can u plz explain the googlebot? I have no idea regarding. I saw from many site they use this world, So plz share ur knowledge and give me more idea where i have learn more seo.

Thanks in advance

Google bot is the search engine robot of Google. It's the one that crawls the pages of a site.

Googlebot is the search bot software used by Google, which collects documents from the web to build a searchable index for the Google search engine.

If a webmaster wishes to restrict the information on their site available to a Googlebot, or another well-behaved spider, they can do so with the appropriate directives in a robots.txt file,[1] or by adding the meta tag <meta name="Googlebot" content="nofollow" /> to the webpage.[1] Googlebot requests to Web servers are identifiable by a user-agent string containing "Googlebot" and a host address containing "googlebot.com".[2]

Currently Googlebot only follows HREF links and SRC links.[1] Googlebot discovers pages by harvesting all of the links on every page it finds. It then follows these links to other web pages. New web pages must be linked to from another known pages on the web in order to be crawled and indexed.

A problem which webmasters have often noted with the Googlebot is that it takes up an enormous amount of bandwidth.[citation needed] This can cause websites to exceed their bandwidth limit and be taken down temporarily. This is especially troublesome for mirror sites which host many gigabytes of data. Google provides "Webmaster Tools" that allow website owners to throttle the crawl rate.[3]

its from http://en.wikipedia.org/wiki/Googlebot

A side Note.

If you have content that requires a username and password to see then this means that google's bot won't find those pages. You can give google a username and password to use though. The Documentation for this turns up frequently but i can seem to find it..

Googlebot is the search bot software used by Google, which collects documents from the web to build a searchable index for the Google search engine.

If a webmaster wishes to restrict the information on their site available to a Googlebot, or another well-behaved spider, they can do so with the appropriate directives in a robots.txt file,[1] or by adding the meta tag <meta name="Googlebot" content="nofollow" /> to the webpage.[1] Googlebot requests to Web servers are identifiable by a user-agent string containing "Googlebot" and a host address containing "googlebot.com".

How often can I expect googlebot to crawl my site assuming I update it on a regular basis?

leftybogs wrote:there's wiki about that: http://en.wikipedia.org/wiki/Google_Bot

THis should answer the question... Thanks for the link leftybogs...

Googlebot is the search bot software used by Google, which collects documents from the web to build a searchable index for the Google search engine.
If a webmaster wishes to restrict the information on their site available to a Googlebot, or another well-behaved spider, they can do so with the appropriate directives in a robots.txt file,[1] or by adding the meta tag <meta name="Googlebot" content="nofollow" /> to the webpage.[1] Googlebot requests to Web servers are identifiable by a user-agent string containing "Googlebot" and a host address containing "googlebot.com".[2]
Currently Googlebot only follows HREF links and SRC links.[1] Googlebot discovers pages by harvesting all of the links on every page it finds. It then follows these links to other web pages. New web pages must be linked to other known pages on the web in order to be crawled and indexed.
---------------------------------------

thanks for that info and tips about googlebot...it helps me a lot with my site...continue posting quality topics for newbies like me...

Googlebot: Google uses several user-agents to crawl and index content in the Google.com search engine. Googlebot describes all Google spiders. All Google bots begin with "Googlebot"; for example, Googlebot-Mobile: crawls pages for Google’s mobile index; Googlebot-Image: crawls pages for Google’s image index.

Source: http://searchenginewatch.com/define

* Googlebot, a web crawler that finds and fetches web pages.
* The indexer that sorts every word on every page and stores the resulting index of words in a huge database.
* The query processor, which compares your search query to the index and recommends the documents that it considers most relevant.

More to read here: http://www.googleguide.com/google_works.html

Googlebot are spiders and robots that are responsible for crawling and indexing your site.

As far as I know, generating new and quality content is probably the best way to inject some fresh visits from the googlebot.

SEO is a strategical mind game between the machine (Google bot) and the human (SEO specialist).