Page 1 of 1

Re: Difference between crawling, index and caching

Posted: Mon Aug 13, 2012 2:35 am
by gapinfotech
Automated website crawlers are powerful tools to help crawl and index content on the web. As a webmaster, you may wish to guide them towards your useful content and away from irrelevant content. The methods described in these documents are the de-facto web-wide standards to control crawling and indexing of web-based content. They consist of the robots.txt file to control crawling, as well as the robots meta tag and X-Robots-Tag HTTP header element to control indexing. The robots.txt standard predates Google and is the accepted method of controlling crawling of a website.

Re: Difference between crawling, index and caching

Posted: Wed Aug 29, 2012 11:57 pm
by juanbeach
Crawling is where search engines spiders / bots move from web page to web page by following the links on the pages. The pages "found" are then ranked using an algorithm and indexed into the search engine database.

Indexing is where search engine has crawled the web and ranks the URLs found using various criteria and places them in the database, or index.

Caching is where copies of web pages stored locally on an Internet user's hard drive or within a search engine's database.

Re: Difference between crawling, index and caching

Posted: Sat Sep 01, 2012 6:13 am
by rickeymartin55
Hay as juanbeach said its is correct..

Re: Difference between crawling, index and caching

Posted: Sat Sep 01, 2012 6:48 am
by rachelsjohnas
Google bot crawls the absolute web pages to locate new and aces content. The appointment to your site, in this attention is alleged CRAWL.

What it picks up from your website during this CRAWL is stored on its server, aloft if your website is alleged CACHED - which shows a date if Googlebot endure crawled and best up this content.

Finally this CACHED agreeable is larboard for Google Indexer to basis that webpage on it's seek result, according to its content, pagerank, area age, backlinks, etc.

Re: Difference between crawling, index and caching

Posted: Tue Sep 04, 2012 2:48 am
by esparkinfo
Hello,

Crawling- Google sends its spiders to your website..
Indexing- Google visited your website and has added you to its database..

Caching- Google toook a snapshot of your website when it last visited and stored the data in case your website went down or if there are some any other issues.

Thanks,
eSparkInfo

Re: Difference between crawling, index and caching

Posted: Thu Sep 13, 2012 12:11 am
by kevin619
When search engine find any meaningful information on any page of our site , then it crawled our page. And when stored it temporarily to show the people then it called cached. And when this information searched by many people ,and find it useful then google stored it permanently this is called indexed.

Re: Difference between crawling, index and caching

Posted: Fri Sep 28, 2012 6:48 am
by markwillson400
Crawling: When the google's robot visit on a particular site then it's called crawling.
Indexing: Fetching data after crawling is called indexing.
Cashing: Taking snapshot of the website by the google is called cashing.

Re: Difference between crawling, index and caching

Posted: Thu Oct 04, 2012 12:36 am
by gapinfotech
caching and index is the same part Crawling is the process performed by search engine crawler, when searching for relevant websites on the index

Re: Difference between crawling, index and caching

Posted: Sun Oct 07, 2012 7:35 pm
by IssacCummings
Caching is where copies of web pages stored locally on an Internet user's hard drive or within a search engine's database.