Difference between crawling, index and caching

For discussion of general Search Engine Optimization, not specific to any engine.
Post Reply
gapinfotech
Posts: 145
Joined: Mon Jun 25, 2012 1:25 am
Contact:

Re: Difference between crawling, index and caching

Post by gapinfotech »

Automated website crawlers are powerful tools to help crawl and index content on the web. As a webmaster, you may wish to guide them towards your useful content and away from irrelevant content. The methods described in these documents are the de-facto web-wide standards to control crawling and indexing of web-based content. They consist of the robots.txt file to control crawling, as well as the robots meta tag and X-Robots-Tag HTTP header element to control indexing. The robots.txt standard predates Google and is the accepted method of controlling crawling of a website.

juanbeach
Posts: 23
Joined: Tue Jul 31, 2012 4:27 am
Contact:

Re: Difference between crawling, index and caching

Post by juanbeach »

Crawling is where search engines spiders / bots move from web page to web page by following the links on the pages. The pages "found" are then ranked using an algorithm and indexed into the search engine database.

Indexing is where search engine has crawled the web and ranks the URLs found using various criteria and places them in the database, or index.

Caching is where copies of web pages stored locally on an Internet user's hard drive or within a search engine's database.

rickeymartin55
Posts: 2
Joined: Sat Sep 01, 2012 5:57 am
Contact:

Re: Difference between crawling, index and caching

Post by rickeymartin55 »

Hay as juanbeach said its is correct..

rachelsjohnas
Posts: 30
Joined: Wed Aug 29, 2012 5:48 am
Contact:

Re: Difference between crawling, index and caching

Post by rachelsjohnas »

Google bot crawls the absolute web pages to locate new and aces content. The appointment to your site, in this attention is alleged CRAWL.

What it picks up from your website during this CRAWL is stored on its server, aloft if your website is alleged CACHED - which shows a date if Googlebot endure crawled and best up this content.

Finally this CACHED agreeable is larboard for Google Indexer to basis that webpage on it's seek result, according to its content, pagerank, area age, backlinks, etc.

esparkinfo
Posts: 6
Joined: Wed Aug 15, 2012 11:16 pm
Location: New York, USA
Contact:

Re: Difference between crawling, index and caching

Post by esparkinfo »

Hello,

Crawling- Google sends its spiders to your website..
Indexing- Google visited your website and has added you to its database..

Caching- Google toook a snapshot of your website when it last visited and stored the data in case your website went down or if there are some any other issues.

Thanks,
eSparkInfo
For our Website Development Portfolio visit : https://www.esparkinfo.com/portfolios.html

kevin619
Posts: 6
Joined: Tue Apr 10, 2012 12:19 am
Location: California
Contact:

Re: Difference between crawling, index and caching

Post by kevin619 »

When search engine find any meaningful information on any page of our site , then it crawled our page. And when stored it temporarily to show the people then it called cached. And when this information searched by many people ,and find it useful then google stored it permanently this is called indexed.

markwillson400
Posts: 1
Joined: Fri Sep 28, 2012 6:39 am
Contact:

Re: Difference between crawling, index and caching

Post by markwillson400 »

Crawling: When the google's robot visit on a particular site then it's called crawling.
Indexing: Fetching data after crawling is called indexing.
Cashing: Taking snapshot of the website by the google is called cashing.

gapinfotech
Posts: 145
Joined: Mon Jun 25, 2012 1:25 am
Contact:

Re: Difference between crawling, index and caching

Post by gapinfotech »

caching and index is the same part Crawling is the process performed by search engine crawler, when searching for relevant websites on the index

IssacCummings
Posts: 2
Joined: Sat Oct 06, 2012 11:08 pm
Location: http://www.easydvdmart.com/
Contact:

Re: Difference between crawling, index and caching

Post by IssacCummings »

Caching is where copies of web pages stored locally on an Internet user's hard drive or within a search engine's database.
New Star Rising for TV shows ---criminal minds season 7 dvd,Seize the present, Seize it!

Post Reply

Who is online

Users browsing this forum: Google [Bot] and 56 guests