Page 1 of 1
How many types of crawlers are there?
Posted: Fri Dec 03, 2010 2:45 am
by jesicawillss
I heard that there are different types of crawlers to crawls videos, web pages etc. Is it true?
I want to know that how many types of crawlers are there.
Re: How many types of crawlers are there?
Posted: Sat Dec 04, 2010 5:00 am
by karynmonk
Different search engine crawler has a different name.
Google crawler name is the name of Googlebot, Yahoo is slurb robot etc. ..
Re: How many types of crawlers are there?
Posted: Mon Dec 06, 2010 3:20 am
by aqzseo
i think 3 types crawlers are there
Seo Company
Re: How many types of crawlers are there?
Posted: Thu Dec 23, 2010 4:55 am
by jesicawillss
aqzseo wrote:i think 3 types crawlers are there
Seo Company
Can you please name that?
Re: How many types of crawlers are there?
Posted: Mon Apr 04, 2011 2:44 pm
by jonnyhardbaked
Yep, there are many different kinds of crawlers. If you want to know them, you can search them in Google.
Re: How many types of crawlers are there?
Posted: Mon Apr 04, 2011 11:54 pm
by VladTepes
There are probably thousands of them doing specific crawling tasks on parts of a site. Better not to think about them but follow search engine guidelines on ranking and how to present pages effectively..
Re: How many types of crawlers are there?
Posted: Fri Apr 08, 2011 10:00 pm
by Amber21
There is just one crawler. There are only other names called for it like spider.
Re: How many types of crawlers are there?
Posted: Mon Aug 01, 2011 3:40 am
by ujju
very confusing.
Is there any types?? please tell me.
Van hire Edmonton
Re: How many types of crawlers are there?
Posted: Tue Aug 02, 2011 4:14 am
by lizatailor23
I have heard this first time. I am also wanted to know this.
Re: How many types of crawlers are there?
Posted: Tue Aug 02, 2011 11:22 pm
by thenyclinic
Each Search Engine has its own crawler:
Google -- Googlebot
Yahoo -- Yahoo Slurp
MSN -- MSNbot
Ask -- Teoma
AltaVista -- Scooter
Excite -- Architect spider
Inktomi.com -- Slurp
Alexa -- ia_archiver
Look smart -- Mantra Agent
Lycus -- Lycos_Spider_ (T-Rex)
Cuil -- Twiceler.
Re: How many types of crawlers are there?
Posted: Wed Aug 03, 2011 3:33 am
by madhusmita
The search engine use the crawlers to crawl the sites.The name is different for different sites.But the sites is not using different crawlers for the different objects of the site.
Re: How many types of crawlers are there?
Posted: Mon Oct 17, 2011 4:49 am
by Ken Peterson
thenyclinic wrote:Each Search Engine has its own crawler:
Google -- Googlebot
Yahoo -- Yahoo Slurp
MSN -- MSNbot
Ask -- Teoma
AltaVista -- Scooter
Excite -- Architect spider
Inktomi.com -- Slurp
Alexa -- ia_archiver
Look smart -- Mantra Agent
Lycus -- Lycos_Spider_ (T-Rex)
Cuil -- Twiceler.
Nice post ,thanks for sharing .
Re: How many types of crawlers are there?
Posted: Wed Oct 19, 2011 1:41 am
by wlcindia
Every Search have its own crawler, Like Google have Google Bot, MSN have msnbot, yahoo habe slurp etc.
Re: How many types of crawlers are there?
Posted: Sat Oct 22, 2011 4:55 am
by perfectionnk
Thousands of search engine are there and there have own clowler, you can easily find on net various search engine crawlers like Google -- Googlebot, Yahoo -- Yahoo Slurp, MSN -- MSNbot, Ask -- Teoma, AltaVista -- Scooter, Excite -- Architect spider.
Re: How many types of crawlers are there?
Posted: Thu Oct 27, 2011 8:56 pm
by arunjha
I think every search engine have only one types of crawlers who is crawl everything for search engine.