How many types of crawlers are there?

jesicawillss · Post by **jesicawillss** » Fri Dec 03, 2010 2:45 am

I heard that there are different types of crawlers to crawls videos, web pages etc. Is it true?
I want to know that how many types of crawlers are there.

karynmonk · Post by **karynmonk** » Sat Dec 04, 2010 5:00 am

Different search engine crawler has a different name.
Google crawler name is the name of Googlebot, Yahoo is slurb robot etc. ..

aqzseo · Post by **aqzseo** » Mon Dec 06, 2010 3:20 am

i think 3 types crawlers are there

Seo Company

jesicawillss · Post by **jesicawillss** » Thu Dec 23, 2010 4:55 am

aqzseo wrote:i think 3 types crawlers are there

Seo Company

Can you please name that?

jonnyhardbaked · Post by **jonnyhardbaked** » Mon Apr 04, 2011 2:44 pm

Yep, there are many different kinds of crawlers. If you want to know them, you can search them in Google.

VladTepes · Post by **VladTepes** » Mon Apr 04, 2011 11:54 pm

There are probably thousands of them doing specific crawling tasks on parts of a site. Better not to think about them but follow search engine guidelines on ranking and how to present pages effectively..

Amber21 · Post by **Amber21** » Fri Apr 08, 2011 10:00 pm

There is just one crawler. There are only other names called for it like spider.

ujju · Post by **ujju** » Mon Aug 01, 2011 3:40 am

very confusing.
Is there any types?? please tell me.

Van hire Edmonton

lizatailor23 · Post by **lizatailor23** » Tue Aug 02, 2011 4:14 am

I have heard this first time. I am also wanted to know this.

thenyclinic · Post by **thenyclinic** » Tue Aug 02, 2011 11:22 pm

Each Search Engine has its own crawler:

Google -- Googlebot
Yahoo -- Yahoo Slurp
MSN -- MSNbot
Ask -- Teoma
AltaVista -- Scooter
Excite -- Architect spider
Inktomi.com -- Slurp
Alexa -- ia_archiver
Look smart -- Mantra Agent
Lycus -- Lycos_Spider_ (T-Rex)
Cuil -- Twiceler.

madhusmita · Post by **madhusmita** » Wed Aug 03, 2011 3:33 am

The search engine use the crawlers to crawl the sites.The name is different for different sites.But the sites is not using different crawlers for the different objects of the site.

Ken Peterson · Post by **Ken Peterson** » Mon Oct 17, 2011 4:49 am

thenyclinic wrote:Each Search Engine has its own crawler:

Google -- Googlebot
Yahoo -- Yahoo Slurp
MSN -- MSNbot
Ask -- Teoma
AltaVista -- Scooter
Excite -- Architect spider
Inktomi.com -- Slurp
Alexa -- ia_archiver
Look smart -- Mantra Agent
Lycus -- Lycos_Spider_ (T-Rex)
Cuil -- Twiceler.

Nice post ,thanks for sharing .

wlcindia · Post by **wlcindia** » Wed Oct 19, 2011 1:41 am

Every Search have its own crawler, Like Google have Google Bot, MSN have msnbot, yahoo habe slurp etc.

perfectionnk · Post by **perfectionnk** » Sat Oct 22, 2011 4:55 am

Thousands of search engine are there and there have own clowler, you can easily find on net various search engine crawlers like Google -- Googlebot, Yahoo -- Yahoo Slurp, MSN -- MSNbot, Ask -- Teoma, AltaVista -- Scooter, Excite -- Architect spider.

arunjha · Post by **arunjha** » Thu Oct 27, 2011 8:56 pm

I think every search engine have only one types of crawlers who is crawl everything for search engine.

Search Engine Forums, SEO Forum

How many types of crawlers are there?

How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Re: How many types of crawlers are there?

Who is online