What is a Web crawler and how does it work?

For discussion of general Search Engine Optimization, not specific to any engine.
Post Reply
ritesh3592
Posts: 446
Joined: Wed Jul 31, 2019 3:42 am
Contact:

Re: What is a Web crawler and how does it work?

Post by ritesh3592 »

A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "spider" or a "bot."

vijayshah1140
Posts: 80
Joined: Thu Jul 18, 2019 2:32 am
Contact:

Re: What is a Web crawler and how does it work?

Post by vijayshah1140 »

A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index.

Post Reply

Who is online

Users browsing this forum: No registered users and 16 guests