Google Answers Logo
View Question
Q: Spidering ( No Answer,   1 Comment )
Subject: Spidering
Category: Computers > Algorithms
Asked by: gigabit-ga
List Price: $25.00
Posted: 03 Nov 2005 12:25 PST
Expires: 03 Dec 2005 12:25 PST
Question ID: 588529
How do spiders work?  Also what and how can you scrape data using
spiders?  Are theses two programs a good example of what spiders can
do? &

If you write a tutorial that could teach a child to use this
technology a tip of $25 will be included.
There is no answer at this time.

Subject: Re: Spidering
From: larkas-ga on 15 Nov 2005 23:34 PST
Check out this Wikipedia entry:

Spiders are often used for mirroring, indexing, and automated web site
maintainence (i.e. checking for broken links).

Scraping is something different. Much of time when scraping data it is
not necessary to traverse all te links pages to get the data you want
to scrape.

Important Disclaimer: Answers and comments provided on Google Answers are general information, and are not intended to substitute for informed professional medical, psychiatric, psychological, tax, legal, investment, accounting, or other professional advice. Google does not endorse, and expressly disclaims liability for any product, manufacturer, distributor, service or service provider mentioned or any opinion expressed in answers or comments. Please read carefully the Google Answers Terms of Service.

If you feel that you have found inappropriate content, please let us know by emailing us at with the question ID listed above. Thank you.
Search Google Answers for
Google Answers  

Google Home - Answers FAQ - Terms of Service - Privacy Policy