Google Answers Logo
View Question
 
Q: Search Enginers ( No Answer,   3 Comments )
Question  
Subject: Search Enginers
Category: Computers
Asked by: gxzech-ga
List Price: $5.00
Posted: 16 May 2003 09:13 PDT
Expires: 15 Jun 2003 09:13 PDT
Question ID: 204635
I want to search a couple hundred specific sites for certain keywords.
 Is there any way of putting these sites into a text file and being
able to conduct a keyword search only on these specific sites (the
entire domain not just the page)?
Answer  
There is no answer at this time.

Comments  
Subject: Re: Search Enginers
From: secret901-ga on 16 May 2003 09:28 PDT
 
Hi gxzech,
It is possible to search Google by creating a program that utilizes the Google API.

secret901-ga
Subject: Re: Search Enginers
From: ntd-ga on 17 May 2003 13:21 PDT
 
1. Download and unzip http://unxutils.sourceforge.net/UnxUtils.zip and
Wgetgui from http://www.jensroesner.de/wgetgui/#download.
2. Unzip both files.
3. Move the contents of wgetgui.zip to UnxUtils\usr\local\wbin
(assuming you unzipped into a folder named UnxUtils)
4. Open wgetgui.exe in UnxUtils\usr\local\wbin.
5. Check the box labeled Mirror Site, and the one labeled "Save to
custom dir:"  In the space under "Save to custom dir:" type c:\mirror,
or any other place you'd like the files to be saved.
6. Begin adding the site addresses to URL by typing them or pasting
them in and then double clicking.
7. After entering all of the sites in, click "Add to wGetStart.bat",
and the "Start wGetStart.bat" to begin mirroring the files
8. After the download (it will probably take a VERY long time), open
up a DOS window, then go into the UnxUtils\usr\local\wbin folder.
9. Type grep -r textyouarelookingfor c:\mirror > results
10. After that, which may take a while as well (but not nearly as long
as mirroring), type sort -r results
Subject: Re: Search Enginers
From: zorgster-ga on 17 May 2003 13:43 PDT
 
The licence on the Google API restricts searches/day to 1000.  A
search can only be done on one site at a time using the API. 
Therefore to search a hundred or so sites each time would restrict you
to less than 10 searches before the limit is reached.  Unless your get
a commercial licence.

Web-based Google is the same, one site per site-specific search.

Lycos' advanced search allows more than one site to be searched in any
search.  I just searched on "www.microsoft.com, www.novell.com,
www.sun.com". However you cannot export the search results to a text
file...

I looked at some of the Coppernic products, ie Coppernic Agent
Personal.  You can filter the results by domain, keywords etc.  You
can save the search and export the results.  It costs ~$30 to
download.  Unfortunately the free Agent Basic does not allow filtering
by domain.

Important Disclaimer: Answers and comments provided on Google Answers are general information, and are not intended to substitute for informed professional medical, psychiatric, psychological, tax, legal, investment, accounting, or other professional advice. Google does not endorse, and expressly disclaims liability for any product, manufacturer, distributor, service or service provider mentioned or any opinion expressed in answers or comments. Please read carefully the Google Answers Terms of Service.

If you feel that you have found inappropriate content, please let us know by emailing us at answers-support@google.com with the question ID listed above. Thank you.
Search Google Answers for
Google Answers  


Google Home - Answers FAQ - Terms of Service - Privacy Policy