Google Answers Logo
View Question
 
Q: internet search engines - how to search just a bunch of specific websites ( No Answer,   4 Comments )
Question  
Subject: internet search engines - how to search just a bunch of specific websites
Category: Computers > Internet
Asked by: onetwothreefour-ga
List Price: $20.00
Posted: 11 Oct 2002 14:38 PDT
Expires: 30 Oct 2002 15:12 PST
Question ID: 75442
**please only answer if you are four or five star rated ****
***do not answer if your rating is lower than that thanks***
The fee is for part 1, answer to part 2 is only required if part 1
answer is not possible
Part 1
Is it possible to use a standard search engine like google to set up
a search page wiht a google search box that allows a user to say
search 100 websites that i specify in a list
Ideally i'd like to set up an html page that allows users to use tick
boxes to say which websites of a list that i provide , that they want
to search for their query
By way of experiment, I have tried to do a simple mulitple domain
search using google advanced search advice on google itself with just
a couple of domains at a time but that doesn't seem to work for me -
although the single domain one works ok ie

query site:www.domainname.com

Perhaps one of the other google offerings will do what i want ?

Part 2
Or if none of this will work then i want to have something properly
set up by a software person - in which case , what would they need ?
what sort of budget cost ? Is there anything special that would be
required on the websites being searched
Am I asking how to set up a mini-search engine of my own effectively ?

Request for Question Clarification by larre-ga on 11 Oct 2002 17:07 PDT
While Google search results aren't available as meta search data for
commercial usage, they do offer search solutions and developer tools
that might be able to be tailored to your requirements. Have you
already considered (and/or discarded as an option) Google Free Search?

=l=

Clarification of Question by onetwothreefour-ga on 12 Oct 2002 02:48 PDT
I began to look at the google free search but ran ut of time and not
sure if it can handle all i need to do - this is part of my question -
what do you think ?
Answer  
There is no answer at this time.

The following answer was rejected by the asker (they received a refund for the question).
Subject: Re: internet search engines - how to search just a bunch of specific websites
Answered By: xemion-ga on 12 Oct 2002 09:13 PDT
 
AllTheWeb Advanced Search has the capability you're looking for.  It
has the same "domain search" feature that Google has, however, Google
limits your query to 10 words total (allowing you to filter by 9
domains, maximum).  AllTheWeb's domain search feature, on the other
hand, allows up to 1024 characters total.  Unless you have small
domain names, you won't fit a 100 domains in that field.  However, I
did test it with the 79 of PCMagazine's Top 100 Classic's list (
http://www.pcmag.com/article2/0,4149,7500,00.asp ).

The Advanced Search page is at:
http://www.alltheweb.com/advanced

The domain filter is about halfway down the page.

I inputed the top 100 domains:
bigstep.com bloomberg.com schwab.com citibankonline.com
moneycentral.msn.com datek.com irs.gov djinteractive.com
hooversonline.com fool.com oraclesmallbusiness.com quicken.com
salesforce.com smartmoney.com thestreet.com earthweb.com elite.com
eroom.net expertcity.com extremetech.com grc.com homestead.com
hotmail.com palmgear.com pcmag.com register.com slashdot.org
antivirus.com vindigo.com webex.com webmonkey.com groups.yahoo.com
dice.com guru.com hotjobs.com monster.com about.com aol.com bbc.com
britannica.com encarta.msn.com fedstats.gov google.com
howstuffworks.com ivillage.com loc.gov medscape.com msn.com nolo.com
northernlight.com techencyclopedia.com techreview.com house.gov
senate.gov webmd.com webopedia.com whitehouse.gov yahoo.com amazon.com
andale.com carsdirect.com cooking.com dealtime.com dell.com ebay.com
epinions.com ethnicgrocer.com landsend.com paypal.com frommers.com
expedia.com fodors.com iexplore.com lonelyplanet.com orbitz.com
smarterliving.com travelocity.com avantgo.com cnn.com eonline.com
espn.com imdb.com mightybigtv.com nytimes.com salon.com shutterfly.com
slate.msn.com foodtv.com citysearch.com kids.discovery.com disney.com
ehow.com embark.com epicurious.com nationalgeographic.com nces.ed.gov
nick.com si.edu zagat.com gamespot.com

It only allowedme  to input up to cnn.com, cutting the list off
halfway through eonline.com  I'm inclosing the list in the answer so
you can easily test the search page for yourself.

I hope this helps you.  Thanks for the question!

xemion-ga

Request for Answer Clarification by onetwothreefour-ga on 15 Oct 2002 09:22 PDT
Are you saying i have to paste in the list to the small box that says
"only include"  on the domain filter section.
If so I guess this works but this is not really a satisfactory answer
for my purposes as I need to be able to set up a search page that is
easy for users to use and can tick radio type boxes for which sites
they want to include
Does alltheweb allow me to write a page that uses their websearch in
this way ?
I want something a bit more commercially usable - a paid for service
would be fine but it needs to be usable by novices and not a
workaround of the advanced search features page of a search engine -
unless that can be legitimately worked up into a user friendly page on
my site

Request for Answer Clarification by onetwothreefour-ga on 16 Oct 2002 16:11 PDT
am just nudging the google answers site by re-requesting answer
clarification in case you did not get an email on this - i don't get
why my account says "needs attention" for this question when i am
awaiting a clarifcation

anyway i am just seeing if this changes the onscreen status for me
and/or emails the researcher on this

Clarification of Answer by xemion-ga on 16 Oct 2002 17:17 PDT
I apologize, I should have responded to your request right away.  I've
been looking for something that suits your needs and haven't found
anything yet.  I'll keep looking and get back to you.
The question will say "Needs Attention" until you rate it or request a
refund or repost.  At this time, we're still in the clarification
phrase of the question and you should not do either of those things
until I'm fully finished answering.  Thanks.

xemion-ga

Request for Answer Clarification by onetwothreefour-ga on 17 Oct 2002 02:55 PDT
ok fine i will wait if you can get a really good answer would be great
timewise, i need something in the next 24-48 hours really 

btw google answers used to have a thing where you select the expiry
date of the question but i don't see it anymore when i post new
questions
have they cut that out ?

Clarification of Answer by xemion-ga on 17 Oct 2002 09:32 PDT
Ok, I was unable to find anything.  I'm sorry my answer hasn't met
your needs.  I thought it was a perfect match.  I apologize.  Please
feel free to repost or refund the question.
Yes, the expiration date choice was removed.  All questions now have a
month as their expiration date.  Thanks.

xemion-ga

Request for Answer Clarification by onetwothreefour-ga on 27 Oct 2002 15:40 PST
i have asked for a refund . thanks for trying anyway
Reason this answer was rejected by onetwothreefour-ga:
see my comments in question and Clarification of Answer by xemion-ga
on 17 Oct 2002 09:32 PDT which says:
"Ok, I was unable to find anything.  I'm sorry my answer hasn't met
your needs.  I thought it was a perfect match.  I apologize.  Please
feel free to repost or refund the question."

Comments  
Subject: Re: internet search engines - how to search just a bunch of specific websites
From: hailstorm-ga on 11 Oct 2002 16:43 PDT
 
What you are trying to do is set up a "meta-search" site, a search
engine of search engines. There are many of these available (Dogpile
at http://www.dogpile.com being the one I am most familiar with),
though I am not sure of what percentage of them allow you to choose
the search engines to be searched.

If you are going to do this, you will have to check the terms of
service of each individual search engine site you intend to list to
see if you are allowed to do this. For example, from the Google Terms
of Service document:

"The Google Search Services are made available for your personal,
non-commercial use only. You may not use the Google Search Services to
sell a product or service, or to increase traffic to your Web site for
commercial reasons, such as advertising sales. You may not take the
results from a Google search and reformat and display them, or mirror
the Google home page or results pages on your Web site. You may not
"meta-search" Google. If you want to make commercial use of the Google
Search Services, you must enter into an agreement with Google to do so
in advance. Please contact us for more information.

Google Terms of Services:
://www.google.com/terms_of_service.html

Sample Dogpile Search:
http://search.dogpile.com/texis/search?q=Google&fs=web&geo=no&method=0
Subject: Re: internet search engines - how to search just a bunch of specific websites
From: ajisp-ga on 11 Oct 2002 23:26 PDT
 
Part-2:

we can setup a website based search Engine for you which will need two
inputs
A) a list of domain names to search with in and 
B) the list of keywords to search for 
if the req. is  only this to cost will be USD200
but if to setup for multiple user based a/c and with more features
added we can quote you seperatly
Subject: Re: internet search engines - how to search just a bunch of specific websites
From: onetwothreefour-ga on 12 Oct 2002 02:46 PDT
 
Dear  ajisp-ga 
please tell me more about your methods and your services - and your
website address if that is allowed by google rules ?
do you have an existing demo ?
do you use elance for projects ?
Subject: Re: internet search engines - how to search just a bunch of specific websites
From: onetwothreefour-ga on 12 Oct 2002 02:55 PDT
 
Dear hailstorm-ga 
No dogpile is not what i am after - this searches other search
engines.
I want to search (with a single engine) several specific websites.

Actually i think freefind does what i need - i am investigating this
but leaving the question open for better solutions .

Thanks for your points re use of google data - as this was something i
was considering doing but realise now that i can not.

Important Disclaimer: Answers and comments provided on Google Answers are general information, and are not intended to substitute for informed professional medical, psychiatric, psychological, tax, legal, investment, accounting, or other professional advice. Google does not endorse, and expressly disclaims liability for any product, manufacturer, distributor, service or service provider mentioned or any opinion expressed in answers or comments. Please read carefully the Google Answers Terms of Service.

If you feel that you have found inappropriate content, please let us know by emailing us at answers-support@google.com with the question ID listed above. Thank you.
Search Google Answers for
Google Answers  


Google Home - Answers FAQ - Terms of Service - Privacy Policy