Google Answers Logo
View Question
 
Q: Google Search - Creating a file of URL links ( No Answer,   1 Comment )
Question  
Subject: Google Search - Creating a file of URL links
Category: Computers > Internet
Asked by: beckyp-ga
List Price: $2.00
Posted: 15 Jun 2003 23:24 PDT
Expires: 18 Jun 2003 23:27 PDT
Question ID: 217808
Sometimes, I'll conduct a search and get hundreds or thousands of
links to the actual information that I am seeking.

I would like to check out each link ... but often run out of time.  I
would like to be able to run a search, load it into a file, then
search the links at a more leisurely pace.  That way I can avoid
searching a link multiple times.  Also, I may encounter a link that
has been placed lower on the google "scale" but meets my needs.

Is there any way to *easily* create a file of the resulting [google
search] links into Excel, Access or Word or other software?  I'm
trying to find a way to avoid cutting and pasting each page into a
file or printing out each page.

Becky

PS  I've been doing "research" from the early days of Lexus/Nexus ...
so I feel comfortable wording my searches.  However, sometimes I want
to broaden my search ... and I can't handle it in a day or so.

Request for Question Clarification by justaskscott-ga on 16 Jun 2003 22:33 PDT
Perhaps another Researcher will have an easy solution along the lines
you have described.  In the meantime, I'll ask: Have you thought of
bookmarking the searches you don't have time to look at now?  That's
what I do, and it seems to be an easy solution.  The results may
change somewhat by the time I look at them -- but then again, the
original results were already different than they were at some earlier
time.  The results are generally useful at any given time.  (I can
recall only one time where a link I was interested in disappeared when
I examined the results later.)  So I see little downside in just
bookmarking the search.

Clarification of Question by beckyp-ga on 17 Jun 2003 00:30 PDT
I haven't tried it before ... so how do I bookmark my search?

Does that give me access to my entire search, at a specific point in
time?  Or do I have to bookmark (possibly hundreds or thousands) of
links, one-by-one?

Please keep in mind ... I'm just trying to conduct a search, save the
related links, then, search them one-by-one at a slower pace.   Yes, I
know that I might miss links that are added in the future.

Any and all thoughts are greatly appreciated.

Becky

Request for Question Clarification by mcfly-ga on 17 Jun 2003 02:49 PDT
Hi Becky,

Bookmarking your search results will save the URL of the results page,
so when you recall the bookmark, the search will effectively be
performed again automatically.  This means the results may not be
identical on every recall, but they will include newly listed sites.

To bookmark a page in Internet Explorer, just perform your search and
click Favourites > Add to Favourite.

There are ways to use a program to filter the results using a
scripting language such as Perl, but my knowledge does not stretch to
this.  Other researchers may be able to help you however.

Kind regards,

mcfly-ga

Request for Question Clarification by justaskscott-ga on 17 Jun 2003 11:19 PDT
I think that mcfly-ga has explained it well.

Incidentally, to bookmark the search results on Netscape, click
Bookmarks > Add Bookmark.

If the bookmarking idea meets your needs, may I post it as an answer?

Clarification of Question by beckyp-ga on 17 Jun 2003 16:06 PDT
Scot,

Sorry, bookmarking doesn't meet my needs since the results will change
every time I log on.  I'm trying to find a way to save the results,
one time, so that I can tick them off as I check them out. Actually,
read2live's 100 results per page / C&P solution produces a better
result for me.

Thanks anyway.

Becky
Answer  
There is no answer at this time.

Comments  
Subject: Re: Google Search - Creating a file of URL links
From: read2live-ga on 17 Jun 2003 06:54 PDT
 
Hi, Becky,

Some good news and some bad news, and two pieces of what may be
goodish news for you.  The good news is that there is software called
Googlis, available at <http://www.googlis.com/>, which claims " People
use Googlis for market research, making reports from search results in
a specific web sector or for 'power searching'. Googlis has two
strengths - it can do multiple searches but show this as one set of
results (this can get rid of the cancelling effects of word order and
alternate spellings) - and secondly it can export these search results
to CSV format (which means you can use Microsft Excel or Access to
produce reports, graphs, etc)."

That sounds as if it is just what you want.  The free/ unregistered
version is limited to 15 exports at one time: registration costs
$20.00 and gives you unlimited export ability.

The bad news: Googlis appears to be unavailable: click on the download
link and you get a "The page cannot be found" message.  I found
several software download sites which have Googlis listed - but they
all (so far) send you back to Googlis itself and that cannot find page
message.

The dates given are fairly recent, and it could be that the download
page is temporarily unavailable and will be reposted soon.  If the
software has been withdrawn, why remove just the download page (I ask
myself), why not remove the whole site?  So there may be hope there.

The goodish news (1): an intermediate solution for you.  Have you
thought about setting your preferences to 100 (click on Preferences on
Google search or results screen, scroll down to the number of results
dialog, click on the triangle and click on 100).  Now when you do a
Google search, just use File >> Save As  (or File >> Save Page As,
depending on what browser you are using - and there may be other
variations on that as well.  Once you have saved the results page, go
to the next 100 results and so on, until you reach the end of Google's
results listings.

Now that may sound like a lot of saved searches - but in fact there
will be only 8 or 9 files per search.  That is because Google posts
only the top 860 or so hits, regardless of how many million results it
found.

Now you can go back when you want to, open those html saved searches
in your browser, analyse as you will.  It's not a csv/ excel file, but
you did say it does not have to be excel, access or word.

Goodish news (2):  if you are into Perl, then Google Hack #44
"Scraping Google Results: Scraping the results of a Google search into
a comma-delimited file" might work for you. I say "might", because
there is some discussion on the page, it doesn't work for everyone and
there may be misprints in the coding.  You will find the hack at
<http://hacks.oreilly.com/pub/h/164>

I cannot post this as an answer because my first suggestion does not
meet all your requirements, and the second suggestion, the hack, may
not work (but keep checking the hacks page, someone may come up with a
solution).  Or the Googlis download may be available again.  So if you
are happy with any of these approaches, then feel free to say so and I
will post this as an answer.

I do hope there is a neat answer to the problem - this could be a very
useful tool.  Good luck!  r2l

Important Disclaimer: Answers and comments provided on Google Answers are general information, and are not intended to substitute for informed professional medical, psychiatric, psychological, tax, legal, investment, accounting, or other professional advice. Google does not endorse, and expressly disclaims liability for any product, manufacturer, distributor, service or service provider mentioned or any opinion expressed in answers or comments. Please read carefully the Google Answers Terms of Service.

If you feel that you have found inappropriate content, please let us know by emailing us at answers-support@google.com with the question ID listed above. Thank you.
Search Google Answers for
Google Answers  


Google Home - Answers FAQ - Terms of Service - Privacy Policy