I am in search of obtaining all the links from a site to other sites.
E.g. what links do CNN.com have on their entire site to other
sites? I know it can be done spidering the site yourself and
extracting the links but since Google already have the source to the
entire site its something they can do. They don't. Who does?

---

Request for Question Clarification by maniac-ga on 25 Sep 2002 19:45 PDT

Hello Roelof,

Are you looking for something beyond (on AltaVista)...
  link:www.google.com host:redhat.com
which provides about 12000 hits (since Red Hat uses Google as its search engine)?

  --Maniac

---

Clarification of Question by roelof-ga on 26 Sep 2002 03:19 PDT

Maniac,

Correct indeed - the problem is that I am not looking for a specific
link but rather look at ALL the external links to other sites. I guess
it would be something like:

link:* host:redhat.com

which does not work...
Hope this helps to clarify.

'later,
Roelof.

roelof-ga,

there is an article in the German Linux-Magazin that presents a Perl
script that searches for all references to a web page
(http://www.linux-magazin.de/Artikel/ausgabe/2002/10/perl/perl.html?print=y).
The Perl script uses the Google Web Service
(://www.google.com/apis/).

The article is in German but the Google Language Tools
(://www.google.com/language_tools) might help you...

HTH. Yours, Thomas