How can I do a word search of a specific directory on the internet? 
E.g. I may want to search
http://www.piperanddrummer.com/pdnews/
for the key word: 'peter'.

I would like the search to be able to be for anything below the
directory specified

---

Clarification of Question by branton-ga on 03 Oct 2002 18:23 PDT

I would like the solution to be able to search pdf as well as HTML.

Hi, 

Here is the completed query, 
://www.google.com/search?q=inurl:www.piperanddrummer.com/pdnews/+%2B%22Peter%22&num=100&hl=en&lr=&ie=UTF-8&safe=off&filter=0

And now I'll tell you how I did that. 

First, you want to use the "inurl" function which in this case would
be a google search which looks like this :

inurl:www.piperanddrummer.com/pdnews/ 

Only two or three pages are going to pop up because this site uses ASP
for its programming. But.. if you look at the bottom of the listing
there is a sentence which says.. "In order to show you the most
relevant results, we have omitted some entries very similar to the 2
already displayed.
If you like, you can repeat the search with the omitted results
included."

Yes we do, so click on that hyperlink and all those ASP pages will
show up. Now, at the bottom of the page, Next to the Google Search
Button, there is another hyperlink which says .. "Search within
results" Click on that.

Now, type in +"Peter" and this will search all the pages we found
before, for the word Peter. Again, only two pages are going to show up
because of the ASP, so we again ask that all pages be shown and you
get the final result which I started this answer out with.

Happy searching, and thanks for the question. 

webadept-ga

You know you can already search by the site by putting your query as
"peter site:piperanddrummer.com" . It's not as specific to the
directory, but it's a start.

skermit-ga

Unless the server is configured to allow you to see all files in a
directory mode, you more or less need to know what files are there in
order to search them.

Your best bet would be to locate a program called a SPIDER or ROBOT. 
These are the same types of tools that Google uses to parse web pages
and generate search criteria.  In the case of a search engine, they
are looking for any meaningful word, but in your case, you are only
looking for a single phrase.  Many spiders out there allow you to
specify key words to search for and how many links to follow.  Also
whether or not to follow links to a different site.

Try this spider program: http://www.searchmechanics.com/prepare/
There are other programs out there if that one doesn't meet your
needs.

Layne