Hello.

I need a complete list of site that contains "shopper.exe" on their
URL. I tried to find it on google, and combine some keywords, but the
result is not so complete. Some of the site is not listed on google
search engine when i try to search them from Lycos.

---

Request for Question Clarification by journalist-ga on 28 Mar 2003 09:33 PST

At ://www.google.com/search?q=%22shopper.exe%22&hl=en&lr=&ie=UTF-8&start=90&sa=N
are listed over 76,000 returns for "shopper.exe" (with quotation
marks).  Have you already executed this search?  I skipped to results
pages 10 and 18 and saw the shopper.exe extension on most results. 
Have you already executed this specific search on Google?

---

Request for Question Clarification by pafalafa-ga on 28 Mar 2003 09:39 PST

Hello japrak,

As my esteemed colleague, journalist-ga, noted, there are indeed may
thousands of sites mentioning "shopper.exe".  This is not a surprise,
as the file has a somewhat notorious reputation as a security
vulnerability.

If you could tell us a bit more about what, specifically, you are
after, then perhaps one of the researchers here can get you precisely
the information you need.

---

Clarification of Question by japrak22-ga on 28 Mar 2003 11:13 PST

Hello,

Yes i have tried that keyword.
It only showed me 29 pages with 286 results. not 78,000

And i tried to find them on Lycos. It show me www.rhinoliningsgear.com
as a result. But i can't get it on Google!

Please help!

---

Request for Question Clarification by pafalafa-ga on 28 Mar 2003 17:53 PST

Hello again Japrak.

Can you please explain EXACTLY what you did that led to 29 pages/286
results, instead of the thousands that others have found.

For instance, I entered the following text into the Google search box:

                     "shopper.exe"

Is that what you did?  Or did you try a different search?  Or is this
about something other than searching?  The more you can tell us, the
more likely we can be of assistance.

Hi again,

There are two reasons why Google shows less results than Lycos when
you you search for URLs containing the phrase ""shopper.exe"

1. Google doesn't index every dynamic URL it finds, although it does
index some.
2. Google shows less than the complete results unless you follow a
link at the end.


1. Google and dynamic URLs
--------------------------

Quite simply, although Google is quite capable of indexing dynamic
URLs (typically identified by a "?" in the URL, or cgi-bin), they pass
on many:

Reasons your site may not be included.
Your pages are dynamically generated. We are able to index dynamically
generated pages. However, because our web crawler can easily overwhelm
and crash sites serving dynamic content, we limit the amount of
dynamic pages we index.
://www.google.com/webmasters/2.html


2. The way Google shows results
-------------------------------

At the top of each search results page it says something like:

Results 1 - 30 of about 73,400.
://www.google.com/search?as_q=&num=30&hl=en&ie=ISO-8859-1&newwindow=1&btnG=Google+Search&as_epq=shopper+exe&as_oq=&as_eq=&lr=&as_ft=i&as_filetype=&as_qdr=all&as_occt=url&as_dt=i&as_sitesearch=&safe=images

73,400 is the total number of results. However, when you get to the
end of the results, you will find a message saying:

"In order to show you the most relevant results, we have omitted some
entries very similar to the 208 already displayed. If you like, you
can repeat the search with the omitted results included."

By clicking on the link you can see the rest of the results, although
you can't see more

than the first 990, a limit which applies to all Google searches. 
://www.google.com/search?q=allinurl:++%22shopper+exe%22&num=30&hl=en&lr=&ie=UTF-8&newwindow=1&as_qdr=all&start=270&sa=N

They are almost always extremely similar to the results you have
already seen. Especially so with dynamically generated pages, which
are typically all the same except for a bit of product detail, as you
would expect with shopper.exe.


Lycos
-----

Lycos uses the FAST/AlltheWeb index for its results. Although it shows
8,902 pages with "shopper.exe" within their URL, there is also a limit
of how many results you get to see, in this case 1000:
http://search.lycos.com/default.asp?query=&first=991&pmore=more&ca=w&gi=0&npl=wfc%3D3%26wfr%3D%26wfr%3D%252B%26wfr%3D%252D%26wfw%3Durl%252Eall%253A%26wfw%3D%26wfw%3D%26wfq%3Dshopper%252Eexe%26wfq%3D%26wfq%3D%26dfc%3D2%26df0%3Di%26df1%3De%26dfq%3D%26dfq%3D%26adv%3D1%26adf%3D%252D2%26lang%3D


How to see the complete results
-------------------------------

You can't. All the major search engines limit the number of results
displayed. By putting it a lot of effort, you could change your query
to get different sets of results, and end up with more than 990 when
you merge all the results together.

For example, this search returns pages with "shopper.exe" in the URL,
but not cgi-bin:
://www.google.com/search?num=30&hl=en&lr=&ie=ISO-8859-1&newwindow=1&as_qdr=all&q=allinurl%3A++%22shopper+exe%22+-cgi-bin


Please ask for further clarifications if any part of my answer is
unclear, or if I have misunderstood your query.


Best wishes,
roebrtskelton-ga

---

Request for Answer Clarification by japrak22-ga on 28 Mar 2003 21:27 PST

hello,

so, how i can search a site that contain dynamic page ?

---

Clarification of Answer by robertskelton-ga on 29 Mar 2003 05:56 PST

Do you mean a specific site, or dynamic sites in general?

---

Request for Answer Clarification by japrak22-ga on 30 Mar 2003 03:28 PST

Hello

Yes i means dynamic sites in general. I need to search websites that
contain "shopper.exe" and much of them using dynamic pages where
Google can't display it on the search result.

---

Clarification of Answer by robertskelton-ga on 30 Mar 2003 14:11 PST

Most sites which use "shopper.exe" are of course online stores. If you
want to search within such a site, they might have their own search
function, like this site:
http://www.thecelticcardteam.com/cgi-bin/Shopper.exe?ListCategories

If you want to find all the sites using "shopper.exe" that Google and
Lycos can't find or choose not to index, it is very difficult.

The only other major engine which allows such a search is Teoma:
http://s.teoma.com/search?q=inurl%3a%22shopper.exe%22&qsrc=23&nw=False&u=30

It says that there are 38,100 results, but sadly only shows the first
39.

The manufacturers of the shopping cart list some stores that use it:

PDG Software
http://www.pdgsoft.com/stores.htm
http://www.pdgsoft.com/testimonials.htm