Google Answers Logo
View Question
 
Q: Are my URLs making my site unspiderable? ( Answered,   0 Comments )
Question  
Subject: Are my URLs making my site unspiderable?
Category: Computers > Algorithms
Asked by: crunchyguy-ga
List Price: $4.00
Posted: 14 Jul 2004 15:27 PDT
Expires: 13 Aug 2004 15:27 PDT
Question ID: 374142
My site filmmerchant.com has a strong page rank on the main page and
on a couple of the side pages.  However, all of the product pages have
a page rank of 0.  It appears to me that the way that I have set up
the navigation is making the pages unspiderable.  I've heard that
maybe I have too many variables in the urls for the spider to handle
it.  I'd love to figure out what I can do to make the site spiderable,
as I'm getting next to no traffic at the moment.
Answer  
Subject: Re: Are my URLs making my site unspiderable?
Answered By: webadept-ga on 18 Jul 2004 23:59 PDT
 
Hi, 

This is one of the banes of uses mod_rewrite none of the SEO's tell
you about. In fact it is so obvious I wonder that anyone uses
mod_rewrite at all.

Take this link for example:
http://www.filmmerchant.com/9-dollar-dvds/?ls=181

Now, in the bot's mind (any bot) the page listed (?ls=181) is 1) an
uncertain type 2)  3 levels down (there for of little importance) and
3) comprised of only links to other pages. (this is a link of your
search result page. )

This link, a product link:
http://www.filmmerchant.com/exercise/ambient-water.php?DVD=82163

is 1) on the third level (so of very little importance and 2) has only
a variance of words with every other page in that directory of 23 word
groups. So it is not much different.

Remember that we are dealing with a bot here, not something that
thinks, but something that doesn't think, it just records what it
sees. It is an Automaton` nothing more.

Now, I can see that you are using these pages to describe different
movies, and that your search levels are in fact on the top level, not
three deep, but the bot doesn't know that, it just goes with what it
sees, and a page three levels down that doesn't have much content, and
that content is only different by 20 - 30 words per page for every
page in that directory, can't be very important, .. can it? Put that
way, no, and this is exactly how that bot reacts.

You should also read the Google Webmasters area, found off the main
page, regarding the use of sitemaps.. I would strongly recommend
looking at this first, before looking at code rewrites. It is possible
that if you created a well-formed sitemap.html, you could get much
better results from your current system.

thanks, 

webadept-ga
Comments  
There are no comments at this time.

Important Disclaimer: Answers and comments provided on Google Answers are general information, and are not intended to substitute for informed professional medical, psychiatric, psychological, tax, legal, investment, accounting, or other professional advice. Google does not endorse, and expressly disclaims liability for any product, manufacturer, distributor, service or service provider mentioned or any opinion expressed in answers or comments. Please read carefully the Google Answers Terms of Service.

If you feel that you have found inappropriate content, please let us know by emailing us at answers-support@google.com with the question ID listed above. Thank you.
Search Google Answers for
Google Answers  


Google Home - Answers FAQ - Terms of Service - Privacy Policy