Google Answers Logo
View Question
 
Q: Technical Question Re: URLs and Google Crawler/Indexing/Retrieval ( Answered,   0 Comments )
Question  
Subject: Technical Question Re: URLs and Google Crawler/Indexing/Retrieval
Category: Miscellaneous
Asked by: anneb-ga
List Price: $35.00
Posted: 27 Apr 2004 11:06 PDT
Expires: 27 May 2004 11:06 PDT
Question ID: 337089
We changed the DNS for website www.aaa.bbb.com to be an alias for website
aaa.bbb.com, and currently both URLs resolve to the same set of web
servers. We are contemplating moving www.aaa.bbb.com to a URL
rewriting server (so users will always get redirected to a
aaa.bbb.com URL) and are trying to determine if there will be any
resulting issues for Google users. For example, will both www.aaa.bbb.com
and aaa.bbb.com get indexed? If so, will both URLs appear in the
search results? Is one approach (alias/web server vs. rewriting
server) better for the Google: crawler, indexing, or retrieval?

Thanks

PS - the Google link tool treats "www" as a stop word. Hence, both
URLs returned identical results.
Answer  
Subject: Re: Technical Question Re: URLs and Google Crawler/Indexing/Retrieval
Answered By: mmastrac-ga on 01 May 2004 17:31 PDT
 
Hi anneb-ga!

Search engines generally "fold" similar information into single results.  You 
won't harm your Google index (or any other search engine index) by
having two sites reference the same page, but only one will appear in
the listings.  Generally, the page with the higher rank will appear.

I've found a lot of information on this topic by searching Google for
the words "duplicated content penalty google":

This forum: http://forums.seochat.com/showthread.php?t=8510

Has a post that says: "Duplicate content doesn't leed to a penalty,
but plese note that Google will only display one copy in the SERPS,
normally the one with the higher PR."  In other words, the highest
ranked page will be the one the users will see.

No matter which approach you choose, rewriting or DNS aliasing, you'll
very likely end up with the same results.  In both cases, the search
engines will choose only one of your sites (whichever is the most
popular) to present to the user as a search result.  Since both of
your sites are going to be identical, it should not matter which is
presented as the result.

In this case, I would suggest the easier route and using a simple DNS
alias.  For an example of a very popular site using a technique like
this, please see "www.msdn.microsoft.com" and "msdn.microsoft.com".

Please let me know if I have answered this question with enough
detail.  If you require more information, don't hesitate to ask for an
answer clarification.

Regards,
mmastrac-ga

Request for Answer Clarification by anneb-ga on 03 May 2004 11:02 PDT
Thanks for the research, it's appreciated. Here is the problem: what
was provided doesn't definitely answer my question; facts are needed.
Statements that are prefaced by "generally," "very likely," and
"normally" are assumptions, not facts.

Being a first-time user of Google Answers, I made the assumption that
Google moderated this site and that they would provide answers to
technical questions, such as mine. My err.

Regards

Clarification of Answer by mmastrac-ga on 03 May 2004 11:47 PDT
Hi anneb-ga!

I'm sorry that there was confusion over the role of Google
researchers.  Since we have no affiliation with Google (besides being
screened initially), we are not privy to confidential information with
regards to the inner workings of the search engine.

The best answer I can provide to you will be gathered from outside
observation of the search engine, but any answer would be no more than
a hypothesis.  I have a great deal of experience in both networking
administration dealing with DNS, as well as technical experience in
working with web requests that gives the ability to make a good guess
at something like this, but of course, cannot guarantee that any of it
is correct.

If you like, I can provide more detailed explanations into how DNS
aliasing works, how search engines behave and would most likely
interact with the DNS aliasing, and try to locate real-world examples
of the behaviour you're interested in.  Unfortunately I believe this
is as much as you will be able to obtain from the public Internet
itself.

Your other option, always available, is to ask for a refund- minus the
initial $0.50 non-refundable listing fee.

I'm sorry that I could not provide a satisfactory answer.  Please let
me know how you would like to proceed.

Regards,
mmastrac-ga
Comments  
There are no comments at this time.

Important Disclaimer: Answers and comments provided on Google Answers are general information, and are not intended to substitute for informed professional medical, psychiatric, psychological, tax, legal, investment, accounting, or other professional advice. Google does not endorse, and expressly disclaims liability for any product, manufacturer, distributor, service or service provider mentioned or any opinion expressed in answers or comments. Please read carefully the Google Answers Terms of Service.

If you feel that you have found inappropriate content, please let us know by emailing us at answers-support@google.com with the question ID listed above. Thank you.
Search Google Answers for
Google Answers  


Google Home - Answers FAQ - Terms of Service - Privacy Policy