Google Answers: google spiders only index.htm, would like site to be crawled

View Question

Q: google spiders only index.htm, would like site to be crawled ( No Answer, 1 Comment )

Question

Subject: google spiders only index.htm, would like site to be crawled
Category: Computers > Internet
Asked by: afisguy-ga
List Price: $3.00

Posted: 10 Jul 2004 11:17 PDT
Expires: 18 Jul 2004 19:07 PDT
Question ID: 372351

I notice google responds with just one link when I query with
"link:www.lifemysteries.com".  I have tried various robots.txt files,
but they still generate the same result.

Also, I have about 10 sites linking to me (mostly reciprocal).
How do I get spiders like google to crawl the entire site?

http://www.lifemysteries.com

Request for Question Clarification by aceresearcher-ga on 10 Jul 2004 18:28 PDT
Researchers, see additional information on previous Question
http://answers.google.com/answers/threadview?id=368645

Clarification of Question by afisguy-ga on 18 Jul 2004 19:06 PDT
I've added a text menu, and I have the site navigated properly!  Thanks!

Answer

There is no answer at this time.

Comments

Subject: Re: google spiders only index.htm, would like site to be crawled
From: respree-ga on 15 Jul 2004 23:03 PDT

By getting rid of your javascript navigation menu.  Spiders cannot
understand javascript and, therefore, cannot follow your links.

Important Disclaimer: Answers and comments provided on Google Answers are general information, and are not intended to substitute for informed professional medical, psychiatric, psychological, tax, legal, investment, accounting, or other professional advice. Google does not endorse, and expressly disclaims liability for any product, manufacturer, distributor, service or service provider mentioned or any opinion expressed in answers or comments. Please read carefully the Google Answers Terms of Service.

If you feel that you have found inappropriate content, please let us know by emailing us at answers-support@google.com with the question ID listed above. Thank you.

Search Google Answers for

Google Home - Answers FAQ - Terms of Service - Privacy Policy