Google Answers Logo
View Question
 
Q: Search Engine Indexing ( No Answer,   3 Comments )
Question  
Subject: Search Engine Indexing
Category: Computers > Internet
Asked by: waza-ga
List Price: $10.00
Posted: 19 Apr 2005 20:22 PDT
Expires: 19 May 2005 20:22 PDT
Question ID: 511638
We have our experts listed in www.expertguide.com.au.   As you can see
from http://www.expertguide.com.au/ExpertList.aspx page (which every
page on our website is linked from).

But for some reason NONE of the search engines are indexing those
pages.  They have indexed every other page, but not those.  Can you
give us answer as why and what we can do to fix this.

Thanks,

Warren
Answer  
There is no answer at this time.

Comments  
Subject: Re: Search Engine Indexing
From: birdland-ga on 28 Apr 2005 10:31 PDT
 
Hi Warren,

The first thing to check is your robots.txt file. Here's a tutorial
page if you need it;

http://www.searchengineworld.com/robots/robots_tutorial.htm

It may be you're inadvertantly denying access to those pages in your
robots.txt file. If you're not using one, you may be able to point the
robots in that direction with a proper robots.txt implementation.

Also; type the following into a google search window;

site:www.expertguide.com.au

You'll see that a lot of pages are indexed - but there are no details
listed and they're not "cached". This is the "google sandbox" working.

It appears to me that the site has only been operational since
sometime in November 2004. That's not a lot of history time for the
search engines to do their indexing work.

I can't find your site in the DMOZ directory - submission here is a must;
http://search.dmoz.org/
You should submit the index page only - but people have been known to
submit subdirectories (such as www.expertguide.com.au/ExpertList.aspx)

There is a lot of Javascript on the page. Search engines like text.
You may want to redesign, move the javascript to a .js file (point the
browsers to that file  - IE; <script type="test/javascript"
src="namethisfile.js"></script>) thereby providing a text and link
heavy index page for the engines to spider.

Feel free to contact;
<a href="http://www.internet-reach.com>Internet Reach</a> for further clarification.
Subject: Re: Search Engine Indexing
From: somraa-ga on 08 May 2005 22:43 PDT
 
Hi Warren,
the Head-Tag of this page contains this line:
<META content="noindex,FOLLOW" name="ROBOTS">
which tells the searchrobots not to index this page, just to follow.
In order to follow, they need exact links, like, for example: <a
href="ExpertListing_A.aspx">A</a>
Instead I found in your sourcecode <a
href='ExpertListing_A.aspx'>A</a> which I believe is the reason, why
they did not follow.
Somraa
Subject: Re: Search Engine Indexing
From: waza-ga on 08 May 2005 23:10 PDT
 
All seems to be working now.

Important Disclaimer: Answers and comments provided on Google Answers are general information, and are not intended to substitute for informed professional medical, psychiatric, psychological, tax, legal, investment, accounting, or other professional advice. Google does not endorse, and expressly disclaims liability for any product, manufacturer, distributor, service or service provider mentioned or any opinion expressed in answers or comments. Please read carefully the Google Answers Terms of Service.

If you feel that you have found inappropriate content, please let us know by emailing us at answers-support@google.com with the question ID listed above. Thank you.
Search Google Answers for
Google Answers  


Google Home - Answers FAQ - Terms of Service - Privacy Policy