Dear ckatir,
There are various possible reasons why your site is not indexed in
Google. Google bases its indexing, as well as its ranking, on the
sites that have linked to you. The robot crawls throughout the links,
to add sites to the index, which is updated about every four weeks.
You can learn more about this technology at the page "Page Rank
Technology" <://www.google.com/technology/index.html>.
That means, that there are two possible reasons why your site was not
visited by the Google Robot (or that it is not indexed):
(1) Your site is not linked to any other site and therefore, the robot
has difficulties in finding it throughout the crawl in links. Please
note, that even if you've submitted your site through the "Add URL
page" (://www.google.com/addurl.html), it doesn't mean that the
robot would crawl you - Google write "Given the large number of sites
submitting URLs, it's likely your pages will be found in an automatic
crawl before they make it into our index through the URL submission
form. We DO NOT add all submitted URLs to our index, and cannot
predict when or if they will appear." (Source: Google Information for
Webmasters "Submitting your site"
<://www.google.com/webmasters/1.html#A2>.
(2) The index was not updated since the last time you've submitted
your URL "The process may take several weeks to complete." (Source:
Google Information for Webmasters "The 'Add URL' form didn't work"
<://www.google.com/webmasters/1.html#B1>.
Google list two more possible problems for those who have submitted
their URL to Google but are not listed:
(3) "Occasionally, websites are not reachable when we try to crawl
them because of network or hosting problems. When this happens, we
retry multiple times, but if the site cannot be crawled, it will not
be listed in our current index. If it was a transient problem, the
site will likely show up in the next index, which will be completed in
a few weeks." (ibid)
(4) "If we have not picked up your site and it has been several
months, then it is likely that our spiders are not able to find your
site. The ONLY way a site is included in our index is if our crawlers
are able to find it by jumping from link to link on the Web. If we
have not found your pages, it is because we have not encountered any
links on the web pointing to your site. This is not to say that no
sites on the Web contain links pointing to your site - it simply means
that no sites found by Google contain links pointing to your page. If
you increase the links pointing to the page, Google will likely find
your site in the future." (ibid).
There are also technical components in your site that might hinder the
robot crawl. Among them:
(5) You use frames
(6) You use Flash (in your case you don't)
(7) You use "stop words" for the robot (see
http://www.robotstxt.org/wc/norobots.html).
(8) your page is dynamically generated.
These reasons, as well as others (see "Other Reasons",
<://www.google.com/webmasters/2.html#B3>) can bring about to the
fact that your page is not indexed in Google yet.
Usually and normally, the reason is just that you're not ranked to
enough sites, and that it takes a long time to index sites only on the
basis of the submitted URL. The solutions for you could be:
- Increase the number of sites that link to you
- Increase your listing in directories, such as the Google Directory
(http://directory.google.com/).
You can also discuss your problem and the solutions to it at Google
Public Support group
<http://groups.google.com/groups?q=google.public.support.general>. If
you want to, you can submit your URL again (at
://www.google.com/addurl.html), but that doesn't ensure faster
indexing.
Google Researchers - such as myself - are not affiliated with Google,
and only research on its platforms. However, my experience with many
site submissions (also as a webmaster and a site owner) is that
finding other sites that would link to you is the best solution.
I hope that helped. Please contact me if you need any clarifications
on this answer. I'd be pleased to clarify my answer before you rate
it. |
Request for Answer Clarification by
ckatir-ga
on
13 Oct 2002 14:15 PDT
Hi,
I like to ask specific clarifications on points below:
1) Google bases its indexing, as well as its ranking, on the
sites that have linked to you. The robot crawls throughout the links,
to add sites to the index, which is updated about every four weeks.
Here are the pages that point to me from my statistic page provided by
my host:
- http://branding.globalredirect.com/index.html 32
- http://www.hypermart.net/t/daytoday/stats/freestats/enable 23
- http://www.webadept.net/cgi/awstats.cgi 4
- http://www.hoferprecision.com 3
- http://www.homeimprovementconnection.com 2
- http://www.dealtime.com/GSE/GseWrapCache/1,6902,,00.html?nFormID=0&uid=1...
1
- http://search.earthlink.net/search?site=earthlink-ws&q=product+branding
1
- http://megadirectory.directhit.com/megadirectory/search.php?y=7942&qry=m...
1
- http://whatis.techtarget.com/wsearchResults/1,290214,sid9,00.html?query=...
1
- http://eps.new.search.new.net/apps/eps/results.cgi?quick=1&Partner=oingo...
1
- http://info.alexa.com/data/details?amzn_id=alexa65-tb-20&url=http://www....
1
- http://webster.directhit.com/webster/search.aspx?qry=marketing%2Fcommuni...
1
- http://www.att.net/cgi-bin/websearch?cmd=qry&qry=%22branding+irons%22&im...
1
- http://www.hoferprecision.com/0208/about.htm 1
- http://www.bonzi.com/bonziportal/index.asp 1
- http://www.worldnet.att.net/cgi-bin/websearch?cmd=qry&qry=e-marketing&im...
1
- http://www.hoferprecision.com/0208/flangedmotor.htm 1
- http://www.updated.com/search/?wid=11542&text=Marketing 1
- http://amzaon.com/results.asp?term=casino+marketing 1
- http://ask.com/main/moreresults.asp?ask=+dissertation+on+marketing+topic...
1
- http://www.alexa.com/search?amzn_id=&q=e-marketing%20tools 1
- https://www.hypermart.net/internal/usermgt/loadbyusername.gsp?p_site=1&p...
1
- http://www.alexa.com/data/details/traffic_details?q=&p=Det_W_t_40_L1&url...
1
- http://www.ask.com/main/moreresults.asp?ask=criteria+for+branding+&qsrc=...
1
- http://www.ask.com/main/moreresults.asp?ask=marketing&qsrc=0&adcat=b2b&a...
1
- Others 41
All these sites are crawled by Google, especially HoferPrecision.com
I have also been crawled by these Robots:
ia_archiver 44 times 12 Oct 2002 - 10:40
Road Runner: The ImageScape Robot 20 times 11 Oct 2002 - 13:59
Scooter 4 11 Oct 2002 - 08:58
Inktomi Slurp 1 11 Oct 2002 - 13:07
I also believe this statistic is important:
Links from an Internet Search Engine
- Google 473
- Ask Jeeves 184
- AOL 100
- Netscape 64
- Dogpile 25
- MSN 22
- Other search engines 18
- Yahoo 13
- AltaVista 13
- MetaCrawler (Metamoteur) 4
- Excite 4
- WebCrawler 3
- Lycos 2
- Go.com 1
- Overture 1
I have been with Google Adword select for more than a month now. I
feel Google has to have some sort of priority for Google advertisers.
I feel if it's ok that we pay we are shown, but it's not ok to be at
leats included in directory is a wrong feeling for people.
Now let me state the seond point:
2) "Occasionally, websites are not reachable when we try to craw)
them because of network or hosting problems.
I have discussed this with my host and they have assured me that the
host is fine.
Now on the third point
3)There are also technical components in your site that might hinder
the
robot crawl. Among them:
(5) You use frames
(6) You use Flash (in your case you don't)
(7) You use "stop words" for the robot (see
http://www.robotstxt.org/wc/norobots.html).
(8) your page is dynamically generated.
Can you please check my site and tell me exactly which one of these
techniocal problem exist in my site?
I truly appreciate your help and eagerly waiting for clarification.
|
Clarification of Answer by
politicalguru-ga
on
15 Oct 2002 03:45 PDT
Dear ckatir,
Because of the data you presented, it took a bit to examine the issue,
so please accept my apologies for the time it took.
I have checked the pages that are claimed to be linked to you - all of
the sample pages I have tried are not linked to you in a visible link,
which is Google's request for crawling, see Google's "don't" regarding
page indexing:
"Don't:
- Cloak.
- Write text or create links that can be seen by search engines but
not by visitors to your site.
- Participate in link exchanges for the sole purpose of increasing
your ranking in search engines.
- Send automated queries to Google in an attempt to monitor your
site's ranking.
- Use programs that generate lots of generic doorway pages."
(Source: Google Information for Webmasters, "Webmaster Dos and
Don'ts", <://www.google.com/webmasters/dos.html>).
Your links may imply cloaking. If this is the case, cloaking might
cause permanent ban from the Google index.
In any case, Google themselves indicate that the erason could be :
"Your page was manually removed from our index, because it did not
conform with the quality standards necessary to assign accurate
PageRank. We will not comment on the individual reasons a page was
removed and we do not offer an exhaustive list of practices that can
cause removal. However, certain actions such as cloaking, writing text
that can be seen by search engines but not by users, or setting up
pages/links with the sole purpose of fooling search engines may result
in permanent removal from our index. If you think your site may fall
into this category, you might try 'cleaning up' the page and sending a
re-inclusion request to help@google.com. We do not make any guarantees
about if or when we will re-include your site. " (Source: Google
Information for
Webmasters "A. My web pages have never been included in the Google
index."
<://www.google.com/webmasters/2.html>.
I hope that helps.
I suggest you'll contact this email to seek solutions for your
problem.
|
