Hi

I searched for the site nohasslefinance.co.uk in google the other day
and it appeared, I searched again today and it has gone - do you
remove websites from google?

Regards

Lee

---

Request for Question Clarification by robertskelton-ga on 10 Feb 2003 12:01 PST

Had the site been appearing in Google for some time, or did it appear
for just one or two days and then disappear?

---

Clarification of Question by stenning-ga on 10 Feb 2003 12:22 PST

Hi robertskelton-ga

Yes, the site appeared for a couple of days then dissappeared?

I look forward to hearing from you.

Cheers

Lee

Hi Lee, 
 
There was a time when you just submitted your website's URL, waited a
month or two, it appeared and that was that. These days the process
can be more complicated, especially when it comes to Google.
 
Freshbot 
-------- 
 
When you submit your URL to Google, some time in the next month or so
the Googlebot will pay your site a visit and index most or all of it.
When the entire main index is refreshed (typically at the end of each
month) your site should appear and stay there. Sometimes you have to
wait until the following main index refresh for it to appear.
 
Google also has Freshbot - it looks for websites which typically have
constantly changing content, and re-indexes them every day or two. If
you see any Google search results with a date beside them, that is
when Freshbot last visited them. Sometimes Freshbot will
unintentionally find other sites...
 
It appears that nohasslefinance.co.uk was found by the FreshBot, and
is now going through an unstable period which often occurs to new
sites found by FreshBot. One of the most common queries I receive here
(and elsewhere) is why does my site disappear, then reappear, then
disappear? The following comes from GoogleGuy, a Google search
engineer who often answers queries posted at WebMasterWorld:
 
GoogleGuy: Everflux and Fresh Crawls 
------------------------------------ 
 
If your site is new, or hasn't shown up in google for long, it may
because our "fresh crawl" (which runs each day) was finding your site
instead of our main crawl (which runs about once a month). Our "fresh
crawl" is a newer feature, and we're still experimenting with which
pages to crawl, how deeply to crawl, etc. We even reserve the right to
(gasp!) not do a fresh crawl on some days because we're doing tests or
reviewing new code. Someone wrote in recently and said "my site got in
google three weeks ago, and you've dropped me four times!"  Nope, it's
just that we don't always crawl the same pages in our fresh crawl, and
we don't always crawl to the same depth. As we do a full crawl of the
web, we find most of the sites from our fresh crawl and put them in
our regular index. My advice on our fresh crawl is to view it as a
nice "bonus" on top of google's deep index. Users can always search
our full index, but sometimes we can serve up even fresher pages as an
extra nicety.
 
The rest of the discussion is at: 
http://www.webmasterworld.com/forum3/6339.htm 
 
Basically, if your site is picked up by freshbot one day, but not the
next, the site's listing reverts to its normal listing. If your site
didn't previously have a regular listing, it disappears. Here are some
more opinions at WebMasterWorld:
 
Google also has what we call the fresh-bot, also nicknamed "minty". It
crawls much more frequently, but not as deeply. It is used to update
pages in the index which change often. After a freshbot crawl you site
may appear for a few days with an updated listing, called a "fresh
listing". However, if the freshbot does not return within a few more
days, your "fresh listing" will disappear, and your listing will
revert to whatever it was during the previous deep-crawl, meaning the
one at least one month ago. If you have never had a "previous" deep
crawl, then your site may disappear. If the fresh bot returns to your
site, your fresh listing may re-appear. Therefore, during the first 30
to 59 days of a site's life, it may drop in and out of Google's
results page.
http://www.webmasterworld.com/forum3/6743.htm 
 
When we do a new fresh crawl, it currently replaces the last fresh
crawl. And again, we do experiments from time to time, so different
crawls may visit different pages. (GoogleGuy)
http://www.webmasterworld.com/forum3/6339.htm 
 
My site is new and isn't in the Main Index yet, but was in for a day,
due to fresh bot crawl 3 days ago. freshbot came back this morning
(whew), grabbed some pages, but I'm nowhere to be found... The point
is that pages found by freshbot have an unsure life in Google's index.
http://www.webmasterworld.com/forum3/5196-3-15.htm 
 
Search Strategy: searching WebMasterWorld for "freshbot" 
 
 
This is a huge subject, with thousands of people guessing at what is
going on, and rare instances of someone like GoogleGuy giving
semi-official answers.
 
Best wishes, 
robertskelton-ga

Thanks for the great answer, dont have much cash, but this is a token
of my appreciation! Cheers

Directly from Google's information for webmasters:

"If your page does not appear at all, there here are some other
possible explanations.

    * Your site may not have been reachable when we tried to crawl it
because of network or hosting problems. When this happens, we retry
multiple times, but if the site cannot be crawled, it will not be
listed in our current index. If it was a transient problem, your site
will likely show up in the next index, which will be completed in a
few weeks.

    * A technical glitch on our side may have caused us to 'miss' your
site. In crawling more than 3 billion pages every few weeks, our
system experiences hiccups from time to time. Again, this is a
transient problem, and your site will likely show up in the next
index. Please be patient with us during this period, as we are not
able to modify our index by hand to add sites missed in this way.

    * The contents of your page or the links pointing to your page
changed significantly and you no longer have a sufficiently high
PageRank, or your page had low PageRank to begin with and a small
change caused you to be dropped from the Google index.

    * Your page was manually removed from our index, because it did
not conform with the quality standards necessary to assign accurate
PageRank. We will not comment on the individual reasons a page was
removed and we do not offer an exhaustive list of practices that can
cause removal. However, certain actions such as cloaking, writing text
that can be seen by search engines but not by users, or setting up
pages/links with the sole purpose of fooling search engines may result
in permanent removal from our index. If you think your site may fall
into this category, you might try 'cleaning up' the page and sending a
re-inclusion request to help@google.com. We do not make any guarantees
about if or when we will re-include your site."

://www.google.com/webmasters/2.html  has the rest of the
information.   If you click on the left-hand menu's links, there is
more various information for webmasters there-- like how you can make
sure your website is indexed (using HTML's META tags), how to stop
pages from being indexed, and how to submit your site to Google (via
hyperlinks).

Hope that helps,
DS