A team of researchers from the School of Information Management and
Systems University of California, Berkeley released a study How Much
Information? that chronicles the information explosion over the past
several years.
In 2000 there was an estimated 25 to 50 terabytes of information on the web
?The "surface" Web consists of approximately 2.5 billion documents up
from 1 billion pages at the beginning of the year, with a rate of
growth of 7.3 million pages per day. Estimates of the average
"surface" page size vary in the range from 10 kbytes per page to 20
kbytes per page. So, the total amount of information on the "surface"
Web varies somewhere from 25 to 50 terabytes of information
[HTML-included basis]. If we want to obtain a figure for textual
information, we would use a factor of 0.4, which leads to an estimate
of 10 to 20 terabytes of textual content. At 7.3 million new pages
added every day, the rate of growth is [taking an average estimate]
0.1 terabytes of new information [HTML-included] per day.?
(..)
?If we take into account all web-accessible information, such as
web-connected databases, dynamic pages, intranet sites, etc.,
collectively known as "deep" Web, there are 550 billion web-connected
documents, with an average page size of 14 kbytes, and 95% of this
information is publicly accessible. If we were to store this
information in one place, we would need 7,500 terabytes of storage,
which is 150 times more storage than we would need for the entire
"surface" Web, even taking the highest estimate of 50 terabytes. 56%
of this information is the actual content [HTML excluded], which gives
us an estimate of 4,200 terabytes of high-quality data. Two of the
largest "deep" web sites - National Climatic Data Center and NASA
databases - contain 585 terabytes of information, which is 7.8% of the
"deep" web. And 60 of the largest web sites contain 750 terabytes of
information, which is 10% of the "deep" web.?
University of California, Berkeley
http://www.sims.berkeley.edu/research/projects/how-much-info/internet.html
-------------------------------------------------------------
In the year 2003 there was an estimated 167 terabytes of information on the web
See Table 1.13: The size of the Internet in terabytes.
Source: How much information 2003
http://www.sims.berkeley.edu/research/projects/how-much-info-2003/internet.htm
-------------------------------------------------------------
Web size 1995-1997
In 1995 there was 0 .03 terabytes of information on the web
In 1996 there was 0.2 terabytes of information on the web
In 1997 there was 1.8 terabytes of information on the web
http://www.lesk.com/mlesk/ksg97/ksg.html
-------------------------------------------------------------
?As regards the Internet, the study shows that the Web has some 170
terabytes of information available to users, the equivalent of 17 US
Libraries of Congress. Instant messaging, meanwhile, generates five
billion messages a day (274 terabytes a year), while e-mail generates
a much larger amount of information: 400,000 terabytes a year, thanks
to the 31 billion messages sent every day.?
http://www.lavanguardia.es/public/series/51146905512.html
-------------------------------------------------------------
How Big is the Internet?
2000 Estimate
?The Internet contains over 2.1 billion pages (July 2000 estimate by
Cyveillance). Every day more than 7 million new pages are being added.
It is predicted that there will be more than 4 billion pages by early
2001.?
http://library.indstate.edu/newsletter/feb03/internetsize.html
-------------------------------------------------------------
The researchers estimated that the world wide web contains 172
terabytes of information on public pages.
http://www.computerweekly.com/Article126062.htm
-------------------------------------------------------------
"The World Wide Web contains about 170 terabytes of information on its
surface; in volume this is seventeen times the size of the Library of
Congress print collections."
Download White Paper: Sizing The Internet
University of California, Berkeley
http://www.sims.berkeley.edu/research/projects/how-much-info-2003/execsum.htm
-------------------------------------------------------------
?The volume of information on the public Web alone tripled between the
time the 2000 report and the 2003 report were written.?
http://www.dlib.org/dlib/november03/11editorial.html
-------------------------------------------------------------
Sizing the Internet: A Cyveillance Study"
Source: Cyveillance, 10-July-2000
- 2.1 billion unique, publicly accessible web pages, and about 4
billion by early 2001 if the current rate of growth continues;
- 7.3 million uniques ages added per day;
- Average page size: 10,060 bytes;
- Average number of images on page: 14.38 (median);
- Percentage of US vs. international pages: 84.7%/15.37%
- still continues to grow at accelerating rate;
The Deep Web: Surfacing Hidden Value"
Source: BrightPlanet LLC, July 2000
"The deep Web contains 7,500 tarabytes of information, compared to 19
terabytes of information in the surface Web;
The deep Web contains nearly 550 billion individual documents compared
to the 1 billion of the surface Web; 60 of the largest web sites
contain about 750 terabytes of information;"
"More than half of the deep Web content resides in topic specific databases;
Average page size on the surface Web is 18.7 kbytes, while on the deep
Web - 13.7 kbytes, and median for the deep Web is 19.7 kbytes;
Average deep Web site has a Web-expressed (HTML included basis)
database size of 74.4 megabytes, and a median of 169 kbytes;"
http://www.sims.berkeley.edu/research/projects/how-much-info/internet/wwwdetails.html
-------------------------------------------------------------
As of 7/5/2000, the Web has roughly:
2,170,000,000 pages;
40,800,000,000,000 bytes of text;
489,000,000 images;
8,160,000,000,000 bytes of image data.
http://www.sims.berkeley.edu/research/projects/how-much-info/internet/rawdata.html
------------------------------------------------------------
?The Internet is growing at an astounding rate - 7.3 million unique
pages are added every day. This rapid growth means it is imperative
for companies to proactively manage their presence on the Internet now
to ensure online success in the future.?
Cyveillance
http://www.cyveillance.com/web/forms/request.asp?form_type=wp&wp_name=sizing_internet
-------------------------------------------------------------
?According to the results of the Web Characterization Project's most
recent survey, the public Web, as of June 2002, contained 3,080,000
Web sites, or 35 percent of the Web as a whole. Public sites accounted
for approximately 1.4 billion Web pages. The average size of a public
Web site was 441 pages.?
See Figure 1: Number of Public Web Sites, 1998 - 2002
http://www.dlib.org/dlib/april03/lavoie/04lavoie.html
-------------------------------------------------------------
Sizing The Internet http://www.cyveillance.com/web/downloads/Sizing_the_Internet.pdf
-------------------------------------------------------------
Growth of the internet 1969-2003 by hosts
http://www.zakon.org/robert/internet/timeline/Count_Host-log.gif
-------------------------------------------------------------
Here is a thesis published in 2003 that provides some relevantdata
regarding the size of the internet.
http://home.zcu.cz/~dalfia/CiteSeeker.pdf
Search criteria:
Internet growth
Size of the internet ?billion terabytes?
Terabytes billion +web
I hope you find this information helpful!
Best regards,
Bobbie7 |
,
0 Comments
)
