Hello Prpro
This is an interesting question and something I have wanted to do in
the past. The solution I would suggest is http://www.daypop.com
Daypop prides itself on being the "current events" search engine and
crawls the web at least once a day for every known blog (that is every
blog that it has discovered and is active) and online newspapers and
magazines. By doing this it allows you to keep up with the trends and
the latest word on your search criteria.
At present Daypop has an index of over 59,000 sites that it trawls
through, this may not seem many when you compare it to the number of
pages indexed by a site such as Google which runs into billions but
remember that the majority of webpages are static and once they have
been written they never change. Daypop concentrates on the frequently
changing pages. Incidentally if there is a page that you think should
be included in Daypop you can just submit it and it will be added to
their search index.
When you enter a search criteria you can limit your results solely to
weblogs, news or RSS feeds (or a combination) allowing you to finetune
your results. There are also advanced search capabilities that allow
you to do detailed searches up to 2 weeks back in time (if you need to
search further back in time your only options are to use a normal
search engine, such as Google, or to use the Internet Wayback Machine,
which is severely limited).
http://www.daypop.com/info/search_tips.htm
http://www.daypop.com/advanced
There is also the option of the Daypop archives which show you the
latest buzz on days back in history - this feature is still being
developed and I would expect it to expand soon. The archive stretches
back 3 years.
http://www.daypop.com/archive/news/
According to the site's technology page, each major news site is
updated every 3 hours whilst lesser known ones are trawled every 24
hours. Weblogs are updated every 12 hours unless they feature on the
www.newsisfree.com site or make use of a ping facility at weblogs.com
in which case they are then updated every hour.
Daypop can also allow you to analyse the results of trends. This is
done by using one of 4 technologies - Link, Word, Wishlist or
Popularity Analysis.
Link analyses gather information on the links that are being passed
around the net by users. Word analyses determines the current
buzzwords being used by the various authors. Wishlist analyses shows
you what people want to buy by searching various wishlists such as
those on Amazon.com. Popularity analyses determines the popularity of
various sites and posts by judging how many people link to it.
http://www.daypop.com/info/technology.htm
Daypop has been widely reviewed in the press and is loved by many.
Some of the choice reviews can be seen below:
1) Business Week - May 31, 2004
'Out-Googling The Top Search Engine'
2) SearchEngineWatch.com - February 6, 2004
'Daypop earns our other honorable mention, due to its continued
strength in indexing weblogs and its interesting features such as
"word bursts" and "news bursts" that surface heightened usage of
certain words in weblogs and on the front pages of online news
sources.'
3) New York Times - Mar. 13, 2003
'Sites that track what people are linking to or searching for online
provide a peek at the Web's collective consciousness. But do those
statistics capture all the hot topics? ... The study of "word bursts"
in Weblogs or e-mail could prove a sort of early-detection system for
online trends.'
4) Reuters - Feb. 26, 2003
'Visitors to Daypop, an index of personal journalism sites known as
Weblogs, were treated on Wednesday to a new feature called "word
bursts," an automated attempt to identify the hottest words at the
moment... It's just the latest example of the power of Weblogs to
shape perception among a growing audience of online readers.'
5) Guardian Unlimited - July 18, 2002
'Major search engines don't keep up adequately with the rapidly
changing content Daypop tracks, so it fills a major gap. It can do
this because it focuses "only" on a mere 7,500 weblogs and news
sites.'
6) New York Times - Mar. 28, 2002
'Now Daypop.com, an alternative search engine that focuses on news
sites and Weblogs, has made it easier to snoop on what other people
want other people to buy them.'
7) USA Today - Mar. 11, 2002
'When you're looking for the absolute latest on a new movie release,
sporting event or Internet craze, chances are Daypop will find it. The
site scours more than 6,500 news sites, online magazines and personal
weblogs.'
8) CNET - Dec. 13, 2001
'We put Daypop to the test... and, in every case, Daypop found what
the others couldn't. You'll find more news from more sites than you
can imagine... Impressive.'
Finally so what does Daypop say about Pepsi today?
http://www.daypop.com/search?q=pepsi&search=Search&t=a
There are 95 pages using the standard Daypop search, an example result
found is this:
RedCherri
"Coke or Pepsi ? Pepsi Coke/Pepsi or 7Up/Sprite ? 7Up/Sprite Burger
King or MacDonald's ? Burger King Hamburger or Hot Dog ? Hot Dog White
bread"
redcherri.blogdrive.com - 65K - Cached 06-20 - Citations
This tells us that Pepsi was mentioned on the redcherri.blogdrive.com
website and in a comparison with other main brands. The information
was collected on 20th June for this listing and there are further
citations and links to this article available.
Incidently there are other sites like this available - the other main
one being Blogdex at MIT Laboratories - but none are as extensive in
its results and you indicated in your question you only required one
solution (which I regarded as the best).
I am sure you will agree Daypop is a vast resource and will definitely
help you in tracking your product and its popularity on the internet
in the past and its current buzz. If you require any further
information on this subject please ask for clarification and I will do
all I can to help. |
Request for Answer Clarification by
prpro-ga
on
20 Jul 2004 07:06 PDT
Yeah, it doesn't have to be a comprehensive report, but here is why I
wanted to use a clipping service -- any thoughts?
I have a topic (a company) that is getting TONS of write-ups in blogs
and I have been chartered to collect them all. When I am doing a
search, I come up with literally thousands of links, many of which are
duplicates, plus ? when I go to the blogs ? I sometimes need to click
on link after link to go down the entire chain of postings.
Here are my questions:
Is there a blog ?clipping service? that would be able to suss this out
for us and collect all the info into a report (or series of reports)?
If not a clipping service, is there a blog search engine or aggregator
that you could recommend that could make this project simpler and less
expensive?
Hope you can help? ;-(((
|
,
0 Comments
)