When you get results from google, you get results that looks like this
(from actual google results on word "example":
===
Example Web Page
You have reached this web page by typing "example.com", "example.net",
or "example.org" into your web browser. These domain names ...
example.org/ - 1k - Cached - Similar pages
====
I want to have you write a script for a search robot that does the following:
1. search a term
2. strip out the domain names of all the results hits, only the domain
name -- for example on the above hit -- example.org --
from the above results. If there were a thousand domains in a
results, I want all 1000 domains stripped out.
3. save each unique domain names only to a file on my PC.
Obviously, you want to use the Google API if it provides this, and I
assume it does since it has knowledge of the domain name. And this
robot needs to run from a Windows client PC, not a server, so it must
use a client-supported technology -- such as VB, C++, VB script,
javascript, etc. but not Perl, ... I would be open to PHP.
I want to then import that file into Excel or mySQL or MS Access to
research further, for instance, do a whois search for contact info.
No, I won't call or e-mail them, I just want to conduct market
research on certain things.
I want to be able to also eliminate duplicate domain names, so the
robot must have a memory of names that it has already scraped and
saved. |
Clarification of Question by
author20-ga
on
28 Feb 2004 18:14 PST
Hi,
I tried to price a script development project, but found a few open
source packages that do the trick.
But no way are they as good as the one you are describing. My budget
for this was to be timed for the delivery of a softwar p;ackage, in 2
to 3 weeks.
I would be glad to pay you $50 in 3 payments over 5 weeks, for the
delivery of the softwar program now.
Or I could give you one payment of $30 now. I have a perfect payment
record on ebay, and pay on elance promptly (even if some of the
programmers deliver rotten code).
If you opted for 3 payments over 5 weeks, I could give $20 tonight,
$10 in 2 weeks and $10 in five weeks. I sold all my stuff to complete
a sofotware project and start my company. I'm eating out of garbage
cans in back of McDonalds to launch a major web site, and I need to
target a market by domain.
Only certain market, it is a perfect application for the commercial
tool. I will pay, just lay it on me now.
|
Request for Question Clarification by
pafalafa-ga
on
28 Feb 2004 19:15 PST
Hello again author20-ga,
Thanks for getting back to me so quickly. It sounds like the software
I mentioned really hit the bullseye, which is great. But I don't
quite understand what you're asking of me now, though.
If I answer your question now by posting the information, you will be
charged the current price of the question -- $50. Of course, you
don't actually *pay* it until your credit card bill comes due, which
is presumably some weeks hence.
Do you want me to answer the question as it is currently set-up --
with a $50 price tag????
You seem to have something else in mind, but I'm not sure what.
There's no way for customers and researchers to communicate with one
another -- or to make/receive a payment -- other than here on the
pages of Google Answers.
Let me know how you would like to proceed on this, and I'll try my
best to accomodate your needs.
Thanks.
pafalafa-ga
|
Request for Question Clarification by
pafalafa-ga
on
03 Mar 2004 16:18 PST
Hello again.
Well, it turns out there are some freeware packages to extract URL's,
but I'm not sure they'll do everything you'll need. The packages
don't come with detailed documentation, and take some playing around
with to really figure them out. I'm not sure, for instance, whether
they remove duplicates, like the commercial software does.
Tell you what. Please re-price your question at the amount you think
you can best afford, and I'll post an answer with what I've learned.
When all is said and done, you may decide you can live with the
freeware, or you may need the commercial software, which you can use
for free for a while anyway, before paying for it to get the full
license.
|
