Google Answers Logo
View Question
 
Q: How to list all web sites/domains with extension .org? ( No Answer,   6 Comments )
Question  
Subject: How to list all web sites/domains with extension .org?
Category: Computers > Internet
Asked by: ericf1-ga
List Price: $4.00
Posted: 18 Dec 2004 05:20 PST
Expires: 17 Jan 2005 05:20 PST
Question ID: 444255
I want to
-have a sort describtion of the web site for each result (1-3 lines)
-able to search by one or multiple key works from the domain name
and/or his description

Request for Question Clarification by pafalafa-ga on 02 Jan 2005 19:58 PST
eric,

There are probably several million .org names at this point -- way
more than can be handled in an easily manageable fashion on a desktop
PC.  Can you tell us what sort of high-end system and software you're
intending to use to manage this truckload of information that you're
asking for...?

Thanks.

pafalafa-ga
Answer  
There is no answer at this time.

Comments  
Subject: Re: How to list all web sites/domains with extension .org?
From: gromy-ga on 18 Dec 2004 12:42 PST
 
To get a list of all the .org domain names, you need to get zone
access from the registry.

http://www.pir.org/registrars/zone_file_access

You will of course need to write your own description of each web
site. I would suggest using a MySQL database with one field for the
domain and the other for the  description. You can then easily search
the database as you describe.

You may find this domain search tool interesting:
http://www.whois.sc/domain-explorer/
Subject: Re: How to list all web sites/domains with extension .org?
From: ericf1-ga on 19 Dec 2004 22:23 PST
 
I don't imaging to write down a description for each web site.
I was wondering if I can get a file (if it is not available on line)
with a description already inlcude.

Concerning the second option (whois), we can make a search only on the
domain name, there is no description neither.  Moreover, we cannot
restrict the result on the .org only.

This solution doesn't meet my requirements.
Subject: Re: How to list all web sites/domains with extension .org?
From: gromy-ga on 25 Dec 2004 23:59 PST
 
There is no requirement for a description in order to register a .org
domain, which is what I was thinking when first responding. Now it
occured to me, you could do the following: create a web crawler to hit
the homepage of each .org registered and record the meta description
in the head of the html page. With a good understanding of PHP and
MySQL you could easily write the code to do this with 1-2 hours of
work. Create the database, upload and insert the list of .org domains.
Then create the crawler to go down the list and hit the homepage and
copy the meta description into the 'description' column of your
database. Searching the database then would be a simple SQL statement
like
SELECT * FROM 'database_table' WHERE domain LIKE '%keyword%'

This will return a list of domains and their corresponding description
where 'keyword' appears anywhere in domain.
Subject: Re: How to list all web sites/domains with extension .org?
From: ericf1-ga on 02 Jan 2005 19:18 PST
 
Since I do not have the skills to do this, how much are you asking to
write this kind of program?
Subject: Re: How to list all web sites/domains with extension .org?
From: gromy-ga on 07 Jan 2005 15:40 PST
 
I'm not interested in doing it. I'd recommend posting on elance.com
and see what people bid on the project.

http://www.elance.com/c/cats/main/categories.pl?catId=10183&type=buyer
Subject: Re: How to list all web sites/domains with extension .org?
From: ericf1-ga on 12 Jan 2005 20:24 PST
 
I found what I was looking for: on the website http://www.alexa.com/
I use as keywork "org" and the "other keyworks" to make my query

In the result, I have information on the website (description and more
than I was expected like ranking, comments, other links...)

Important Disclaimer: Answers and comments provided on Google Answers are general information, and are not intended to substitute for informed professional medical, psychiatric, psychological, tax, legal, investment, accounting, or other professional advice. Google does not endorse, and expressly disclaims liability for any product, manufacturer, distributor, service or service provider mentioned or any opinion expressed in answers or comments. Please read carefully the Google Answers Terms of Service.

If you feel that you have found inappropriate content, please let us know by emailing us at answers-support@google.com with the question ID listed above. Thank you.
Search Google Answers for
Google Answers  


Google Home - Answers FAQ - Terms of Service - Privacy Policy