we have a software application which shows ads when people browse with
it. We would like to make sure that it does not show ads on adult
sites. We therefore need a reliable list of hard core adult sites
which we can load into our software program and are convinced that
such a list is available on the web. We already know about DMOZ but
are looking for something more consistent and reliable than that.

---

Clarification of Question by kentert-ga on 28 Apr 2004 12:36 PDT

so to refine the question - if there is no url list, might there be an
open source filter as suggested by politicalguru-ga below?

---

Request for Question Clarification by pafalafa-ga on 28 Apr 2004 12:45 PDT

I wouldn't go so far as to say there aren't such blacklists (I don't
think politicalguru-ga meant to imply that either).  It's just that
such lists are a continually moving target, and need to be frequently
updated.

One such list -- that is updated regularly, as far as I know -- is here:

http://www.jayallen.org/comment_spam/blacklist.txt

Is this the sort of thing you're looking for?

pafalafa-ga

---

Clarification of Question by kentert-ga on 28 Apr 2004 13:45 PDT

I am looking for either:
1) an open source filter which we can integrate into our application
to identify adult sites with a high degree of certainty
2) an extensive list of adult urls which is not complete but which is
accurate for those urls which it contains

Why not snip all the .com's, .net's, etc from all your results and
only use that in your application?  Sure, there's
hardcoreadultstuff.com today, but why not anticipate
hardcoreateadultstuff.net, .org, and .sex?

A list such as this is impossible: "adult" sites are opening and
closing all the time, sometimes because of the ethical and legal
problems they pose to their hosts. Search engines and programmes such
as "Net Nanny" (see a little about them at "Web Filtering programmes"
http://www.childwelfare.com/kids/webfilt.htm) use usually a
combination of language and image patterns which they cosider to be of
"adult" content, which is the only affective way. Maybe you could use
one of these programmes, or find an open-source filter.