I need to find a specific website, which may be on a dead server,
however the address is all I need.

I have a few PDF Files of what the site is.  It is hidden from all Web
Crawler Bots so I need to find a program that searches the web for a
site that matches the documents I have and which also disobeys the
ROBOTS.txt files placed in websites.

A link to point me in the right direction of such a program, or how to
write it would be extremely helpful.

Thanks

Own Research:

NOT A Site Search Engine

LIKE ://www.google.com/bot.html
     http://www.forestsoftware.co.uk/crawlers.html
     http://www.velocityscape.com

The Wayback Machine may be a way to go (www.archive.org)...it grabs
copies of websites and stores them so you can go back and look at old
content/designs.

Thanks wil try that, however if I am right in thinking then this
website will hide itself even from that.