I am trying to wget a large web forum recursively with over 100,000 posts.

The command I am using is quite successful. It logs in and starts
recursively downloading the webpage. I have got upwards of 26,000
posts.

It seems though that after 2-5 hours it starts giving me 400 Bad
Request errors and cycles through the list requesting but not
downloading pages.

Here is the code I am using:
wget post-data 'forceredirect=1&do=login&vb_login_md5password=HEREISTHEHASH&vb_login_username=username&url=/forums/index.php&vb_login_password=&cookieuser=1'
-r --save-cookies cookies.txt --keep-session-cookies -o log.log -N -E
-b -k -R *login.php?do=logout* http://www.SITE.com/forums/login.php




I need a solution or workaround.

Does the site still work ?  You haven't consumed all their bandwidth
ration and they haven't blocked you?

You should have at least been considerate enough to add the wait or
random-wait command line options.

The site has probably blocked you or went down because of your request.

If the website is not down, you can go through a proxy... heck, in
your script, have it go to a random proxy after say... X requests or
so.