Download a site...
 

Is there a way/program to save a site(links and everything intact) to be used offline?
Would this work with the TFP?
How big do you think the TFP is in Gigs?

there aren't any programs i know of that would work with TFP because it uses cookies, etc.. but there are MANY programs that can be used to simply download everything from a URL, imput url and it just starts to download any and all links from it (better progz have better configs, etc..) but u get the idea

try download.com or something like that

You know, this reminds me of some site I found a while ago operated by some university. They have a seriously massive database cataloging the entire internet for each year, so you can actually go back and see what the internet looked like in say, 1997. I know I posted about it at the http://www.fanimenation.com/ forums a looong time ago. Now I'm going through all the threads to try to find it. :crazy:

depending on how much you're actually trying to save, try going to FILE then SAVE AS.........i know it will save the current page and all graphics on it, not sure if you will be able to do a WHOLE site. this is my second day here and as far as i know TFP is using
some massive space....that TT board is pretty stocked up with graphics.

ah yes..........check this link
http://download.com.com/3000-2381-10...l?tag=lst-0-17

The site that archives the whole internet is www.archive.org

It only catches the front page of TFP. As for saving to disk, I recall Sty saying last week that the database passed the 2GB mark. The problem that you would probably have is that certain information (hidden email addresses in TFP, Admin areas of most sites, etc.) are set to restricted viewing rights. Anything that tried to save everything to disk would get horribly confused by the TFP, and also suck down a whole hell of a lot of bandwidth (which does not make administrators happy. )

MrSelfDestruct: I just started thinking about this because I was rememebering how sad the loss of the last TFP was. Is there a backup system this time? A backup server? The whole thing is only 2 gigs?

Great tip guys thanks

Agreed. Awesome, very useful.

I don't know what I would do in the windows world, but if you can get your hands on a unix running computer (not to hard in these days of linux and free software) the program you want is called curl (wget would also work but not as well for this task) you would need to play with it a little so that it sent the right cookies and post data, but all of that can be done pretty easily through command line options. In theory you could get everything that you have accsess to as a user, it would probably take about 2 hours of fiddleing with to do. The other option is just to ask the admin to send you a copy of the sight ziped up in one big file and then encripted with a public key so you couldn't go rooting around thru private data. Then the admin just needs to find somewhere safe to keep his (private) key and he can recover from you whenever he wants. Aw hell screw public key, he could just use a cypher for it and that would work plenty fine, just never gives you the cypherkey.

Under windows, you can use the Windows port of wget to do something like this.

http://space.tin.it/computer/hherold/

Just read through the manual. The administrators of the forum might not like you much if you tried to download the entire forum, but it should be possible. You can also use rate limiting, and you should be able to save the pictures. Also, if you use Netscape/Mozilla you should be able to use the cookies.txt generated by the browser to allow wget to act as if it is logged in. I am not sure if you can do that with IE.

I use webreaper it is great and it allows you to get the information in threads you only go into the site as deep as you want to.

I don't remember the site I got it from but it was free.

Remember newbies. Most of the images on the titty board are stored on peoples private hosts, so the overall size of the TFP isn't incredibly large. It's big, but it's not terabyte big.

WinHTTrack is free and works well.

it would be cool to have a program like that

I used WebCopier to download a site about Prague to my laptop before I went there. It was very useful in the hotel room.

BUT it took me DAYS of downloading on my broadband. DAYS! The project will not be letting you browse it until it is finnished or you stop it. Beacause not until then will it convert all the links to local links, which again took hours. But it worked, and it took gigs of space. (turned out to include tons of pictures of the local hookers that I could have been without)

NOTE: a lot of owners of sites do not like (understatement) you to use these robot downloaders and may spank you for it. I am not sure that it would be liked if you try to image this site locally... I would not risk my membership here trying. It may be against the rules in the charter if I am not remembering wrong. So ask first!

i use wget

google for it

WinHTTrack website copier is a good one.

http://www.httrack.com

Hell I think Frontpage had a feature like that way back when. Not that I would recommend buying it. I remember using it back in the mid to late 90's sometime.

I could whack ya up something in Perl in about half an hour.