Httrack Multiple Site Download

[95thcobra]

dear hak5 um i was wondering if you guys know of a way to make httrack download multiple sites at once

thank you

[Infiltrator]

I could be wrong, but I don't believe Httrack can download multiple sites at once.

I had gone through the Httrack documentation, and I am fraid but it doesn't mention much about downloading multiple websites.

http://www.httrack.com/html/fcguide.html

[aPices]

Httrack is great but not the only program of its kind. While it does have some multi-threading it's not as advanced as say PageNest, which does offer a multiple site download option. It's only for Windows, however works fine using wine.

Here is a list of more offline browser/web archivers

[digip]

Just use wget, feed it a text file of sites to spider, tell it how many links deep to spider each site, where to store the output and what file types(can just mirror/download everything if you really wanted to), and be sure to give it a decent user agent. Tools like HTTrack and wget in general, many people block the user agent alone, so be sure to fake one. Personally, I like wget. Works well, and cross platform. Help file is easy to follow. Wget also has file resume too, so if you get a timeout for downloading too fast or whatever, can restart, and pick up where you left off.

Edited October 18, 2012 by digip