95thcobra Posted October 17, 2012 Share Posted October 17, 2012 dear hak5 um i was wondering if you guys know of a way to make httrack download multiple sites at once thank you Quote Link to comment Share on other sites More sharing options...
Infiltrator Posted October 17, 2012 Share Posted October 17, 2012 I could be wrong, but I don't believe Httrack can download multiple sites at once. I had gone through the Httrack documentation, and I am fraid but it doesn't mention much about downloading multiple websites. http://www.httrack.com/html/fcguide.html Quote Link to comment Share on other sites More sharing options...
aPices Posted October 17, 2012 Share Posted October 17, 2012 Httrack is great but not the only program of its kind. While it does have some multi-threading it's not as advanced as say PageNest, which does offer a multiple site download option. It's only for Windows, however works fine using wine. Here is a list of more offline browser/web archivers Quote Link to comment Share on other sites More sharing options...
digip Posted October 18, 2012 Share Posted October 18, 2012 (edited) Just use wget, feed it a text file of sites to spider, tell it how many links deep to spider each site, where to store the output and what file types(can just mirror/download everything if you really wanted to), and be sure to give it a decent user agent. Tools like HTTrack and wget in general, many people block the user agent alone, so be sure to fake one. Personally, I like wget. Works well, and cross platform. Help file is easy to follow. Wget also has file resume too, so if you get a timeout for downloading too fast or whatever, can restart, and pick up where you left off. Edited October 18, 2012 by digip Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.