Jump to content

Httrack Multiple Site Download


Recommended Posts

I could be wrong, but I don't believe Httrack can download multiple sites at once.

I had gone through the Httrack documentation, and I am fraid but it doesn't mention much about downloading multiple websites.


Link to comment
Share on other sites

Just use wget, feed it a text file of sites to spider, tell it how many links deep to spider each site, where to store the output and what file types(can just mirror/download everything if you really wanted to), and be sure to give it a decent user agent. Tools like HTTrack and wget in general, many people block the user agent alone, so be sure to fake one. Personally, I like wget. Works well, and cross platform. Help file is easy to follow. Wget also has file resume too, so if you get a timeout for downloading too fast or whatever, can restart, and pick up where you left off.

Edited by digip
Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Create New...