Skip to content

Feature Request: Download web site(s) + Use existing assets (Action) #113

Description

@mpheyse

I would like to see a new action that is that same as "Download web site(s)" but will use (and not re-download) any non-cache files existing locally.

I'm working with a particularity slow server, and all the pages are in a single CGI and I'm getting lots of errors and problems etc.

The non HTML 'files' are the bulk of the data, take the most time to download (days) and are not my major error source.

The thing I'm noticing is that repairing (continue) an existing site download is more error prone (breaks pages that were working) than a fresh new download as I work through the mostly undocumented errors.

So What I would like to do is make a run fresh "Download web site(s)" on a clean directory, but prepopulate it with all the .jpg .zip .dat files I've already downloaded 4 times already. And as the new run hits an existing on disk file, in the right place with the correct name, it accepts it as-is and doesn't re-download it.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions