Stream: helpdesk (published)

Topic: Download all files in a URL

view this post on Zulip Júlio Hoffimann (Apr 06 2021 at 16:27):

How do you usually download all files in a folder from a URL?

For example, I would like to download the folder 2000 in this URL: http://www.dpi.inpe.br/prodesdigital/dadosn

Is there a nice way of achieving this using Julia v1.6 Downloads stdlib?

view this post on Zulip Andrey Oskin (Apr 06 2021 at 16:46):

I usually parse response with Gumbo/Cascadia and then just broadcast download/urldownload command

view this post on Zulip Júlio Hoffimann (Apr 06 2021 at 16:50):

I will try to do the same. I was just wondering if there is a convenient method ready for use.

view this post on Zulip Sascha Mann (Apr 06 2021 at 16:59):

wget can download entire directories like that. I don't know the exact parameters it needs but I've used it for that purpose in the past.

view this post on Zulip Andrey Oskin (Apr 06 2021 at 17:09):

Yes, wget is awesome

Last updated: Oct 02 2023 at 04:34 UTC