I would like to download all pdf files linked on a website using wget on Mac OS (zsh).
I have tried:
wget -r -p -k --random-wait --limit-rate=50k -A .pdf -erobots=off https://unfccc.int/process-and-meetings/bodies/constituted-bodies/executive-committee-of-the-warsaw-international-mechanism-for-loss-and-damage-wim-excom/task-force-on-displacement/implementation-updates-task-force-on-displacement\#eq-1
and I have also added the following options to no avail:
--span-hosts
--no-check-certificate
--no-cookies
-H
The error is always the same:
no-follow attribute found in unfccc.int/process-and-meetings/bodies/constituted-bodies/executive-committee-of-the-warsaw-international-mechanism-for-loss-and-damage-wim-excom/task-force-on-displacement/implementation-updates-task-force-on-displacement. Will not follow any links on this page
-e robots=off
not-erobots=off
? Although it doesn't work either way for me. This may help bitbucket.org/intgr/pub/wiki/… But I myself stumbled on downloading the correct html.