0

I am looking for an automatable way to download the contents of a web page after the client-side javascript app has finished loading all the divs. I know I can do this by saving the site through browser GUI, but I am looking for a solution on the command line or some other scripting method.

Things I have tried: curl, wget

Anyone have suggestions?

3
  • Could you explain why curl and wget could not get the job done? wget should be able to do this with the -p -k options. Mar 19, 2015 at 20:24
  • @KompjoeFriek neither of these tools capture the divs loaded by the client side scripts, they only return the source to run the js app
    – oiiio
    Mar 21, 2015 at 18:36
  • Ok, i did not understand that you wanted to include the client-side generated content. Mar 21, 2015 at 19:08

1 Answer 1

0

I've already answered to the matter of running client-side scripts on (or prior to) content load. If using python, you might try PyV8 plugin.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.