1

After going through a few tutorials, I've managed to serve up jsdom and express with a few lines of code and scraping the landing page of any url in the jsdom environment.

However, I can't seem to find any documentation on following through pages and links for further scraping.

2 Answers 2

0

There's no recursive setting in jsdom. Just get all links from the top-level page and issues those that are within the same domain for new scrapes (recursively)

-1

try https://github.com/rc0x03/node-promise-parser

follow all links on example.com:

pp('example.com')
.find('a')
.follow('@href')
0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.