0

I have a script which allows to retrieve all sorts of information of a given url: JsFiddle

As you can see the meta content is derived from the 'baseUrl' (at the begining of the script). There is also a div (#links) for all the a href on that page (baseUrl). My question: How do I get the meta content of the links instead of the baseUrl?

1 Answer 1

0

What your script is doing is loading the main page and parsing out the data. In order to get the meta tags on the linked urls you need to basically run the script again with the link URLs instead of just your baseUrl. If you loop this indefinitely, you have basically built a web crawler.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.