12

This was marked off-topic but left on Stack Overflow in case someone else has this same question.

This may be out of scope but I was curious to know if you could scrape a Angular JS website?

If you can can someone point me to some good resources? I did some R & D but could not find any useful resources besides Phantom JS

2
  • 2
    I'm not sure if you figured a solution to do this but the simplest answer is to use phantomjs which is a headless browser that let's you script and fetch data using css selectors and do anything you want with it. phantomjs.org Let me know if you need further help. P.S I'm not sure how this was voted off-topic. Nov 9, 2016 at 17:29
  • Possible duplicate of stackoverflow.com/questions/35050746/… Jul 28, 2018 at 23:08

1 Answer 1

3

The simplest answer to this question is yes, it is possible, but not using traditional bots that only look at the raw textual content that they'd get in the HTTP response body and don't really interpret what a typical browser running JavaScript would see. Google does it (as of May 2014): http://googlewebmastercentral.blogspot.com/2014/05/understanding-web-pages-better.html

If you have a bot that parses javascript and allows the normal http xhr requests to go out and get the actual data that populates a SPA, you can scrape an Angular site.

1

Not the answer you're looking for? Browse other questions tagged or ask your own question.