I am trying to attain Woolworth specials data from this website: "https://www.woolworths.com.au/shop/catalogue" However, I can't seem to extract the specific class information I am after. Examples include: 'sf-pricedisplay', 'shelfProductStamp-imageTagsContainer' and etc. They are contained within a container. I believe this information may be generated dynamically.
Would anyone be able to help me with this?
from bs4 import BeautifulSoup
import requests
page = requests.get("https://www.woolworths.com.au/shop/catalogue#view=catalogue2&saleId=28314&areaName=NSW&page=3")
soup = BeautifulSoup(page.content, 'html.parser')
print(soup.find_all('div', class_='shop-content')) # This works.