Questions tagged [puppeteer]

Puppeteer is a Node.js library which provides a high-level API to control headless Chrome or Chromium over the DevTools Protocol. It can also be configured to use full (non-headless) Chrome or Chromium.

Filter by
Sorted by
Tagged with
0 votes
0 answers
15 views

Does login with Instagram use session ID still exist?

Currently, I'm trying to learn Puppeteer on Node.js to access an Instagram account page without using a username and password for login. I believe that if I continuously attempt to log in with my ...
ferdinand's user avatar
  • 325
0 votes
1 answer
32 views

Generating Images from a Complex DOM (Including iframes)

I'm working on an application (am owner) similar to Canva (wouldn't be a competitor), where the "canvas" is constructed of standard DOM elements instead of the HTML canvas element. I'm ...
Joshua Arnold's user avatar
0 votes
0 answers
16 views

How I can pass the Cloudflare checkbox with Puppeteer?

I would like to connect to a website with Puppeteer, but I am blocked by the Cloudflare checkobx of this website. even if I check it manually, the page is refreshed and I return to the checkbox. but I ...
ilyess bougataya's user avatar
-1 votes
1 answer
16 views

is it possible to have 2 different puppeteer instances connected to the same browser? [closed]

I'm trying to have 2 different puppeteer instances connected to the same browser and each manage a different tab (just run different scripts on each tab). it has to be 2 different instances I cannot ...
Amit Morad's user avatar
0 votes
0 answers
7 views

My question is that after opning a tab with puppeteer in want to opne a devtools and after that i want to perform a keybord shortcut 'ctrl+shift+c'

In my puppeteer project after opening a tab, I want to press F12 to open dev tools and after that I want to perform another keyboard shortcut Ctrl+Shift+C to inspect elements. I also have another ...
Yogesh Ahir's user avatar
0 votes
0 answers
18 views

How to get the header of an XHR page using puppeteer

I am no knowledge about puppeteer. I try to retrive header content (such as cookie, Referer etc.) of a specific url (not the page in goto, but the page retrive by XHR). Anyone can give me a tip for ...
chris wu's user avatar
0 votes
0 answers
17 views

How to get the context of an iframe (google payframe) using puppeteer

So basically I'm testing the adyen drop-in googlepay integration, for this I need to login, follow a link to the page with the gpay button, click it and then in the appearing popup I need to click the ...
Alex's user avatar
  • 49
0 votes
1 answer
46 views

What wrong in Puppeteer technology, why most site show another view on directly browsing and browsing with Puppeteer?

I do checked a serious of sites directly and with Puppeteer with that code How can I capture all network requests and full response data when loading a page in Chrome? Starting from https://www....
Alex's user avatar
  • 387
0 votes
0 answers
33 views

Puppeteer - Hotel website will not load for webscraping

Background: I am trying to webscrape a hotel website (normal hyatt and that website loads normally when I go to that URL (as expected). Problem: However, when I use Puppeteer to access that website, ...
Nelson Mak's user avatar
0 votes
0 answers
14 views

Puppeteer to fill username password details on the alert dialog

I am using puppeteer for taking screenshots for some sites periodically. These sites require login before entering which i did for the few sites where html content is loaded by examining the input ...
Dhiresh Budhiraja's user avatar
0 votes
0 answers
22 views

Is there a way to set a custom certificate in puppeteer?

The site requires special certificates, I need to register them for the browser, I can't use standard requests, because I need JS async def main(): browser = await launch(options={'...
pigs never look back's user avatar
1 vote
0 answers
28 views
+50

puppeteer / spatie/Browsershot click a specific attribute

I'm working with spatie/Browsershot to fill a web form. I'm able to get past the first page: Browsershot::url('https://www.homedepotrebates11percent.com/#/home') ->newHeadless() -&...
dfeva's user avatar
  • 41
0 votes
0 answers
27 views

Unable to generate PDF with A/3 compliance when font-awesome icons (PUA unicodes) are used (missing actualText)

We are using puppeteer to generate a PDF from a HTML template, when this template contains font-awesome icons it fails the validation to PDF-A/3 standards. Step to reproduce: (1) Set an HTML template/...
xenope's user avatar
  • 33
2 votes
2 answers
37 views

I am using in puppeeter an evaluate and I try to pass a function to it, I am getting "myFunction is not a function" [duplicate]

Basically, I have a function: const parseToNumber = (inputString) => { const cleanedString = inputString.replace(/[^0-9a-zA-Z]+/g, ''); const numberValue = parseInt(cleanedString); return ...
yavgz's user avatar
  • 305
-1 votes
2 answers
56 views

Puppeteer - Grabbing Distance from Hotel Website

Problem: I cannot grab the distance (kilometers or miles - depending on where you live), e.g. 25.9. Wyndham hotel website I either grab a whole bunch of text that is not consistent or I grab empty ...
Nelson Mak's user avatar
0 votes
0 answers
15 views

Does a given Puppeteer version download the same Chrome version every time?

I have an NPM install where I am installing the Mermaid CLI. I want to fix all NPM package versions, including Puppeteer, such that they are installed via a package-lock.json file. Now, when Puppeteer ...
bmitc's user avatar
  • 357
1 vote
0 answers
27 views

Puppeteer - Search Results page doesn't load consistently

Problem: I am trying to use Puppeteer to webscrape a hotel website but the search results do not load consistently. Does the website have some anti-webscraping defences? Code: const puppeteer = ...
Nelson Mak's user avatar
0 votes
0 answers
17 views

Can I have a way to get URL from user and use it in page.goto function in Puppeteer in Node js project? [closed]

I am trying to automate a web page mainly, will be scraping the content from webpage, but the challenge here is the webpage should be based on URL provided by USER. Want to have a UI where in user ...
Sudhi's user avatar
  • 1
1 vote
1 answer
34 views

How to print HTML on different PDF pages using Puppeteer

I am using puppeteer in a NodeJS backend for generation of PDF reports. I have HTML code, and I need certain portions of the code to be printed on separate pages. For example, If I have <div><...
Shubhanshu Singh's user avatar
-1 votes
0 answers
14 views

Puppeteer giving previous tab data

I have a table with different rows, once you click a row it opens a table inside the page. I retrieve the data I need with example, id='my_id' then close the tab, and in the table select the next row ...
Peet Stander's user avatar
0 votes
0 answers
47 views

ERROR: Failed to set up Chrome r116.0.5845.96

I am using node.js for a project where I need a headless browser I am using "puppeteer": "21.2.1", in my pakcage.json I am using pnpm for pnpm install every thing is working fine ...
yaminoyuki's user avatar
0 votes
0 answers
37 views

How to save Json response on puppeteer JS

We can launch browser in controlled environment on Node.js for example: const puppeteer = require('puppeteer'); (async () => { const browser = await puppeteer.launch({ headless: true })...
Alex's user avatar
  • 387
0 votes
0 answers
31 views

Puppeteer-generated PDF is displaying weird characters after writing it to S3

I'm reading HTML files directly from an AWS S3 bucket using Node.js and opening them with Puppeteer to convert them into PDFs. However, the PDFs generated from this process are displaying strange ...
Alireza Bashiri's user avatar
2 votes
1 answer
84 views

Puppeteer - How to manipulate slider or slider value

Problem: On this hotel website wyndham, I am trying to change the aria-valuemax of the class ui-slider-handle to 200 but I cannot target it. My attempts: Minimal reproducible code: const puppeteer = ...
Nelson Mak's user avatar
0 votes
0 answers
22 views

puppeteer, Is it possible not to close the browser after exiting the node process?

Please tell me, is it possible not to close the browser after exit nodejs process and connect to it? In Selenium, this is possible using chromedriver const connectedBrowser = await puppeteer....
evil pixi's user avatar
0 votes
0 answers
12 views

why can't I use previously defined variables inside a $eval?

In this example I have error that user and password are not defined. await page.$eval('input[type="email"', el => el.value = user); await page.$eval('input[type="password"', el =...
yavgz's user avatar
  • 305
0 votes
0 answers
14 views

how to check if an html element exists using puppeeter? is it necessary to use waitForSelector?

I currently visit some urls, in some there is a selector and in others not, if there is a certain selector in this case <table> I want some action to be done. try { await page_table....
yavgz's user avatar
  • 305
0 votes
0 answers
50 views

"Fixing Puppeteer Node.js Error: TargetCloseError - Protocol error (Network.enable) - Target closed

I've created a web scraper using Puppeteer in Node.js. However, when I run the program, I encounter the following error: TargetCloseError:Protocolerror(Network.enable):Targetclosed. I've noticed that ...
Oleksandr's user avatar
2 votes
1 answer
21 views

What happened to Puppeteer's BrowserFetcher?

At the moment, all documentation for createBrowserFetcher and BrowserFetcher stands removed. I haven't been following the development of puppeteer, so don't know what happened. Can anyone point me in ...
Snehanshu Phukon's user avatar
0 votes
0 answers
22 views

AWS Cloudwatch Canary - Nodejs puppeteer - searching for text in XML output

I have built a cloudwatch canary using the gui, it has generated some code for me which I have adapted. The idea is simply to query a web page which returns back some XML that looks like this: <...
Martin W's user avatar
  • 372
0 votes
0 answers
26 views

Header is not repeating in pdf generation for second page in C# code

'I am using below code for header template and it's breaking in the second page. Attached screen shot below. [1st page header looks good] (https://i.stack.imgur.com/9lfZI.png) [2nd page header is ...
Jagan Microsoft's user avatar
0 votes
0 answers
16 views

Puppeteer: Network.response received is missing initial redirects, traffic when opened on the new tab

The use case I'm trying to cover is to read all the traffic from each tab. I'm not controlling the tab page creation and users can create tabs at any time by clicking. Listeners set on the page level ...
Alex_Alex's user avatar
  • 199
0 votes
0 answers
27 views

Having issues using puppeteer and jsdom to parse the HTML of a website

I am currently trying to create a javascript program that will parse the HTML from a webpage and then take each HTML tag put it into array so I can further select it for processing. I am using ...
ecurtis28's user avatar
0 votes
1 answer
61 views

Puppeteer - Cannot Target Checkbox on Hotel Website

Problem: Using Puppeteer, I cannot click Available Hotels check-box in hotel website (https://www.wyndhamhotels.com/hotels/chicago-il-usa?brand_id=HR&checkInDate=10/31/2023&checkOutDate=11/5/...
Nelson Mak's user avatar
0 votes
0 answers
20 views

Whatsappwebjs heroku with RemoteAuth is not working

I am trying to use the RemoteAuth option in WhatsAppWebJS, and it works perfectly fine on my local machine. However, when it comes to deploying it on Heroku, I encounter an issue. The QR code is ...
Mutti's user avatar
  • 13
0 votes
0 answers
133 views

Puppeteer old Headless deprecation warning:

const bot = require("puppeteer"); const fs = require("fs"); const botConfiguration ={ headless:false, executablePath:"C:/Program Files/Google/Chrome/Application/chrome.exe&...
jaytheblogger's user avatar
1 vote
1 answer
39 views

How to fix issue that deprecated 'page.waitForTimeout' method usage

I made a web scraping script using the NodeJS puppeteer package based on TypeScript. I used await page.waitForTimeout(3000); method to delay the script running until page loading. This function works ...
Dev Conductor's user avatar
0 votes
2 answers
44 views

Puppeteer Save PDF to absolute path

I am attempting to convert a HTML file to PDF using Puppeteer and I want to save the converted PDF file absolutely to the root. (I am using MacOS btw). export const HTML_PATH = path.resolve( "/...
Codex's user avatar
  • 11
-2 votes
0 answers
41 views

Get dimensions of base64 image in C#

I'm using PuppeteerSharp. And I have base64 string of image. How can I get image dimensions (width and height) by this base64 string? So, I'm using Linux, and system doesn't support System.Drawing....
user467566's user avatar
-4 votes
0 answers
44 views

Puppeteer bypasses this advanced protection

I'm trying to bypass a non-standard custom-coded Cloudflare protection. However, despite using all the fingerprint extensions and taking all precautions, it still detects that I'm a bot. I've found a ...
TAKAHIRO MINAMI's user avatar
0 votes
2 answers
27 views

Puppeteer not showing all the elements in terminal - Node JS web scraping [duplicate]

I am trying to scrape the products in the below amazon URL https://www.amazon.in/gp/browse.html?node=4092115031&ref_=nav_em_sbc_tvelec_gaming_consoles_0_2_9_12 I this URL the product list items ...
gopinath krm's user avatar
0 votes
0 answers
31 views

How to remove table breaking from puppeteer pdf

I'm generating a pdf using node js and puppeteer. I'm facing the issue of table break in my pdf because of page length and table length. If there is any possible way to avoid this issue please help ...
Shubhanshu Singh's user avatar
0 votes
0 answers
13 views

Getting browser scraping errors post migration to NodeJS 16 and new aws chrome errors

I recently upgraded from nodejs 12 to nodejs 16.For that I had to switch from https://github.com/alixaxel/chrome-aws-lambda/tree/v3.1.1 to https://github.com/Sparticuz/chrome-aws-lambda/tree/puppeteer%...
Abhijeet Kushe's user avatar
1 vote
2 answers
44 views

Remove about:blank and date-time from pdf in puppeteer

const { params } = request.body; const GENERATE_UUID = uuidv4(); const path = `generated/letter_list_${GENERATE_UUID}.pdf`; const browser = await puppeteer.launch({ ...
Shubhanshu Singh's user avatar
0 votes
0 answers
17 views

Puppeteer Error: Error: Execution context was destroyed, most likely because of a navigation

I am trying to build a small API that uses Puppeteer to navigate to a website, logs in, and collects some data for me. However, when testing my initial try, I keep getting an error that says Puppeteer ...
Alex Dodd's user avatar
0 votes
2 answers
21 views

Evaluation failed: ReferenceError occurs when call evaluate function

When you call evaluate in puppeteer, an error occurs as follows. 'Evaluation failed: ReferenceError: cov_mjds8ir32 is not defined' also 'page.$eval' occurs same error page = await browser.newPage(); ...
chois's user avatar
  • 1
0 votes
1 answer
46 views

Puppeteer page.on loaded evaluate

How do you properly pass the puppeteer page to the page.on('load' or page.on('domontentloaded events? do{ var page = await browser.newPage(); page.on('domcontentloaded', async () => { page....
Steve Payne's user avatar
0 votes
1 answer
37 views

How to click a random span element with Puppeteer

I am trying to automate a bot to randomly select a tool/ link on my page "KRC SEO TOOLS" with all the same span elements each time the page is been loaded or refreshed. I have tried so many ...
Julian Singh's user avatar
0 votes
0 answers
10 views

Puppeter, stop/start proxy in the middle of running

i have a program that consumes way too much data on proxies, so i was wondering if i could use a proxy just in the moment of an important block of instructions and then turn it off after that I haven'...
MR Movi's user avatar
0 votes
1 answer
38 views

Puppeteer - Cannot target specific drop-down menu element

Problem: I am trying to use Puppeeteer to use await page.click(<ELEMENT>); to change the currency in the drop down menu of a website ihg hotel. I am getting Error: Node is either not clickable ...
Nelson Mak's user avatar

1
2 3 4 5
156