Skip to content

Instantly share code, notes, and snippets.

@HollyBang
Created November 13, 2017 11:11
Show Gist options
  • Select an option

  • Save HollyBang/2ada11ce00ba8c9e518a4eb5a76431ff to your computer and use it in GitHub Desktop.

Select an option

Save HollyBang/2ada11ce00ba8c9e518a4eb5a76431ff to your computer and use it in GitHub Desktop.
const puppeteer = require('puppeteer');
let scrape = async () => {
const browser = await puppeteer.launch({headless: false});
const page = await browser.newPage();
await page.goto('http://books.toscrape.com/');
await page.click('#default > div > div > div > div > section > div:nth-child(2) > ol > li:nth-child(1) > article > div.image_container > a > img');
await page.waitFor(1000);
const result = await page.evaluate(() => {
let title = document.querySelector('h1').innerText;
let price = document.querySelector('.price_color').innerText;
return {
title,
price
}
});
browser.close();
return result;
};
scrape().then((value) => {
console.log(value); // Success!
});
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment