Skip to content

Instantly share code, notes, and snippets.

@jtg567

jtg567/scrape.py

Last active December 2, 2015 00:14
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save jtg567/16b92b45346cc82d6a38 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save jtg567/16b92b45346cc82d6a38 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. jtg567 revised this gist Dec 2, 2015. 1 changed file with 9 additions and 9 deletions.
    18 changes: 9 additions & 9 deletions scrape.py
    View file
    Original file line number Diff line number Diff line change
    @@ -1,9 +1,9 @@
    from lxml import html
    from selenium import webdriver
    # scrape from mixlr page after js done (element won't exist otherwise)
    driver = webdriver.PhantomJS(executable_path='<replace path>/phantomjs.exe') # another webdriver works fine
    driver.get('http://mixlr.com/<replace username>')
    tree = html.fromstring(driver.page_source)
    air_status = tree.xpath('//*[@id="broadcaster_status"]/span[2]//text()')
    driver.quit()
    from lxml import html
    from selenium import webdriver

    # scrape from mixlr page after js done (element won't exist otherwise)
    driver = webdriver.PhantomJS(executable_path='<replace path>/phantomjs.exe') # another webdriver works fine
    driver.get('http://mixlr.com/<replace username>')
    tree = html.fromstring(driver.page_source)
    air_status = tree.xpath('//*[@id="broadcaster_status"]/span[2]//text()')
    driver.quit()
  2. jtg567 created this gist Nov 30, 2015.
    9 changes: 9 additions & 0 deletions scrape.py
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,9 @@
    from lxml import html
    from selenium import webdriver

    # scrape from mixlr page after js done (element won't exist otherwise)
    driver = webdriver.PhantomJS(executable_path='<replace path>/phantomjs.exe') # another webdriver works fine
    driver.get('http://mixlr.com/<replace username>')
    tree = html.fromstring(driver.page_source)
    air_status = tree.xpath('//*[@id="broadcaster_status"]/span[2]//text()')
    driver.quit()