Settings

Theme

Do not use Selenium for web scraping

buklijas.info

5 points by sasa_buklijas 7 years ago · 2 comments

Reader

snaky 7 years ago

> The only exception that I could see for using Selenium as web scraping tool is if a website that you are scraping is using JavaScript to get/display data that you need to scrape.

Like 95% of web sites?

  • sasa_buklijasOP 7 years ago

    Scrapy does have the solution for JavaScript with Splash, but I have never used it, so far I always found some workaround.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection