I want to execute JavaScript's function in Python-Scrapy, before, i used Selenium, but Selenium is too much slow for scraping the big sites.
I would like to know what's the best alternative for selenium for executing js in Scrapy?
Splash - A javascript rendering service
Splash is a javascript rendering service with an HTTP API. It's a lightweight browser with an HTTP API, implemented in Python using Twisted and QT.
It's fast, lightweight and state-less which makes it easy to distribute.
Bonus points for it being developed by the same guys who are developing Scrapy.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With