I would like to crawl a website, the problem is, that its full of JavaScript things, such as buttons and such that when they are pressed, they do not change the URL, but the data on the page is changed.
Usually I use LWP / Mechanize etc to crawl sites, but neither support JavaScript. any idea?
Another option might be Selenium with WWW::Selenium module
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With