Currently changing user_agent by passing different strings to the html_session()
method.
Is there also a way to change your IP address on a timer when scraping a website?
You can use a proxy (which changes your ip) via use_proxy
as follows:
html_session("you-url", use_proxy("proxy-ip", port))
For more details see: ?httr::use_proxy
To check if it is working you can do the following:
require(httr)
content(GET("https://ifconfig.co/json"), "parsed")
content(GET("https://ifconfig.co/json", use_proxy("138.201.63.123", 31288)), "parsed")
The first call will return your IP. The second call should return 138.201.63.123
as ip.
This Proxy was taken from http://proxylist.hidemyass.com/ - no garantees for anything...
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With