Menu
I am looking for a full list of User-Agents of BOTS (crawlers, spiders, twitter bots, etc).
Do you know anything?
Thanks
457
It is easy to tell a bot from how it glides and lands. Some bots tail players lading in a hot drop area, while some bots drop in remote places across the map. The bots generally land 20 -30 seconds after the real players land. Bots also dive and glide straight and often land on the outskirts of a POI.
Web engineers can look directly at network requests to their sites and identify likely bot traffic. An integrated web analytics tool, such as Google Analytics or Heap, can also help to detect bot traffic.
There is absolutely no way to know with certainty if a request came from a browser or something else making an HTTP request. The HTTP protocol allows for the client to set the User Agent arbitrarily.
Check this list: http://www.botsvsbrowsers.com/category/1/index.html
It contains a total number of 4768 bot user agents.
The other way around to accomplishing bot detection is to use the reverse approach in a white-list way, that is, check if the user agent is not a bot, then anything else is a bot. :-)
To compile a comprehensive list of non bot user agents you can use the lists at http://www.user-agents.org/ and http://www.botsvsbrowsers.com/.
124
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
