I want to parse all my logs of nginx (you can see here):
ls /var/log/nginx/
access.log access.log.21.gz error.log.1 error.log.22.gz
access.log.1 access.log.22.gz error.log.10.gz error.log.23.gz
access.log.10.gz access.log.23.gz error.log.11.gz error.log.24.gz
access.log.11.gz access.log.24.gz error.log.12.gz error.log.2.gz
access.log.12.gz access.log.2.gz error.log.13.gz error.log.3.gz
access.log.13.gz access.log.3.gz error.log.14.gz error.log.4.gz
access.log.14.gz access.log.4.gz error.log.15.gz error.log.5.gz
access.log.15.gz access.log.5.gz error.log.16.gz error.log.6.gz
access.log.16.gz access.log.6.gz error.log.17.gz error.log.7.gz
access.log.17.gz access.log.7.gz error.log.18.gz error.log.8.gz
access.log.18.gz access.log.8.gz error.log.19.gz error.log.9.gz
access.log.19.gz access.log.9.gz error.log.20.gz
access.log.20.gz error.log error.log.21.gz
but I don't know how to do that. First of all, it seems like goaccess can't parse .gz files.
What's the best way of parse all the information contained in these logs?
Quoting the man page and assuming you have a Combined Log Format:
If we would like to process all access.log.*.gz we can do one of the following:
# zcat -f access.log* | goaccess --log-format=COMBINED
OR
# zcat access.log.*.gz | goaccess --log-format=COMBINED
On Mac OS X, use gunzip -c
instead of zcat
.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With