Python log analysis tool/library

Question

I'm looking for a tool/library written in python similar with logstash (ruby + java).

My goals are:

• parse all system logs from syslog
• parse application specific logs (apache, django, mysql etc.)
• store results in something like elasticsearch
• graph results based on different criteria

thanks!

ps: regexes are a way to go but I feel will be quite of work to start from scratch

Answer 1

Shameless plug (I am the author of the library) - logtools does everything you mentioned and much, much more. I try to keep the documentation up to date and show alot of examples, similar to use cases you describe, in the README file. hopefully it would fit what you have in mind, give it a try, and any feedback is welcome - I try to add/fix any issues brought up by users. Check it out at http://github.com/adamhadani/logtools or download latest stable release at https://pypi.python.org/pypi/logtools