Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Send heroku logs to s3

Does anyone know a free Heroku add-on for archiving heroku logs on S3 AWS? I used Loggly add-on but it is not free anymore. So I'd like to find an alternative.

I can see there are flyData and logentries Has anyone used those? Any feedback on them? I would appreciate everyone's thoughts.

Thanks in advance.

like image 792
Sergey Avatar asked Sep 24 '14 12:09

Sergey


People also ask

Can you store logs in S3?

To begin the export process, you must create an S3 bucket to store the exported log data. You can store the exported files in your Amazon S3 bucket and define Amazon S3 lifecycle rules to archive or delete exported files automatically.

Does Heroku store logs?

It retains the most recent 1,500 lines of your consolidated logs, which expire after 1 week. For more production-ready persistence of logs, add one of the Heroku platform's available logging add-ons to your app.

What is S3 Heroku?

Amazon Simple Storage Service (S3) is a durable and available store, ideal for storing application content like media files, static assets, and user uploads. Storing static files elsewhere is crucial for Heroku apps since dynos have an ephemeral filesystem.


1 Answers

Have you tried PaperTrail?

It looks like it does what you're trying to do for free.

Archives

Papertrail automatically creates compressed log archive files on a daily or hourly basis. These are downloadable in Papertrail under Archives. Archives are retained for 1 year with all paid plans or 1 week with the free “choklad” plan. Additionally, Papertrail can upload these archives to an S3 bucket in your own Amazon Web Services account. See “Account” to provide a bucket. Each archive contains all logs in a tab-separated values (TSV) format. In addition to being human-readable, the TSVs are simple to parse or import into a data warehouse like Redshift or Hive/Hadoop on Elastic MapReduce.

like image 87
slocumro Avatar answered Oct 19 '22 02:10

slocumro