Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Set LogStreamName for AWS Lambda call

We deploy node.js functions onto AWS Lambda. When calling them, they auto-generate an AWS CloudWatch log. The log group is set to the name of the Lambda function, that´s helpful. But the log stream is named like this: 2018/02/14/[$LATEST]794dbaf40a7846c4984ad80ebf110544.

AWS CloudWatch Log Streams

That is not helpful when searching for errors since I need to check multiple log streams, because I do not know which one is the correct one.

Is there any way to define the log stream name, so that it is more readable for a human being?

The node.js code looks similar to this:

exports.handler = function (event, context) {
    console.log('Called "' + context.functionName + '" with AWS-Request-Id "' + context.awsRequestId + '"');
    // do sth. here
};
like image 427
Tobias Avatar asked Feb 14 '18 17:02

Tobias


People also ask

Can we run PHP on Lambda?

Since there's no native support for PHP in Lambda, we'll need to provide the PHP binary for Lambda to use so that we acn execute our custom runtime code.

How do you change the log level in Lambda?

To change the entire log level of microservice Lambda functions, you can update the CloudFormation stack parameter. When you change the Log Level parameter and update the AWS CloudFormation stack, it will automatically deploy the new log level to all AWS Lambda functions.

Can I console log in Lambda?

Using the CloudWatch console You can use the Amazon CloudWatch console to view logs for all Lambda function invocations. Open the Log groups page on the CloudWatch console. Choose the log group for your function (/aws/lambda/ your-function-name ). Choose a log stream.

How do I specify a handler in AWS Lambda?

This function handler name reflects the function name ( lambda_handler ) and the file where the handler code is stored ( lambda_function.py ). To change the function handler name in the Lambda console, on the Runtime settings pane, choose Edit.


2 Answers

Check out the context of your function. It has property context.logStreamName. You could change it to any unique name.

Keep in mind, if you want to append your logs to existed stream, you have to persist its token. It was the reason why I created new log stream for each lambda call. Also, I am using guid for creating stream name (like: reason why log created + guid(), timestamp is ok as well).

Check more details in the next article - The Context Object (Node.js)

EDIT: Don't pay attention to my previous answer. It was completely wrong.

I checked my code how I implemented the same functionality. It isn't possible to change group or stream name from the context. But you could use CloudWatchLogs in your code for putting logs in specific group and stream.

My code:

var AWS = require('aws-sdk');

exports.handler = (event, context, callback) => {
    // TODO implement
    var cloudwatchlogs = new AWS.CloudWatchLogs({ apiVersion: '2014-03-28' });

    // create new stream name for each request
    // because I don't persist sequenceToken
    var logStreamName = "myStreamName" + Math.random()

    var params = {
        logGroupName: 'myLogGroup',
        logStreamName: logStreamName
    };
    cloudwatchlogs.createLogStream(params, function(err, data) {
        if (err) console.log(err, err.stack); // an error occurred
        else {
            var params = {
                logEvents: [{
                        message: 'log message',
                        timestamp: new Date().getTime()
                    },
                    {
                        message: 'one more log message',
                        timestamp: new Date().getTime()
                    }
                ],
                logGroupName: 'myLogGroup',
                logStreamName: logStreamName
            };

            cloudwatchlogs.putLogEvents(params, function(err, data) {
                if (err) console.log(err, err.stack); // an error occurred
                else console.log(data); // successful response
            });
        }
    });
    callback(null, 'Hello from Lambda');
};

Disadvantages of this approach are:

  • Your lambda creates two logGroups and two logStreams in accordance. One of your lambda, another custom. console.log('') writes to lambda log, putLogEvents writes to your custom log (i.e: myStreamName0.10141409975385463). Be aware of this.
  • You have to create manually 'myLogGroup' (how I did) or implement code that will create a logGroup if it doesn't exist.

The result of this testing code looks like: enter image description here

My productions stream names have more sense rather name + random. And they are using guid or timestamp as a suffix. I don't think that it is safe to use random.

like image 109
RredCat Avatar answered Oct 16 '22 19:10

RredCat


You cannot change the Log Stream name. Each running container for your Lambda function logs into a different Log Stream.

If you want to easily see the logs together as one, you can stream them to Amazon ElasticSearch Service so you can use Kibana to browse through your logs or you can use CLI tools like awscli to aggregate and browse them in your terminal.

like image 25
Noel Llevares Avatar answered Oct 16 '22 19:10

Noel Llevares