Native logging module not printing to stdout in AzureML

Question

I am trying to use the standard logging module in my AzureML run but nothing gets printed out to stdout.

I tried following instructions from here but I have not been successful.

This is what I am running:

import logging

logging.basicConfig(level=logging.DEBUG)

logger = logging.getLogger(__name__)

logger.info('WHY IS THIS NOT WORKING?')

Am I doing something wrong?

Answer 1

stdout is generally redirected to a log file called "70_driver_log.txt", and with no configuration a local run submission should honor the basicConfig and you should see the output there.

You can fetch the logs from the UI or by streaming the logs in the SDK via run.wait_for_completion(show_output=True)

This is the link to the UI screenshot (but don't have the rep to post an image): driver log in the ML studio

Answer 2

Following piece of code worked for me. I guess, setting the handler is the key here.

import logging

handler = logging.StreamHandler()
logger = logging.getLogger(__name__)
logger.addHandler(handler)
logger.setLevel(logging.INFO)

More detailed response as well alternative approach about the issue can be found here.