execute jupyter notebook and keep attached to existing kernel

Question

I know about nbconvert and use it to generate static html or ipynb files with the results output. However, I want to be able to generate a notebook that stays attached to a kernel that I already have running, so that I can do further data exploration after all of the template cells have been run. Is there a way to do that?

Answer 1

Apparently, you can do this through the Python API. I didn't try it myself, but for someone who will be looking for a solution, this PR has an example in the comments:

from nbconvert.preprocessors.execute import executenb, ExecutePreprocessor
from nbformat import read as nbread
from jupyter_client.manager import start_new_kernel

nb = nbread('parsee.ipynb', as_version=4)
kernel_name = nb.metadata.get('kernelspec', {}).get('name', 'python')
km, kc = start_new_kernel(kernel_name=kernel_name)
executenb(nb, kernel=(km, kc))
kc.execute_interactive('a')  # a is a variable defined in parsee.ipynb with 'a = 1'

Answer 2

Not quite sure about your purpose. But my general solutions are,

1. to execute the notebook in command line and see the execution at the same time,

   jupyter nbconvert --debug --allow-errors --stdout --execute test.ipynb

this will show the execute through all cells in debug mode even exception happens. but I can't see the result until the end of the execution.

2. to output the result to a html file, and then open the html file to see the results. I found this is more convenient.

   jupyter nbconvert --execute --allow-errors --stdout test.ipynb >> result.html 2>&1

if you open result.html, it will be,

and all the errors and results will be shown on the page.

I would like to learn other answers/solutions from you all. thank you.