Python multi-line with statement

Question

What is a clean way to create a multi-line with in python? I want to open up several files inside a single with, but it's far enough to the right that I want it on multiple lines. Like this:

class Dummy:     def __enter__(self): pass     def __exit__(self, type, value, traceback): pass  with Dummy() as a, Dummy() as b,      Dummy() as c:     pass 

Unfortunately, that is a SyntaxError. So I tried this:

with (Dummy() as a, Dummy() as b,       Dummy() as c):     pass 

Also a syntax error. However, this worked:

with Dummy() as a, Dummy() as b,\      Dummy() as c:     pass 

But what if I wanted to place a comment? This does not work:

with Dummy() as a, Dummy() as b,\      # my comment explaining why I wanted Dummy() as c\      Dummy() as c:     pass 

Nor does any obvious variation on the placement of the \s.

Is there a clean way to create a multi-line with statement that allows comments inside it?

Answer 1

As of Python 3.10, it is now possible to parenthesize the whole group of context managers, as you originally tried:

with (Dummy() as a, Dummy() as b,       # comment about c       Dummy() as c):     pass 

This is also technically possible in 3.9, but in a sort of semi-documented limbo.

On one hand, it's documented as new in 3.10, 3.9 wasn't supposed to introduce any features (like this one) that depend on the new parser implementation, and the 3.9 with docs forbid this form. On the other hand, the functionality ended up getting activated in the 3.9 CPython implementation, and the (mostly?) auto-generated 3.9 full grammar spec includes the parenthesized form.

---

On previous Python 3 versions, if you need to intersperse comments with your context managers, I would use a contextlib.ExitStack:

from contextlib import ExitStack  with ExitStack() as stack:     a = stack.enter_context(Dummy()) # Relevant comment     b = stack.enter_context(Dummy()) # Comment about b     c = stack.enter_context(Dummy()) # Further information 

This is equivalent to

with Dummy() as a, Dummy() as b, Dummy() as c: 

This has the benefit that you can generate your context managers in a loop instead of needing to separately list each one. The documentation gives the example that if you want to open a bunch of files, and you have the filenames in a list, you can do

with ExitStack() as stack:     files = [stack.enter_context(open(fname)) for fname in filenames] 

If your context managers take so much screen space that you want to put comments between them, you probably have enough to want to use some sort of loop.

---

As Mr. Deathless mentions in the comments, there's a contextlib backport on PyPI under the name contextlib2. If you're on Python 2, you can use the backport's implementation of ExitStack.

---

Incidentally, the reason you can't do something like

with (         ThingA() as a,         ThingB() as b):     ... 

before the new parser implementation is because a ( can also be the first token of the expression for a context manager, and CPython's old parser wouldn't be able to tell what rule it's supposed to be parsing when it sees the first (. This is one of the motivating examples for PEP 617's new PEG-based parser.

Answer 2

Python 3.9+ only:

with (     Dummy() as a,     Dummy() as b,     # my comment explaining why I wanted Dummy() as c     Dummy() as c, ):     pass 

Python ≤ 3.8:

with \     Dummy() as a, \     Dummy() as b, \     Dummy() as c:     pass 

Unfortunately, comments are not possible with this syntax.