Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Using alternative event loop without setting global policy

I'm using uvloop with websockets as

import uvloop
coro = websockets.serve(handler, host, port)  # creates new server
loop = uvloop.new_event_loop()
loop.create_task(coro)
loop.run_forever()

It works fine, I'm just wondering whether I could run to some unexpected problems without setting the global asyncio policy to uvloop. As far as I understand, not setting the global policy should work as long as nothing down there doesn't use the global asyncio methods, but works with the passed-down event loop directly. Is that correct?

like image 604
jhrmnn Avatar asked Jan 04 '23 00:01

jhrmnn


2 Answers

There are three main global objects in asyncio:

  • the policy (common to all threads)
  • the default loop (specific to the current thread)
  • the running loop (specific to the current thread)

All the attempts to get the current context in asyncio go through a single function, asyncio.get_event_loop.

One thing to remember is that since Python 3.6 (and Python 3.5.3+), get_event_loop has a specific behavior:

  • If it's called while a loop is running (e.g within a coroutine), the running loop is returned.
  • Otherwise, the default loop is returned by the policy.

Example 1:

import uvloop
asyncio.set_event_loop_policy(uvloop.EventLoopPolicy())
loop = asyncio.get_event_loop()
loop.run_forever()

Here the policy is the uvloop policy. The loop returned by get_event_loop is a uvloop, and it is set as the default loop for this thread. When this loop is running, it is registered as the running loop.

In this example, calling get_event_loop() anywhere in this thread returns the right loop.

Example 2:

import uvloop
loop = uvloop.new_event_loop()
asyncio.set_event_loop(loop)
loop.run_forever()

Here the policy is still the default policy. The loop returned by new_event_loop is a uvloop, and it is set as the default loop for this thread explicitly using asyncio.set_event_loop. When this loop is running, it is registered as the running loop.

In this example, calling get_event_loop() anywhere in this thread returns the right loop.

Example 3:

import uvloop
loop = uvloop.new_event_loop()
loop.run_forever()

Here the policy is still the default policy. The loop returned by new_event_loop is a uvloop, but it is not set as the default loop for this thread. When this loop is running, it is registered as the running loop.

In this example, calling get_event_loop() within a coroutine returns the right loop (the running uvloop). But calling get_event_loop() outside a coroutine will result in a new standard asyncio loop, set as the default loop for this thread.

So the first two approaches are fine, but the third one is discouraged.

like image 62
Vincent Avatar answered Jan 06 '23 14:01

Vincent


Custom event loop should be passed as param

If you want to use custom event loop without using asyncio.set_event_loop(loop), you'll have to pass loop as param to every relevant asyncio coroutines or objects, for example:

await asyncio.sleep(1, loop=loop)

or

fut = asyncio.Future(loop=loop)

You may notice that probably any coroutine/object from asyncio module accepts this param.

Same thing is also applied to websockets library as you may see from it's source code. So you'll need to write:

loop = uvloop.new_event_loop()
coro = websockets.serve(handler, host, port, loop=loop)  # pass loop as param

There's no guarantee that your program would work fine if you won't pass your event loop as param like that.

Possible, but uncomfortable

While theoretically you can use some event loop without changing policy I find it's extremely uncomfortable.

  • You'll have to write loop=loop almost everywhere, it's annoying

  • There's no guarantee that some third-party would allow you to pass loop as param and won't just use asyncio.get_event_loop()

Base on that I advice you to reconsider your decision and use global event loop.

I understand that it may be felt "unright" to use global event loop, but "right" way is to pass loop as param everywhere is worse on practice (in my opinion).

like image 37
Mikhail Gerasimov Avatar answered Jan 06 '23 15:01

Mikhail Gerasimov