Server closes after pika.exceptions.StreamLostError: Stream connection lost

Question

I have some images in my queue and I pass each image to my flask server where processing on images is done and a response is received in my rabbitmq server. After receiving response, I get this error "pika.exceptions.StreamLostError: Stream connection lost(104,'Connection reset by peer')". This happens when rabbitmq channel again starts consuming the connection. I don't understand why this happens. Also I would like to restart the server again automatically if this error persists. Is there any way to do that?

Answer 1

Your consume process is probably taking too much time to complete and send Ack/Nack to the server. Therefore, server does not receive heartbeat from your client, and thereby stops from serving. Then, on the client side you receive:

pika.exceptions.StreamLostError: Stream connection lost(104,'Connection reset by peer')

You should see server logs as well. It is probably like this:

missed heartbeats from client, timeout: 60s

See this issue for mor information.

Answer 2

Do your work on another thread. See this code as an example -

https://github.com/pika/pika/blob/master/examples/basic_consumer_threaded.py

---

_{NOTE: the RabbitMQ team monitors the rabbitmq-users mailing list and only sometimes answers questions on StackOverflow.}