Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Spring boot 2.1.5, WebFlux, Reactor: How to deal properly with MDC

Spring boot 2.1.5 Project Reactor 3.2.9

I am setting up a bunch of rest reactive APIs using the above-mentioned frameworks and I am running into an annoying problem with MDC (mapped diagnostic context). My applications are in JAVA.

MDC relies on thread locals to store the current query's mapped context to put in the logs. That system, obviously, is not perfect and contradicts the reactive pattern since the different steps of your execution will be executed through different threads.

I have run into the same problem with the Play Reactive framework but found a workaround there by copying the mapped context transparently from one actor to another.

For spring and reactor, I could not find a satisfying solution yet.

Some random examples found on the internet:

First - It works but forces you to use a bunch of utility methods

Same thing

Second - It tries to copy the context during the onNext publisher event but seems to lose some features on the way of doing that. The signal context, for example, is lost.

I am in need of a proper solution to deal with this:

  • A library which would make the link between MDC and reactor?
  • A way to tweak reactor/spring to achieve it transparently?
  • Any advice?
like image 700
Arnaud Villevieille Avatar asked Jun 11 '19 05:06

Arnaud Villevieille


People also ask

How can the MDC context be used in the reactive Spring applications?

We can use this technique to include session id, request id or actually any request specific property to each log message outputted during the execution of that specific request. The standard way of using the MDC is to set a context value bounded to a specific key.

Can I use Springmvc and WebFlux together?

both infrastructure will compete for the same job (for example, serving static resources, the mappings, etc) mixing both runtime models within the same container is not a good idea and is likely to perform badly or just not work at all.

Is MDC thread safe?

BTW, MDC is thread-safe. No worrying for concurrency. In multi-thread environment, if the child is create with the basic Thread + Runnable way, the child thread will automatically inherit parent's MDC. But if using executor as thread management.

What is difference between mono and flux?

Mono is more relatable to the Optional class in Java since it contains 0 or 1 value, and Flux is more relatable to List since it can have N number of values.


1 Answers

"I could not find a satisfying solution yet."

Working with contexts is the only solution for the moment. Since as you said threadlocals goes against everything that has to do with reactive programming. Using thread local as a storage point during a request is a resource heavy way of solving things and in my opinion poor design. Unless logging frameworks themselves come up with a better solution to the problem we developers must pass the data through the context to accommodate for the logging frameworks blocking nature.

Reactive programming is a paradigm shift in the programming world. Other things like database drivers, that use threadlocal to rollback transactions are also in big trouble. the JDBC database driver spec is defined as blocking in nature, and atm. there has been attempts by spring and the R2DBC project to define a new JDBC driver spec that is inherently non/blocking. This means that all vendors must rewrite ther database driver implementations from scratch.

Reactive program is so new that lots of libraries need to rewrite entire codebases. The logging frameworks as we know it needs to be rewritten from the ground up which is a huge task. And the context in reactive is actually something that should not even be in reactive programming, it was implemented just to accommodate for MDC problems.

It's actually a lot of overhead needing to pass data from thread to thread.

So what can we do?

  • push on logging frameworks, and/or help logging frameworks to rewrite their codebase
  • Accept that there is no "tweak" that will magically fix this
  • use the context and the way suggested in the blogposts

Project reactor context

like image 90
Toerktumlare Avatar answered Sep 30 '22 16:09

Toerktumlare