Scala pipelines - DSL for building a DAG workflow

Question

Im curious about the current libraries for Scala & Akka which would allow me to elegantly build a workflow pipeline.

In my case a workflow is just a DAG of operations so actors/Akka feels like a good fit.

My question is what's the best approach? There are Libs like reactive streams which allow really elegant composition of a pipeline but they seem very record focused.

My use case is a flow of operations passing messages between them. Future composition is nice but syntax becomes unwieldy after a while. Maybe there is something better with scalaz and shapeless.

What are the approaches and tools to building a DSL for pipelines of computation steps using message passing?

Answer 1

While still in early development (pre 1.0 as of writing), you should have a look at akka-streams, which are exactly that - a way to describe a computation graph and then run it asynchronously.