Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Is it correct to convert a CompletableFuture<Stream<T>> to a Publisher<T>?

Tags:

To allow multiple iterations on the resulting stream from a CompletableFuture<Stream<String>> I am considering one of the following approaches:

  1. Convert the resulting future to CompletableFuture<List<String>> through: teams.thenApply(st -> st.collect(toList()))

  2. Convert the resulting future to Flux<String> with cache: Flux.fromStream(teams::join).cache();

Flux<T> is the implementation of Publisher<T> in project reactor.

Use case:

I would like to get a sequence with the premier league teams names (e.g. Stream<String>) from a data source which provides a League object with a Standing[] (based on football-data RESTful API, e.g. http://api.football-data.org/v1/soccerseasons/445/leagueTable). Using AsyncHttpClient and Gson we have:

CompletableFuture<Stream<String>> teams = asyncHttpClient     .prepareGet("http://api.football-data.org/v1/soccerseasons/445/leagueTable")     .execute()     .toCompletableFuture()     .thenApply(Response::getResponseBody)     .thenApply(body -> gson.fromJson(body, League.class));     .thenApply(l -> stream(l.standings).map(s -> s.teamName)); 

To re-use the resulting stream I have two options:

1. CompletableFuture<List<String>> res = teams.thenApply(st -> st.collect(toList()))  2. Flux<String> res = Flux.fromStream(teams::join).cache() 

Flux<T> is less verbose and provides all that I need. Yet, is it correct to use it in this scenario?

Or should I use CompletableFuture<List<String>> instead? Or is there any other better alternative?

UPDATED with some thoughts (2018-03-16):

CompletableFuture<List<String>>:

  • [PROS] The List<String> will be collected in a continuation and when we need to proceed with the result of the future, maybe it is already completed.
  • [CONS] Declaration verbosity.
  • [CONS] If we just want to use it once, then we did not need to collect those items in a List<T>.

Flux<String>:

  • [PROS] Declaration conciseness
  • [PROS] If we just want to use it once, then we can omit .cache() and forward it to the next layer, which can take advantage of the reactive API, e.g. web flux reactive controller, e.g. @GetMapping(produces =MediaType.TEXT_EVENT_STREAM) public Flux<String> getTeams() {…}
  • [CONS] If we want to reuse that Flux<T> we have to wrap it in a cacheable Flux<T> (….cache()) which in turn will add overhead on the first traversal, because it has to store the resulting items in an internal cache.
like image 707
Miguel Gamboa Avatar asked Mar 09 '18 22:03

Miguel Gamboa


Video Answer


1 Answers

    CompletableFuture<Stream<String>> teams = ...;     Flux<String> teamsFlux = Mono.fromFuture(teams).flatMapMany(stream -> Flux.fromStream(stream)); 

Flux.fromStream(teams::join) is a code smell because it's blocking a thread to fetch the result from the CompletableFuture which is running on another thread.

like image 166
youhans Avatar answered Oct 22 '22 19:10

youhans