Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How do I make the join between two streams on Spark structured streaming? - Java 8

I know, join between two streams is not supported yet. But there's a way to do it anyway? Or I need to wait for Spark 2.2.0? Thank you

like image 761
Aniello Guarino Avatar asked Oct 17 '22 13:10

Aniello Guarino


1 Answers

Spark 2.2.0 still won't support stream-stream join. You can watch this ticket: https://issues.apache.org/jira/browse/SPARK-18791

like image 111
zsxwing Avatar answered Oct 21 '22 06:10

zsxwing