koiralo

koiralo has asked 4 questions and find answers to 111 problems.

Stats

About

Shankar Koirala (LinkedIn)

koiralo questions

How to deduplicate messages while streaming kafka using Spark Streaming?
Spark Streamming : Reading data from kafka that has multiple schema
How to construct Dataframe from a Excel (xls,xlsx) file in Scala Spark?

koiralo answers

How to find the time difference between 2 date-times in Scala?
Rolling up multiple rows into a single row and column in spark
to_json not working with selectExpr in spark
Spark Java - Merge same column multiple rows
Differences between query with SQL and without SQL in SparkSQL
Why Spark creates multiple csv files while saving a dataframe in csv format?
get multiple columns within a map: rdd
Use groupby or aggregate to merge items in each transaction in RDD or DataFrame to do FP-growth
Scala - filter out null values in a Array[Map[String,Int]]
Comparing two array columns in Scala Spark