koiralo

koiralo has asked 4 questions and find answers to 109 problems.

Stats

About

Shankar Koirala (LinkedIn)

koiralo questions

How to deduplicate messages while streaming kafka using Spark Streaming?
Spark Streamming : Reading data from kafka that has multiple schema
How to construct Dataframe from a Excel (xls,xlsx) file in Scala Spark?

koiralo answers

to_json not working with selectExpr in spark
Spark Java - Merge same column multiple rows
Differences between query with SQL and without SQL in SparkSQL
Why Spark creates multiple csv files while saving a dataframe in csv format?
get multiple columns within a map: rdd
Use groupby or aggregate to merge items in each transaction in RDD or DataFrame to do FP-growth
Scala - filter out null values in a Array[Map[String,Int]]
Comparing two array columns in Scala Spark
Does persist() on spark by default store to memory or disk?
Change Data Types for Dataframe by Schema in Scala Spark