himanshuIIITian

himanshuIIITian has asked 14 questions and find answers to 19 problems.

Stats

About

enter image description here

himanshuIIITian questions

Getting MatchError when using a placeholder for an unused variable
How to mock an Akka Actor to Unit Test a class?
Why dataset.count() is faster than rdd.count()?
Why do overridden variables get the wrong values in Scala?
Read all Parquet files saved in a folder via Spark
Empty output for Watermarked Aggregation Query in Append Mode
Not able to import Spark Implicits in ScalaTest
Why do we need to add "fork in run := true" when running Spark SBT application?

himanshuIIITian answers

Spark Dataset: Filter if value is contained in other dataset
sbt - object apache is not a member of package org
How to map struct in DataFrame to case class?
Load a file from SFTP server into spark RDD
Read parquet into spark dataset ignoring missing fields [duplicate]
How to handle white spaces in dataframe column names in spark
How can I print nulls when converting a dataframe to json in Spark
How to use a subquery for dbtable option in jdbc data source?
Stop Structured Streaming query gracefully
Read from Kafka and write to hdfs in parquet