Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in apache-spark

Does Spark supports melt and dcast [duplicate]

Spark ML Pipeline throws exception for Random Forest classification: Column label must be of type DoubleType but was actually IntegerType

Why inconsistent results using subtraction in reduce?

scala apache-spark

What is the difference between spark.task.cpus and --executor-cores

How to modify/transform the column of a dataframe?

Why result of Spark reduceByKey is not consistent

scala hadoop apache-spark

Count of List values in spark - dataframe

Use library in Spark-shell

scala apache-spark

PySpark - Are Spark DataFrame Arrays Different Than Python Lists?

Spark schema from case class with correct nullability

Difference between translate and regexp_replace

Joining more than 2 Tables In Spark SQL

Scala String Variable Substitution

Reading multiple csv files at different folder depths

How to replace elements of a breeze matrix in Scala based on some condition?

Why Spark ML ALS algorithm print RMSE = NaN?

Getting a date x days back from a custom date in Scala

scala apache-spark

How to create DataFrame with nulls using toDF?

Using custome UDF withColumn in a Spark Dataset<Row>; java.lang.String cannot be cast to org.apache.spark.sql.Row

Spark job fails on java 9 NumberFormatException for input string ea

java scala apache-spark java-9