Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in apache-spark

Why spark tell me “ name 'sqlContext' is not defined ”, how can I use sqlContext?

How to convert JavaPairInputDStream into DataSet/DataFrame in Spark

Why does spark-shell fail with "'""C:\Program' is not recognized as an internal or external command" on Windows?

windows apache-spark

How to zip two array columns in Spark SQL

Spark SQL has no SparkSqlParser.scala file when compiling in intelliJ idea

Spark dataframe save in single file on hdfs location [duplicate]

How do I Convert Array[Row] to DataFrame

Apache Spark (Structured Streaming) : S3 Checkpoint support

How can you parse a string that is json from an existing temp table using PySpark?

Why does posexplode fail with "AnalysisException: The number of aliases supplied in the AS clause does not match the number of columns..."?

Spark 2.3.0 netty version issue: NoSuchMethod io.netty.buffer.PooledByteBufAllocator.metric()

Meaning of Exchange in Spark Stage

How to convert timestamp column to epoch seconds?

'GroupedData' object has no attribute 'show' when doing doing pivot in spark dataframe

Pyspark on yarn-cluster mode

Zeppelin change port already in use by Spark Master

Spark DataFrame: Computing row-wise mean (or any aggregate operation)

join in a dataframe spark java

Add Number of days column to Date Column in same dataframe for Spark Scala App

Unresolved dependency issue when compiling spark project with sbt

scala apache-spark sbt