Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in apache-spark

Serialization Exception on spark

Error in accessing cassandra from spark in java: Unable to import CassandraJavaUtil

Why does Spark job fails to write output?

apache-spark

How to solve SPARK-5063 in nested map functions

java nested apache-spark

Apache Spark architecture

apache-spark hdfs bigdata

How to vectorize DataFrame columns for ML algorithms?

How to sort RDD

scala sorting apache-spark rdd

How to create a connection to a remote Spark server and read in data from ipython running on local machine?

How to read json data using scala from kafka topic in apache spark

how to specify consumer group in Kafka Spark Streaming using direct stream

How to assign and use column headers in Spark?

Spark: difference when read in .gz and .bz2

apache-spark rdd gzip bz2

Why python UDF returns unexpected datetime objects where as the same function applied over RDD gives proper datetime object

pyspark.sql.utils.IllegalArgumentException: u'java.net.UnknownHostException: user'

hadoop apache-spark pyspark

Apache Spark reads for S3: can't pickle thread.lock objects

How to use double pipe as delimiter in CSV?

scala apache-spark

Is it possible to subclass DataFrame in Pyspark?

How to handle white spaces in dataframe column names in spark

org.apache.spark.rpc.RpcTimeoutException: Futures timed out after [120 seconds]. This timeout is controlled by spark.rpc.lookupTimeout

How to split multi-value column into separate rows using typed Dataset?