Questions
Linux
Laravel
Mysql
Ubuntu
Git
Menu
HTML
CSS
JAVASCRIPT
SQL
PYTHON
PHP
BOOTSTRAP
JAVA
JQUERY
R
React
Kotlin
×
Linux
Laravel
Mysql
Ubuntu
Git
New posts in apache-spark
Why does sortBy transformation trigger a Spark job?
Oct 15, 2022
apache-spark
rdd
partitioning
partitioner
Error initializing SparkContext: A master URL must be set in your configuration
Nov 13, 2022
scala
apache-spark
k-means
Does Spark preserve record order when reading in ordered files?
Aug 19, 2022
apache-spark
Convert spark dataframe to Array[String]
Sep 09, 2022
scala
apache-spark
spark-dataframe
Reading data from Azure Blob with Spark
Sep 25, 2022
java
azure
apache-spark
azure-blob-storage
spark-streaming
Understanding Spark RandomForest featureImportances results
Mar 02, 2022
apache-spark
classification
random-forest
apache-spark-mllib
collect() or toPandas() on a large DataFrame in pyspark/EMR
Apr 14, 2022
pandas
apache-spark
pyspark
emr
amazon-emr
Spark: JavaRDD<Tuple2> to JavaPairRDD<>
Oct 30, 2022
java
mapreduce
apache-spark
How to create a Row from a List or Array in Spark using Scala
Sep 11, 2022
scala
apache-spark
apache-spark-sql
How to find out the amount of memory pyspark has from iPython interface?
Nov 07, 2022
memory
configuration
apache-spark
pyspark
Spark Submit fails with java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;
Dec 23, 2017
java
maven
apache-spark
cassandra-2.0
Apache Spark: What is the equivalent implementation of RDD.groupByKey() using RDD.aggregateByKey()?
May 02, 2022
apache-spark
rdd
pyspark
How to name file when saveAsTextFile in spark?
Oct 24, 2022
apache-spark
pyspark
rdd
How to access broadcasted DataFrame in Spark
Oct 26, 2022
scala
apache-spark
Spark Streaming from Kafka has error numRecords must not be negative
Apr 21, 2022
apache-spark
apache-kafka
spark-streaming
mesos
Get the max value for each key in a Spark RDD
Oct 24, 2022
python
apache-spark
pyspark
rdd
Scala and Spark UDF function
Sep 07, 2022
scala
apache-spark
apache-spark-sql
apache-zeppelin
Structured Streaming exception when using append output mode with watermark
Nov 17, 2022
java
apache-spark
spark-structured-streaming
How to know the number of Spark jobs and stages in (broadcast) join query?
Sep 28, 2022
apache-spark
apache-spark-sql
What is the =!= operator in Scala?
Oct 21, 2022
scala
apache-spark
« Newer Entries
Older Entries »