Questions
Linux
Laravel
Mysql
Ubuntu
Git
Menu
HTML
CSS
JAVASCRIPT
SQL
PYTHON
PHP
BOOTSTRAP
JAVA
JQUERY
R
React
Kotlin
×
Linux
Laravel
Mysql
Ubuntu
Git
New posts in apache-spark
Spark-HBASE Error java.lang.IllegalStateException: unread block data
Dec 21, 2021
apache-spark
hbase
apache-spark-sql
How to add a typesafe config file which is located on HDFS to spark-submit (cluster-mode)?
Jul 06, 2021
hadoop
apache-spark
hdfs
typesafe
Is it possible to run spark yarn cluster from the code?
Feb 21, 2019
java
apache-spark
hadoop-yarn
Persisting data to DynamoDB using Apache Spark
Nov 12, 2022
apache-spark
amazon-dynamodb
apache-spark-sql
amazon-emr
spark-dataframe
Merge multiple RDD generated in loop
Sep 08, 2022
scala
apache-spark
rdd
Spark not leveraging hdfs partitioning with parquet
Aug 28, 2022
hadoop
apache-spark
hdfs
parquet
bigdata
Efficiency of flatMap vs map followed by reduce in Spark
Oct 15, 2022
scala
apache-spark
mapreduce
rdd
flatmap
How access individual element in a tuple on a RDD in pyspark?
Apr 05, 2022
python
apache-spark
pyspark
rdd
Can a model be created on Spark batch and use it in Spark streaming?
Nov 12, 2022
apache-spark
machine-learning
spark-streaming
How to save RandomForestClassifier Spark model in scala?
Jun 24, 2019
scala
apache-spark
apache-spark-mllib
How can I declare a Column as a categorical feature in a DataFrame for use in ml
Dec 05, 2021
python
apache-spark
pyspark
apache-spark-ml
Passing Python functions as objects to Spark
Mar 08, 2019
python
apache-spark
pyspark
How to run spark shell with *local* packages?
Aug 24, 2022
maven
apache-spark
packages
Spark shows different number of cores than what is passed to it using spark-submit
Sep 15, 2022
apache-spark
Convert GraphFrames ShortestPath Map into DataFrame rows in PySpark
Apr 18, 2021
python
apache-spark
pyspark
spark-dataframe
graphframes
'Symbol lookup error' with netlib-java
Feb 02, 2017
java
apache-spark
java-native-interface
fedora
blas
Spark Streaming from Kafka Consumer
Oct 19, 2022
apache-spark
apache-kafka
pyspark
spark-streaming
kafka-consumer-api
Spark explode nested JSON with Array in Scala
Jun 27, 2022
arrays
json
scala
apache-spark
explode
Spark: out of memory when broadcasting objects
Oct 24, 2022
apache-spark
out-of-memory
What type should I declare a DateTime object in a scala class constructor?
Sep 05, 2022
scala
apache-spark
cassandra
« Newer Entries
Older Entries »