Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in apache-spark

Is Spark SQL UDAF (user defined aggregate function) available in the Python API?

Why does PySpark fail with random "Socket is closed" error?

apache-spark pyspark

Caching ordered Spark DataFrame creates unwanted job

Spark streaming + Kafka vs Just Kafka

Spark for kubernetes - Azure Blob Storage credentials issue

Websphere MQ as a data source for Apache Spark Streaming

How to integrate Apache Spark with Spring MVC web application for interactive user sessions

ClassNotFoundException: org.apache.spark.SparkConf with spark on hive

hadoop apache-spark hive

pyLDAvis visualization of pyspark generated LDA model

Apache Spark: User Memory vs Spark Memory

KryoException: Buffer overflow with very small input

apache-spark

Submitting jobs to Spark EC2 cluster remotely

amazon-ec2 apache-spark

Do Parquet Metadata Files Need to be Rolled-back?

Spark EC2 SSH connection error SSH return code 255

ssh amazon-ec2 apache-spark

Spark program gives odd results when ran on standalone cluster

How many partitions does Spark create when a file is loaded from S3 bucket?

Structured streaming won't write DF to file sink citing /_spark_metadata/9.compact doesn't exist

Does Spark use data locality?

spark executor lost failure

Apache Spark Streaming, How to handle Downstream dependency failures