Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in apache-spark

Missing hive dependency issues with Apache Iceberg

Include Hortonworks respository in Spring Boot executable jar

How to generate a jar file that is able to run on Java 1.7, with sbt and Java 1.8

java scala apache-spark sbt

spark data frame converting row values into column name

Spark workflow with jar

apache-spark

Spark read CSV - Not showing corroupt Records

Specify Parquet properties pyspark

Spark error: "ERROR Utils: Exception while deleting Spark temp dir:"

How do I write HDF5 files from Apache Spark?

apache-spark hdf5

Do I need to use "mergeSchema" option in spark with parquet if I am passing in a schema explicitly?

apache-spark parquet

Adding a Column to Spark Table via SQL ALTER TABLE command

How to use long user ID in PySpark ALS

Query spark on JSON object stored on Cassandra DB

difference between spark.executor.memoryOverhead and spark.memory.offHeap.size

apache-spark memory jvm

spark-shell - How to avoid suppressing of elided stack trace (Exceptions)

BSON structure created by Apache Spark and MongoDB Hadoop-Connector

How to read a csv file from s3 bucket using pyspark