Menu
Where can I download documentation for Spark? Although its available as web-pages, it will be much easier to have it attached to source in Eclipse.
I know it is not a strictly programming question, but I cannot think of any other place to ask this question.
720
Spark does not have its system to organize files in a distributed way(the file system). For this reason, programmers install Spark on top of Hadoop so that Spark's advanced analytics applications can make use of the data stored using the Hadoop Distributed File System(HDFS).
Huge Demand For Spark Experts Today, there are well over 1,000 contributors to the Apache Spark project across 250+ companies worldwide. Some of the biggest and fastest growing companies use Spark to process data and enable downstream analytics and machine learning.
Spark stores data in RDD on different partitions. They help with rearranging the computations and optimizing the data processing. They are also fault tolerance because an RDD know how to recreate and recompute the datasets. RDDs are immutable.
You can use wget to download the spark latest document.
mkdir spark_latest_docs
cd spark_latest_docs
wget -m -p -E -k -K -np https://spark.apache.org/docs/latest/
open ./spark.apache.org/docs/latest/index.html
Reference: https://stackoverflow.com/a/21875199/3907204
197
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
