How do you determine the number of partitions of an arbitrary RDD in Scala?
I know PySpark RDD has getNumPartitions defined in its API, but I can't locate the equivalent on the Scala side.
At least in Spark 1.6.1 this works
rdd.getNumPartitions()
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With