Change Iterable[(String, Double)] of an RDD to Array or List

Question

I have an org.apache.spark.rdd.RDD[(String, (Double, Double), Iterable[(String, Double)])] but it seems working with the Iterable is hard. Is there any way I can change it to an Array[(String, Double)]?

Answer 1

You can simply use Iterable.toArray

rdd.map{case (x, y, iter) => (x, y, iter.toArray)}

or Iterable.toList

rdd.map{case (x, y, iter) => (x, y, iter.toList)}