Spark dataframe get column value into a string variable

Question

I am trying extract column value into a variable so that I can use the value somewhere else in the code. I am trying like the following

 val name= test.filter(test("id").equalTo("200")).select("name").col("name") 

It returns

 name org.apache.spark.sql.Column = name 

how to get the value?

Answer 1

The col("name") gives you a column expression. If you want to extract data from column "name" just do the same thing without col("name"):

val names = test.filter(test("id").equalTo("200"))                 .select("name")                 .collectAsList() // returns a List[Row] 

Then for a row you could get name in String by:

val name = row.getString(0)