Spark: Convert/concat an WrappedArray of Row to a String

Question

I have a Spark dataframe with column that has array<struct<_1:long,_2:string>> datatype and following sample data:

WrappedArray([Value,Title1], [Value,Title2], [Value,Title3])

I want to convert this column from WrappedArray to a single String

Here is the desired output:

Value+Title1,Value+Title2,Value+Title3

I tried the following udf passing that column of the dataframe:

val f = (x:Seq[Row]) => x.mkString(",")
sqlContext.udf.register("f", f)

But the result is [Value,Title1],[Value,Title2],[Value,Title3]

flyhighzy · Accepted Answer · 2017-07-30 07:59:42Z

3

try this:

val f = (x:Seq[Row]) => x.map(row => "%s+%s".format(row.getString(0), 
row.getString(1))).mkString(",")

answered Jul 30, 2017 at 7:59

flyhighzy

7001 gold badge5 silver badges8 bronze badges

Sign up to request clarification or add additional context in comments.

1 Answer 1