Consider the following Spark SQL query, which uses higher-or…
Consider the following Spark SQL query, which uses higher-order functions:spark.sql(“””SELECT id, transform(values, x -> x * 2) AS doubled_values, filter(values, x -> x > 3) AS filtered_values, exists(values, x -> x % 2 = 0) AS has_even, reduce(values, 0, (acc, x) -> acc + x) AS total_sumFROM dataset;”””).show()Which statements are correct? (Select two answers)
Read Details