Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in apache-spark-sql

How to add multidimensional array to an existing Spark DataFrame

pyspark high performance rolling/window aggregations on timeseries data

count rows in Dataframe Pyspark

How to split column on the first occurrence of a string?

Privileges for spark sql with sentry

Spark SQL on ORC files doesn't return correct Schema (Column names)

How to GroupBy Spark DataFrame with my Equality Comparators?

Remove nested column in PySpark

How to transform Dataset[(String, Seq[String])] to Dataset[(String, String)]?

DESCRIBE with LIMIT in spark sql

Why my count,Distinct and count of Distinct count is very slow in huge cluster in spark

Spark extract nested JSON array items using purely SQL-query

apache-spark-sql

How to convert from Pandas' DatetimeIndex to DataFrame in PySpark?

SparkSQL: not found value expr

Adding new column using other existing columns Spark/Scala

more efficient way to get monthly counts in Python/Pyspark

Glue - An error occurred while calling getDynamicFrame