Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Is there a way to transpose data in Hive

This is my table:

pid     high    medium    low
1       10      8         6
2       20      16        12
3       10      6         4

I want store this data in another table in Hive with the following format:

pid      priority      value
1         high          10 
1         medium        8
1         low           6
2         high          20
2         medium        16
2         low           12
3         high          10
3         medium        6
3         low           4
like image 862
priyanka Avatar asked May 25 '16 12:05

priyanka


1 Answers

Yes there is a way to do this in Hive. You just need to create a map and then explode said map.

Query:

CREATE TABLE db.new AS
SELECT pid, priority, value
FROM (
  SELECT pid
    , MAP('high', high, 'medium', medium, 'low', low) AS tmp
  FROM db.old ) x
LATERAL VIEW EXPLODE(tmp) explode_table AS priority, value

Output:

---------------------
pid  priority  value
---------------------
1    low       6
1    medium    8
1    high      10
2    low       12
2    medium    16
2    high      20
3    low       4
3    medium    6
3    high      10
like image 116
o-90 Avatar answered Oct 21 '22 06:10

o-90