I have a table with 1000+ partitions.
"Show partitions
" command only lists a small number of partitions.
How can i show all partitions?
Update:
I found "show partitions
" command only lists exactly 500 partitions.
"select ... where ...
" only processes the 500 partitions!
You can see Hive MetaStore tables,Partitions information in table of "PARTITIONS". You could use "TBLS" join "Partition" to query special table partitions. Show activity on this post.
Say if your hive table size was aprrox 14.8 GB then it will divide the hive table data into 128 MB blocks and will result in 119 Partitions. On the other hand your hive table is partitioned so the partition column has 150 unique values.
The sys. partitions catalog view gives a list of all partitions for tables and most indexes. Just JOIN that with sys. tables to get the tables.
Current Hive versions with RDBMS metastore backend should be able to handle 10000+ partitions.
CLI has some limit when ouput is displayed. I suggest to export output into local file:
$hive -e 'show partitions table;' > partitions
hive> show partitions table_name;
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With