Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

hive update lastAccessTime

Tags:

hive

I wanted to update lastAccessTime on hive table ,After google in the web,I get a solution :

set hive.exec.pre.hooks = org.apache.hadoop.hive.ql.hooks.UpdateInputAccessTimeHook$PreExec; 

But If I have two database A & B the hive sql:

 set hive.exec.pre.hooks = 
    org.apache.hadoop.hive.ql.hooks.UpdateInputAccessTimeHook$PreExec;
    use A;
    insert overwrite A.xxx
    select  c1,c2 from B.xxx;

hive returned me

org.apache.hadoop.hive.ql.metadata.InvalidTableException(Table not found B.xxx

like image 328
user3065606 Avatar asked Jan 29 '26 06:01

user3065606


2 Answers

To retrieve a table's 'LastAccessTime', run the following commands through the Hive shell, replacing [database_name] and [table_name] with the relevant values.

    use [database_name];
    show table extended like '[table_name]';

This will return several metrics including the number of milliseconds (rather than the number of seconds) elapsed since Epoch. To format that number as a string representing the timestamp of that moment in the current system's time zone, remove the last three digits from the number and run it through the following command:

    select from_unixtime([last_access_time]);
like image 166
Stephane Bottine Avatar answered Feb 02 '26 07:02

Stephane Bottine


I happen to want the same effect. Take sometime and finnaly make it; your method is right.Just the value mastters;

<property>
   <name>hive.security.authorization.sqlstd.confwhitelist.append</name>
   <value>hive\.exec\.pre\.hooks</value>
</property>

<property>
   <name>hive.exec.pre.hooks</name>
  <value>org.apache.hadoop.hive.ql.hooks.UpdateInputAccessTimeHook$PreExec</value>
</property>

If still not working ,maybe your hive has a bug HIVE-18060UpdateInputAccessTimeHook fails for non-current database. fixed in CDH5.15 CDH 5.15.0 Release Notes if you use cdh .

like image 38
xfly Avatar answered Feb 02 '26 06:02

xfly



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!