Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

OutOfMemoryError when starting hive using beeline

Tags:

hadoop

hive

Issue:

Hive was working from cli , When I am starting hive using beeline :

beeline -u "jdbc:hive2://********:10000/default" -n **** -p **** -d "org.apache.hive.jdbc.HiveDriver"

I am getting the following exception:

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Error: java.io.IOException: com.google.protobuf.ServiceException: java.lang.OutOfMemoryError: GC overhead limit exceeded (state=,code=0)
Beeline version 0.14.0 by Apache Hive

What I tried:

I know restarting the hive service will not solve the purpose, but just gave a try and no luck.

I Tried to clear tmp :

rm -rf *

Now hive cli not also fails to start with the following error :

$ hive
Error creating temp dir in java.io.tmpdir /tmp due to Read-only file system

Any specific hive properties that I need to look into ?

Please guide me. Any help would be appreciated

like image 802
Aditya Avatar asked Sep 04 '26 17:09

Aditya


1 Answers

@Addy, You can try below mentioned solution. It should work for you.

if [ "$SERVICE" = "cli" ]; then
  if [ -z "$DEBUG" ]; then
    export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=12 -Xmx12288m -Xms10m -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:+useParNewGC -XX:-useGCOverheadLimit"
  else
    export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=12 -Xmx12288m -Xms10m -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:-useGCOverheadLimit"
  fi
fi

export HADOOP_HEAPSIZE=2048

For more details you can also visit Cloudera blog for Managing Hive.

like image 163
Bector Avatar answered Sep 07 '26 11:09

Bector



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!