Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Guidelines to set MetaspaceSize - java 8

What is the default value of MetaspaceSize for 64-bit servers? I couldn't find it in the official documentation.

I'm observing that in a server JVM process, at times, the GC frequency becomes high and keeps growing. If I restart the service a few times, it returns to stable. I think its due to the JRE upgrade.

JVM Heap max size is set to be 6GB but when this problem occurs, we see only 3GB heap being used. Metaspace grows by very little and is almost always full. I tried increasing the metaspace to 1GB and it improves the throughput.

I think what is happening is Metaspace by default is set to a very low value and thus GC kicks in. High water mark is continuously increased(again by a very low amount) every time a GC occurs.

I want to set the MetaspaceSize (not sure what is the current value).

Oracle docs say there are no guidelines to know what to set MetaspaceSize to. But is there a way to find out what would be the correct value to set it to?

One hint I got from Oracle docs is this:

If the committed space available for class metadata as a percentage of the total committed space for class metadata is greater than MaxMetaspaceFreeRatio, then the high-water mark will be lowered. If it is less than MinMetaspaceFreeRatio, then the high-water mark will be raised.

But still not able to figure out how to stabilize the GCs..I have three questions:

  1. What is the default MetaspaceSize on 64 bit servers?
  2. What are the default ratios: MaxMetaspaceFreeRatio, MinMetaspaceFreeRatio set to? Answer: It shows Min is 40, Max is 70
  3. How to go about deciding oon a Metaspacesize value?
like image 747
A.R.K.S Avatar asked Apr 07 '16 01:04

A.R.K.S


People also ask

How do I increase Metaspace size in Java 8?

Use the option -XX:MaxMetaspaceSize to put an upper limit on the amount of native memory used for class metadata."

What is Java Metaspace size?

Metaspace is introduced in Java 8 and default size of it is unlimited(limited to physical memory) with dynamic growth.

Do we have PermGen in Java 8?

In Java 8, PermGen method area replaced with MetaSpace. They have moved permGem to the separate memory in the native OS and that is called MetaSpace. It can by default auto increases its size. In MetaSpace, classes can load and unload during the lifespan of the JVM.

What is Metaspace in Java 8 How does it differ from PermGen space || PermGen vs Metaspace?

Simply put, Metaspace is a new memory space – starting from the Java 8 version; it has replaced the older PermGen memory space. The most significant difference is how it handles memory allocation. Specifically, this native memory region grows automatically by default.


2 Answers

MetaspaceSize is the value when a Full GC will be triggered, its not initial space nor maximum space.

The default value for it is 20MB (at least on jdk-8 to jdk-13):

java -XX:+PrintFlagsFinal -version | grep MetaspaceSize

will produce:

size_t MetaspaceSize = 21807104 // 20MB

This means that when Metaspace reaches 20MB a Full GC will be triggered and if you can avoid it, that would be good.

Considering how much data metaspace can potentially hold (methods, annotations, etc), it seems to me that 20MB is a very small value to start with. Unfortunately, choosing a correct value is not easy.

You have two options, enable gc logging -Xlog:gc and let the app run for some time and then find instances like:

[Full GC (Metadata GC Threshold) ...]

And understand from these what you need to set and how.

Or start the process with:

java -XX:NativeMemoryTracking=detail

connect to the PID via :

jcmd <YourJVMPID> VM.metaspace

And find lines like these:

 Virtual space:
    Non-class space:        8.00 MB reserved,       4.25 MB ( 53%) committed
    Class space:            1.00 GB reserved,     512.00 KB ( <1%) committed
    Both:                   1.01 GB reserved,       4.75 MB ( <1%) committed

And get the value from Non-class space after the app has been running for at least a day IMHO.

There are various other settings on how to control Metaspace, which you can find out like this:

java -XX:+PrintFlagsFinal -version | grep Metaspace
like image 57
Eugene Avatar answered Oct 16 '22 06:10

Eugene


I think the most interesting question is #3 so I'll answer that one first. The way I approached it was to run my application for 24 hours with gc logging turned on using these settings:

-XX:+PrintGC
-XX:+PrintGCDetails
-XX:+PrintGCDateStamps
-XX:+PrintGCCause
-XX:+PrintTenuringDistribution
-XX:+PrintGCApplicationStoppedTime
-XX:+PrintGCApplicationConcurrentTime
-Xloggc:gc.log

Then I did this:

grep Metaspace gc.log

and saw that the "used" value quickly grew to 80M ... so I set MetaspaceSize to 100M

-XX:MetaspaceSize=100M

and voila - no more gcs due to metaspace.

It looks like @Pillar's comment pretty much answered your first 2 questions on how to determine the default Metaspace settings for your implementation ... I'll include it here for completeness:

java -XX:+UnlockDiagnosticVMOptions -XX:+PrintFlagsFinal -version -XX:+UseG1GC | grep Metaspace

Technically, @Pillar's comment doesn't tell you the default Metaspace size for any 64 bit server, but but that's because your first question is a bit misleading, since according to the documentation these defaults vary per implementation.

See:

https://docs.oracle.com/javase/8/docs/technotes/guides/vm/gctuning/considerations.html

Specifically, the part at the bottom where it says, "The default size of MetaspaceSize is platform-dependent and ranges from 12 MB to about 20 MB"

like image 34
Adam Avatar answered Oct 16 '22 04:10

Adam