Configuration of workers in a storm cluster

Question

I have a question about configuration of worker processes.

I have already understood that worker processes run within a worker node (which is a machine). What I would like to know is if all worker processes share the same JVM or if each worker process has its own JVM instance? If the latter is true, so I suppose one should set how much memory each process has to use! So where would this configuration be done?

Answer 1

configure worker.childopts = "-Xmx4048m" in storm.yaml.

each worker process will get that much memory from RAM, if available.

Answer 2

Each storm worker process run in its own JVM. The memory allocation to each of the worker can be done in the conf/storm.yaml configuration file. For Ex: Add/Edit the following parameter to allocate 1GB RAM to each of your worker process:

worker.childopts: "-Xmx1024m"

This overrides any JVM RAM settings you have done in general on your machine (like using JAVA_TOOL_OPTIONS)

For more storm configurations refer: Storm Configurations