Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How can I start the Flink job manager web interface when running Flink from an IDE

Tags:

apache-flink

I would like to access the Flink Web interface when starting it locally from the IDE.

I need this because I'd like to access the counters (accumulators) of Flink.

like image 635
Robert Metzger Avatar asked Feb 01 '16 19:02

Robert Metzger


2 Answers

In order to start the web interface when starting Flink locally, we have to enable the web interface in the FlinkMiniCluster. The FlinkMiniCluster is the class managing the startup of all Flink services locally.

Include the dependency:

<dependency>
  <groupId>org.apache.flink</groupId>
  <artifactId>flink-runtime-web_${scala.binary.version}</artifactId>
  <version>${flink.version}</version>
</dependency>

The following snippet will enable the web interface for a StreamExecutionEnvironment:

// set up the execution environment
Configuration conf = new Configuration();
conf.setBoolean(ConfigConstants.LOCAL_START_WEBSERVER, true);
final StreamExecutionEnvironment env = StreamExecutionEnvironment.createLocalEnvironment(8, conf);

You can also use RestOptions to configure the server:

conf.setInteger(RestOptions.PORT, 8082);
like image 196
Robert Metzger Avatar answered Sep 21 '22 20:09

Robert Metzger


In addition to the code in the above answer, the following dependency is also required in the pom file.

    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-runtime-web_${scala.binary.version}</artifactId>
        <version>${flink.version}</version>
    </dependency>
like image 29
Debajyoti Pathak Avatar answered Sep 22 '22 20:09

Debajyoti Pathak