Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Apache Beam Counter/Metrics not available in Flink WebUI

I'm using Flink 1.4.1 and Beam 2.3.0, and would like to know is it possible to have metrics available in Flink WebUI (or anywhere at all), as in Dataflow WebUI ?

I've used counter like:

import org.apache.beam.sdk.metrics.Counter;
import org.apache.beam.sdk.metrics.Metrics;
...
Counter elementsRead = Metrics.counter(getClass(), "elements_read");
...
elementsRead.inc();

but I can't find "elements_read" counts available anywhere (Task Metrics or Accumulators) in Flink WebUI. I thought this will be straightforward after BEAM-773.

like image 672
robosoul Avatar asked Feb 27 '18 16:02

robosoul


1 Answers

Once you have selected a job in your dashboard, you will see the DAG for that job and below the DAG there are a list of tabs.

  1. Click on "Task Metrics" Tab
  2. Click on a box of your DAG
  3. Click on the Add Metric Button, to show that operator metric

Flink dashboard showing metrics

like image 171
diegoreico Avatar answered Oct 12 '22 17:10

diegoreico