Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

where does oozie stores the captured output values of the Java action (or) any action

Tags:

hadoop

oozie

I am using the capture-output option for my Java Action. The values I am using in the downstream actions. Which is working fine. When I do -rerun of the oozie job also framework is fetching the values, without running the Java action again.

I would like to know where does this values stored?

Thanks in advance.

like image 576
user3700301 Avatar asked Jan 21 '15 07:01

user3700301


People also ask

Which one of the following files is required in every Oozie workflow application?

xml file and all the required binaries, scripts, archives, files, and configuration are packaged and deployed in an HDFS directory. The workflow. xml file is under the workflow application root directory on HDFS ( oozie.

What action transitions does Oozie?

1.3 Actions Have 2 Transitions, =ok= and =error= If a computation/processing task -triggered by a workflow- completes successfully, it transitions to ok . If a computation/processing task -triggered by a workflow- fails to complete successfully, its transitions to error .

How do you pass an argument to shell action in Oozie?

You can capture output from shell script and pass it to java action.In the shell script , echo the property like 'dateVariable=${DATE}' and add the capture-output element int the shell action.

Which node drives the actions of the workflow?

Explanation: Control nodes define the flow of execution and include beginning and end of a workflow (start, end and fail nodes) and mechanisms to control the workflow execution path.


1 Answers

Oozie's java action stores captured output/exported properties in a property file defined by Hadoop Job attribute: oozie.action.output.properties at runtime. When action completed, the data is then serialized to Oozie's backend data store - Mysql or in-memory db, in table - oozie.WF_ACTIONS, column - data.

The data here is then visible to other actions referring to this java action's output.

like image 56
Paul H. Avatar answered Nov 15 '22 10:11

Paul H.