Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Apache Nifi Execute Process Processor

Tags:

apache-nifi

I am trying to implement the workflow below using Apache Nifi:

  1. ExecuteSQL - This is fetching data from oracle database in avro format
  2. PutHDFS –This is to put the data into hdfs
  3. ExecuteProcess – This processor executes a bash script in the background which in turn creates the external hive table

I have a few questions:

Does ExecuteProcess Processor in Apache Nifi takes incoming flow files?

I am not able to provide ExecuteProcess processor any incomming flow file. If not, is there any way to support taking incoming flow files?

like image 422
Anonymous Avatar asked Jun 06 '16 06:06

Anonymous


People also ask

How can I run NiFi processor only once?

Individual processors set to `Run once' can be selected on the canvas with a shift-click. Then clicking `Start' on the Operate Palette will start those processors which will run once and stop. Then one can modify processing parameters and repeat.

How do I start my NiFi processor?

To get started, open a web browser and navigate to https://localhost:8443/nifi . The port can be changed by editing the nifi. properties file in the NiFi conf directory, but the default port is 8443.

How does NiFi manages the data flow between the processors?

The core concepts of NiFi A FlowFile represents each object moving through the system and for each one, NiFi keeps track of a map of key/value pair attribute strings and its associated content of zero or more bytes. Processors actually perform the work.


1 Answers

ExecuteProcess does not allow incoming flow files. Take a look at the ExecuteStreamCommand processor, it accepts incoming flow files and also executes an external command.

like image 135
Bryan Bende Avatar answered Nov 19 '22 06:11

Bryan Bende