Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How Can I View FlowFile or STDOUT of Processor?

Tags:

apache-nifi

When things fail, I'd like to view the flow file, or the output (stdout+stderr) from the problematic processor. Is there an easy way to dump out all of the Flowfile's properties, or to just browse a Flowfile?

like image 597
Vince Avatar asked Jan 09 '17 15:01

Vince


People also ask

How to check NiFi status?

If you start NiFi in the background, to check the status and see if NiFi is currently running, execute the command /bin/nifi.sh status. To shut down NiFi, execute the command bin/nifi.sh stop .

How to access NiFi UI?

When the application is started, the user is able to navigate to the UI by going to the default address of http://<hostname>:8080/nifi in a web browser.

Where does content of FlowFile stored?

The Provenance Repository is where the history of each FlowFile is stored. This history is used to provide the Data Lineage (also known as the Chain of Custody) of each piece of data.

What is a FlowFile?

A FlowFile is a logical notion that correlates a piece of data with a set of Attributes about that data. Such attributes include a FlowFile's unique identifier, as well as its name, size, and any number of other flow-specific values.


1 Answers

Processors usually have one or more relationships for failures and it is up to the data flow designer to determine what to do with these.

Some failures are due to temporary conditions like if a destination system was down, for those they would typically be looped back to the same processor to keep retrying until the destination comes back up.

Other failures are due to issues related to the data and likely don't make sense to retry because they will continue to fail. This set of failures you can route to PutFile processor to write them out to directory somewhere, or a PutEmail processor to notify you. Either of those would give you access to the raw data. If you want to see the flow file attributes you could use data provenance to look at all the flow files that passed through the PutFile/PutEmail processor.

like image 143
Bryan Bende Avatar answered Sep 20 '22 06:09

Bryan Bende