Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to save something that I do on nifi.?

Tags:

apache-nifi

I am new to apache NIFI. I was kind of wondering where is the save button. I tried a sample from a tutorial that I saw on youtube. I would like to save all the processors that I created for future reference. I don't see any save button. Is is possible to save my work open later.? Or open in another machine.?

Please Help.

like image 384
yoyo yagami Avatar asked Sep 22 '17 02:09

yoyo yagami


People also ask

How do I save work in NiFi?

If you want to save the entire flow you have in the system, you can also find that in nifi/conf/flow. xml. gz on your nifi box. This is not a template, but would be able to drop into a clean NiFi instance.

Where is NiFi data stored?

NiFi stores your data in a repository while it traverses its way through your system. There are three repositories - the “FlowFile Repository,” the “Provenance Repository,” and the “Content Repository.” Content starts out being written to a Flowfile Repository which is streamed to a Content Repository.

Where are templates saved in NiFi?

The template is downloaded in a xml file. @Randy Gelhausen Under conf there is a templates directory where all the templates are located.

What happens to be data if NiFi goes down?

When a node goes down, NiFi cluster manager will route the data to another node. However, queued data for the failed node will still be queued for failed node. Only that data must be manually sent over to the live node in the cluster or just bring the failed node up.

How do I create a flow in NiFi?

To begin with, drag the processor icon to the NiFi canvas and select GetFile processor from the list. Create an input directory like c:\inputdir. Right-click on the processor and select configure and in properties tab add Input Directory (c:\inputdir) and click apply and go back to canvas.

How do I upload a template to NiFi?

To import a template into your NiFi instance, select the Upload Template icon ( ) from the Operator palette, click the Search Icon and navigate to the file on your computer. Then click the Upload button.


2 Answers

Apache NiFi automatically saves your flow for you. The flow configuration file is stored in ./conf/flow.xml.gz by default. NiFi also maintains an archive of previous versions in ./conf/archive. See the Core Properties settings for changing these settings. It is possible to backup and restore the flow configuration through these files.

Apache NiFi also has a Templates feature that makes it easy to save a selection from your flow, export it from the UI, and share it with other NiFi installations. Templates may be a closer approximation of a "save" button.

like image 180
James Avatar answered Sep 28 '22 11:09

James


The Apache Nifi Registry is another option. You can version processor groups, commit changes to the registry, revert back, add comments, etc. I see it as similar to version control such as Git. It's helpful in collaborative settings as well as promoting changes from development to production.

like image 42
firefly2442 Avatar answered Sep 28 '22 09:09

firefly2442