Friday, February 22, 2019

Apache NiFi - Configuration

Apache NiFi is highly configurable platform. The nifi.properties file in conf directory
contains most of the configuration.
The commonly used properties of Apache NiFi are as follows −

Core properties

This section contains the properties, which are compulsory to run a NiFi instance.
S.No.Property nameDefault Valuedescription
1nifi.flow.configuration.file./conf/flow.xml.gzThis property contains the path to flow.xml file. This file contains all the data flows created in NiFi.
2nifi.flow.configuration.archive.enabledtrueThis property is used to enable or disable archiving in NiFi.
3nifi.flow.configuration.archive.dir./conf/archive/This property is used to specify the archive directory.
4nifi.flow.configuration.archive.max.time30 daysThis is used to specify the retention time for archiving content.
5nifi.flow.configuration.archive.max.storage500 MBit contains the maximum size of archiving directory can grow.
6nifi.authorizer.configuration.file./conf/authorizers.xmlTo specify the authorizer configuration file, which is used for user authorization.
7nifi.login.identity.provider.configuration.file./conf/login-identity-providers.xmlThis property contains the configuration of login identity providers,
8nifi.templates.directory./conf/templatesThis property is used to specify the directory, where NiFi templates will be stored.
9nifi.nar.library.directory./libThis property contains the path to library, which NiFi will use to load all the components using NAR files present in this lib folder.
10nifi.nar.working.directory./work/nar/This directory will be storing the unpacked nar files, once NiFi processes them.
11nifi.documentation.working.directory./work/docs/componentsThis directory contains the documentation of all components.

State Management

These properties are used to store the state of the components helpful to start the processing, where components left after a restart and in the next schedule running.
S.No.Property nameDefault Valuedescription
1nifi.state.management.configuration.file./conf/state-management.xmlThis property contains the path to state-management.xml file. This file contains all component state present in the data flows of that NiFi instance.
2nifi.state.management.provider.locallocal-providerIt contains the ID of the local state provider.
3nifi.state.management.provider.clusterzk-providerThis property contains the ID of the cluster-wide state provider. This will be ignored if NiFi is not clustered but must be populated if running in a cluster.
4nifi.state.management. embedded. zookeeper. startfalseThis property specifies whether or not this instance of NiFi should run an embedded ZooKeeper server.
5nifi.state.management. embedded. zookeeper.properties./conf/zookeeper.propertiesThis property contains the path of the properties file that provides the ZooKeeper properties to use if <nifi.state.management. embedded. zookeeper. start> is set to true.

FlowFile Repository

Let us now look into the important details of the FlowFile repository −
S.No.Property nameDefault Valuedescription
1nifi.flowfile.repository. implementationorg.apache.nifi. controller. repository. WriteAhead FlowFileRepositoryThis property is used to specify either to store the flowfiles in memory or disk. If a user want to stores the flowfiles in memory then change to "org.apache.nifi.controller. repository.VolatileFlowFileRepository".
2nifi.flowfile.repository.directory./flowfile_repositoryTo specify the directory for flowfile repository.

No comments:

Post a Comment

Popular Posts