自动化NIFI模板部署 [英] automating NIFI template deployment

问题描述

我是nifi的新手，并且试图了解(因为它看起来基于GUI)是否存在一种方法可以自动在Nifi上进行缩放，以及如何采用xml Nifi模板并将其部署到集群中.

I'm new to nifi and am trying to understand (since it looks many GUI based) if there is a way to automate scale up and down on Nifi and how one would take an xml Nifi template and deploy it to a cluster.

本质上，我们想要做的是使用Nifi来收集JMX，并以自动方式从kafka服务器上注销文件，以便日志和JMX计数器开始流入，例如，Elasticsearch集群.

Essentially what we're trying to do is use Nifi to collect JMX and log files off of kafka servers as they come up in an automated fashion so logging and JMX counters start flowing to, lets say and Elasticsearch cluster.

例如，现在我们已经使用Ansible自动化了kafka服务器的部署，因此希望与群集部署一起配置和部署Nifi xml团队板，因此无需手动干预即可收集kafka jmx计数器和日志文件.

For example, right now we've automated deployment of the kafka servers using Ansible, so the hope was to configure and deploy Nifi xml teamplates along with the cluster deployment so no manual intervention is required to collect the kafka jmx counters and log files.

一个人如何在Nifi中实现这一自动化?

How would one automate this in Nifi?

推荐答案

有许多工具和技术可用于自动部署模板，包括:

There are a number of tools and techniques available to automate deployment of a template, including:

• 卷曲，请参见 SO:通过REST发布NIFI模板吗?-最基本的API模板部署.
• nifi-api-deploy -执行模板部署以及一些迁移任务.
• nifi-deploy-process-group -执行流程组迁移./li>

• curl, see SO: Post a NIFI template via REST? - most basic API template deployment.
• nifi-api-deploy - performs template deployment plus some migration tasks.
• nifi-deploy-process-group - performs process group migration.

最困难的部分是从现有流程迁移到新流程，尤其是在现有流程可能具有排队的流程文件且来源历史记录引用现有流程的地方.但是，如果您要自动化NiFi群集的整个部署并将模板部署到一个空的画布上，那么这可能不是问题.

The hard part is migrating from the existing flow to the new flow, especially where an existing flow may have queued flowfiles, and provenance history references the existing flow. But if you are automating the entire deployment of the NiFi cluster and deploying the template to an empty canvas, this might not be a problem.

您可以在 查看全文