并行运行Oozie操作 [英] Running Oozie actions in parallel

问题描述

我使用Hue中的工作流编辑器来开发Oozie工作流程。有一些行为应该并行执行。

是否可以同时执行两个或多个操作？

如何设置它在Hue？

解决方案

是的，这是可能的。在各种 Oozie工作流节点中，有两个控制节点 fork 和加入：

fork节点将执行的一个路径分割为多个并发执行路径。

一个连接节点等待，直到前一个分叉节点的每个并发执行路径到达它为止。

fork和join节点必须成对使用。

Hue确实支持它，虽然它不是很直观 - 你可以在工作流上拖放操作，但不能对控制节点执行相同的操作。

要将一个执行路径分成两个并发路径，拖动（例如 step_B 到 step_A 在下面的例子中）：

$ b
这将添加一个 fork 节点，并将相应的操作放在下面：

I am using the workflow editor in Hue to develop an Oozie workflow. There are a few action that should be executed in parallel.

Is it possible to execute two or more actions concurrently?
How can I set it up in Hue?

解决方案

Yes, it is possible. Among various Oozie workflow nodes, there are two control nodes fork and join:

A fork node splits one path of execution into multiple concurrent paths of execution.

A join node waits until every concurrent execution path of a previous fork node arrives to it.

The fork and join nodes must be used in pairs. The join node assumes concurrent execution paths are children of the same fork node.

Hue does support it, although it's not very intuitive - you can drag and drop actions on the workflow, but you cannot do the same for the control nodes.

To split one path of execution into two concurrent ones, drag one action onto another (e.g. step_B onto step_A in the example below):

This will add a fork node automatically and place the appropriate action underneath:

这篇关于并行运行Oozie操作的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！