Oozie>异步动作和同步动作有什么区别 [英] Oozie > what is the difference between asynchronous actions and synchronous actions

查看:171
本文介绍了Oozie>异步动作和同步动作有什么区别的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我从Oozie官方网站上阅读:操作是异步的

I read from Oozie official site: Actions Are Asynchronous

由动作节点触发的所有计算/处理任务均由Oozie异步执行.对于由工作流操作触发的大多数类型的计算/处理任务,工作流作业必须等到计算/处理任务完成后才能转换到工作流中的下一个节点.

All computation/processing tasks triggered by an action node are executed asynchronously by Oozie. For most types of computation/processing tasks triggered by workflow action, the workflow job has to wait until the computation/processing task completes before transitioning to the following node in the workflow.

在同一网站的不同页面上: Fs HDFS动作

Whereas on different page of the same site: Fs HDFS action

FS操作(同步操作)的引入说明:

The introduction of FS action (synchronous action) told that:

从FS操作中同步执行FS命令,工作流作业将等待直到指定的文件命令完成,然后再继续执行下一个操作.

The FS commands are executed synchronously from within the FS action, the workflow job will wait until the specified file commands are completed before continuing to the next action.

为什么 synchronous asynchronous 的介绍基本相同?根据我从操作系统原理课程中的理解,异步意味着该函数不等待而是继续执行.

Why synchronous and asynchronous introduction is basically the same?According to my understanding from the operating system principle course, asynchronous means the function does not wait but continue the execution.

推荐答案

摘录自:穆罕默德·卡穆尔(Mohammad Kamrul)伊斯兰教和阿拉维德·斯里尼瓦桑(Aravind Srinivasan). "Apache Oozie."

Excerpt From: Mohammad Kamrul Islam and Aravind Srinivasan. "Apache Oozie."

异步操作:所有Hadoop操作和<shell>操作都遵循操作执行模型".这些之所以称为异步操作,是因为它们是通过启动程序作为Hadoop作业启动的.

Asynchronous Actions : All Hadoop actions and the <shell> action follow the "Action Execution Model". These are called asynchronous actions because they are launched via a launcher as Hadoop jobs.

同步操作::文件系统操作,电子邮件操作,SSH操作和子工作流操作由Oozie服务器本身执行,称为同步操作.执行这些同步操作不需要运行任何用户代码,只需访问某些库即可.

Synchronous Actions : The filesystem action, email action, SSH action, and sub-workflow action are executed by the Oozie server itself and are called synchronous actions. The execution of these synchronous actions do not require running any user code—just access to some libraries.

基本上,在两种情况下,Oozie服务器都等待操作完成,然后仅移动到DAG中的下一个操作.分离主要基于actinos是在同一Oozie服务器上还是在Hadoop集群上执行.

Essentially, In both the cases Oozie server waits for the completion of the action and then only moves to the next action in the DAG. The separation is mainly based on whether actinos executes on the same Oozie server or on the Hadoop cluster.

这是Oozie动作及其动作执行模型的列表.

Here is list of Oozie Actions and their Action Execution Model.

这篇关于Oozie&gt;异步动作和同步动作有什么区别的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆