什么是工人，工人实例和执行者之间的关系？ [英] What is the relationship between workers, worker instances, and executors?

问题描述

在星火独立模式后，有主节点和工作节点。

1. 2是否例如工人有平均2工作进程一名工人节点？


2. 是否每个工人的实例保持特定的应用程序（管理存储，任务），或者一个工作节点各执一份遗嘱执行人执行人？


3. 有一个流程图讲解火花运行，比如word怎么算？

解决方案

我建议您阅读星火集群文档第一，但更是让这个<一个href=\"http://blog.cloudera.com/blog/2014/05/apache-spark-resource-management-and-yarn-app-models/\">Cloudera博客文章解释这些模式。

您的第一个问题取决于你的意思是实例是什么。节点是一台机器，而且也没有一个很好的理由来运行每台机器多个工人。所以，两个工作节点通常是指两台机器，每个工人星火

工人容纳许多执行人，对于许多应用。一个应用程序有很多工人执行者。

您的第三个问题是不明确的。

In Spark Standalone mode, there are master node and worker nodes.

1. Does 2 worker instance mean one worker node with 2 worker processes?
2. Does every worker instance hold an executor for specific application (which manages storage, task) or one worker node holds one executor?
3. Is there a flow chart explain how spark runtime,such as word count?

解决方案

I suggest reading the Spark cluster docs first, but even more so this Cloudera blog post explaining these modes.

Your first question depends on what you mean by 'instances'. A node is a machine, and there's not a good reason to run more than one worker per machine. So two worker nodes typically means two machines, each a Spark worker.

Workers hold many executors, for many applications. One application has executors on many workers.

Your third question is not clear.

这篇关于什么是工人，工人实例和执行者之间的关系？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！