初始作业未接受任何资源；检查您的集群 UI 以确保工作人员已注册并拥有足够的资源 [英] Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

问题描述

我正在尝试从 Eclipse 运行 spark 示例并收到此一般错误:Initial job has not accept any resources;检查您的集群 UI 以确保工作人员已注册并拥有足够的资源.

I'm trying to run the spark examples from Eclipse and getting this generic error: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources.

我的版本是 spark-1.6.2-bin-hadoop2.6. 我使用 ./sbin/start-master.sh 命令启动 spark一个 shell，并像这样设置我的 sparkConf:

The version I have is spark-1.6.2-bin-hadoop2.6. I started spark using the ./sbin/start-master.sh command from a shell, and set my sparkConf like this:

SparkConf conf = new SparkConf().setAppName("Simple Application");
conf.setMaster("spark://My-Mac-mini.local:7077");

我不会在这里提供任何其他代码，因为此错误会在我运行的任何示例中弹出.这台机器是 Mac OSX，我很确定它有足够的资源来运行最简单的示例.

I'm not bringing any other code here because this error pops up with any of the examples I'm running. The machine is a Mac OSX and I'm pretty sure it has enough resources to run the simplest examples.

我错过了什么?

推荐答案

该错误表明您的集群没有足够的资源用于当前作业.由于您还没有启动 slaves i.e worker .集群将没有任何资源可分配给您的作业.启动奴隶会起作用.

The error indicates that you cluster has insufficient resources for current job.Since you have not started the slaves i.e worker . The cluster won't have any resources to allocate to your job. Starting the slaves will work.

`start-slave.sh <spark://master-ip:7077>`

这篇关于初始作业未接受任何资源；检查您的集群 UI 以确保工作人员已注册并拥有足够的资源的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！