Hadoop:指定distcp的yarn队列 [英] Hadoop: specify yarn queue for distcp

问题描述

在我们的集群上，我们建立了动态​​资源池.

On our cluster we have set up dynamic resource pools.

设置规则，以便第一个纱线将查看指定的队列，然后是用户名，然后是主要组...

The rules are set so that first yarn will look at the specified queue, then to the username, then to primary group ...

但是对于 distcp ，我似乎无法能够指定一个队列，只需将其设置为主要组即可.

However with a distcp I can't seem to be able to specify a queue, it just sets it to the primary group.

这是我现在运行它的方式(不起作用):

This is how I run it now (which doesn't work):

 hadoop distcp -Dmapred.job.queue.name:root.default .......

推荐答案

您在参数说明中犯了一个错误.

You are committing a mistake in the specification of the parameter.

您不应使用:"分隔键/值对.您应该使用"=".

You should not use ":" for separating the key/value pairs. You should use "=".

命令应该是

 hadoop distcp -Dmapred.job.queue.name=root.default .......

这篇关于Hadoop:指定distcp的yarn队列的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！