java.io.IOException：error = 2，Hadoop流中没有这样的文件或目录 [英] java.io.IOException: error=2, No such file or directory eroor in Hadoop streaming

问题描述

请协助处理hadoop streaming的-file选项问题（在下面的链接中提到）。只是为了更新，我知道这个jar已经存在了，在我尝试hadoop-streaming为一个不同的类文件失败后，我正在尝试这个，所以为了确定类文件本身是否有问题或者我的方式使用它。如果你需要stderr文件，请让我知道。

Please help with the "-file" option issue of hadoop streaming (mentioned in the link below). just to update, I know that the jar is already there, I am trying this after I tried hadoop-streaming for a different class file which failed, so to identify if there is something wrong with the class file itself or with the way I am using it. if you need the stderr file please let me know.

Java类文件的Hadoop Streaming -file选项有问题。

Problem with Hadoop Streaming -file option for Java class files.

推荐答案

-file发送jar文件，因为hadoop不支持多个jar文件（不在CLASSPATH中），请检查流文档：

you can't really use -file to send over jars as hadoop doesn't support multiple jars (that were not already in the CLASSPATH), check the streaming docs:

至少迟到版本0.14，Hadoop不支持多个jar文件。因此，在指定自己的自定义类时，您必须将它们与流式jar一起打包，并使用自定义jar而不是默认的hadoop流式jar。

At least as late as version 0.14, Hadoop does not support multiple jar files. So, when specifying your own custom classes you will have to pack them along with the streaming jar and use the custom jar instead of the default hadoop streaming jar.

这篇关于java.io.IOException：error = 2，Hadoop流中没有这样的文件或目录的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！