hadoop中-libjars的问题 [英] Problem with -libjars in hadoop

问题描述

我正在尝试在 Hadoop 上运行 MapReduce 作业，但我遇到了错误，我不确定出了什么问题.我必须传递我的映射器所需的库 jar.

我正在终端上执行以下操作:

hadoop@ubuntu:/usr/local/hadoop$ bin/hadoop jar/home/hadoop/vardtst.jar -libjars/home/hadoop/clui.jar -libjars/home/hadoop/model.jar Gutenberg ou101

我收到以下异常:

在 java.net.URLClassLoader$1.run(URLClassLoader.java:202)

在 java.security.AccessController.doPrivileged(Native Method)

在 java.net.URLClassLoader.findClass(URLClassLoader.java:190)

在 java.lang.ClassLoader.loadClass(ClassLoader.java:306)

在 java.lang.ClassLoader.loadClass(ClassLoader.java:247)

在 java.lang.Class.forName0(Native Method)

在 java.lang.Class.forName(Class.java:247)

在 org.apache.hadoop.util.RunJar.main(RunJar.java:149)

请帮忙..谢谢

解决方案

我找到了答案，它抛出错误，因为我在命令中缺少主"类名.

正确的执行方式是:hadoop@ubuntu:/usr/local/hadoop$ bin/hadoop jar/home/hadoop/vardtst.jar VardTest -libjars/home/hadoop/clui.jar,/home/hadoop/model.jargutenberg ou101

其中 VardTest 是包含 main() 方法的类.

谢谢

I am trying to run MapReduce job on Hadoop but I am facing an error and I am not sure what is going wrong. I have to pas library jars which is required by my mapper.

I am excuting the following on the terminal:

hadoop@ubuntu:/usr/local/hadoop$ bin/hadoop jar /home/hadoop/vardtst.jar -libjars /home/hadoop/clui.jar -libjars /home/hadoop/model.jar gutenberg ou101

and I am getting the following Exception:

at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

at java.security.AccessController.doPrivileged(Native Method)

at java.net.URLClassLoader.findClass(URLClassLoader.java:190)

at java.lang.ClassLoader.loadClass(ClassLoader.java:306)

at java.lang.ClassLoader.loadClass(ClassLoader.java:247)

at java.lang.Class.forName0(Native Method)

at java.lang.Class.forName(Class.java:247)

at org.apache.hadoop.util.RunJar.main(RunJar.java:149)

Please Help ..Thanks

解决方案

I found the answer, it was throwing error cause I was missing on the "main" class name in the command.

The correct way to execute is: hadoop@ubuntu:/usr/local/hadoop$ bin/hadoop jar /home/hadoop/vardtst.jar VardTest -libjars /home/hadoop/clui.jar,/home/hadoop/model.jar gutenberg ou101

where VardTest is the class containing the main() method.

Thanks

这篇关于hadoop中-libjars的问题的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！