Hadoop：无法为您的平台加载native-hadoop库 [英] Hadoop: Unable to load native-hadoop library for your platform

问题描述

我在Ubuntu上安装了Hadoop 2.7.2单节点，我想运行java wordcount程序。编译和创建jar文件是成功完成的，但是当我在Hadoop上运行jar文件时，我收到以下消息：

  WARN util.NativeCodeLoader：无法为您的平台加载native-hadoop库......在适用的情况下使用builtin-java类
  

我通过编辑.bashrc文件来设置环境变量：

  export HADOOP_COMMON_LIB_NATIVE_DIR = $ HADOOP_HOME / lib 
  

当我输入hadoop checknative时 - 我得到这个：

  hadoop：true /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 
 zlib：true /lib/x86_64-linux-gnu/libz.so .1 
 snappy：false 
 lz4：真正的修订版：99 
 bzip2：false 
 openssl：true /usr/lib/x86_64-linux-gnu/libcrypto.so 
 
 16/05/09 00:48:53 INFO util.ExitUtil：以状态1退出
  

Hadoop版本：2.7.2

Ubuntu版本：14.04

任何人都可以给s解决方案

解决方案

将您编译的本机库文件移动到$ HADOOP_HOME / lib文件夹中。
$ b

然后通过编辑.bashrc文件来设置你的环境变量

  export HADOOP_COMMON_LIB_NATIVE_DIR = $ HADOOP_HOME / lib 
 export HADOOP_OPTS =$ HADOOP_OPTS -Djava.library.path = $ HADOOP_HOME / lib
  

确保编译的本地库文件位于$ HADOOP_HOME / lib文件夹中。

它应该解决这个问题。

I've installed Hadoop 2.7.2 single node on Ubuntu and I want to run the java wordcount program. The compilation and the creation of the jar file are done succesfully, but when I run the jar file on Hadoop I receive this message:

WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

I set environment variables by editing .bashrc file:

export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib

When I type hadoop checknative -a I get this:

hadoop: true /usr/local/hadoop/lib/native/libhadoop.so.1.0.0
zlib: true /lib/x86_64-linux-gnu/libz.so.1
snappy: false 
lz4: true revision:99
bzip2: false
openssl: true /usr/lib/x86_64-linux-gnu/libcrypto.so

16/05/09 00:48:53 INFO util.ExitUtil: Exiting with status 1

Hadoop version: 2.7.2

Ubuntu version: 14.04

Could anyone give some clues about the issue?

解决方案

Move your compiled native library files to $HADOOP_HOME/lib folder.

Then set your environment variables by editing .bashrc file

export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib  
export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$HADOOP_HOME/lib"

Make sure your compiled native library files are in $HADOOP_HOME/lib folder.

It should fix the issue.

这篇关于Hadoop：无法为您的平台加载native-hadoop库的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！