Hadoop“无法为您的平台加载原生Hadoop库”警告 [英] Hadoop "Unable to load native-hadoop library for your platform" warning

查看:885
本文介绍了Hadoop“无法为您的平台加载原生Hadoop库”警告的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我目前在运行 CentOs 的服务器上配置hadoop。当我运行 start-dfs.sh stop-dfs.sh 时,出现以下错误:


WARN util.NativeCodeLoader:无法为
加载native-hadoop库您的平台...在适用的情况下使用builtin-java类 p>

我正在运行Hadoop 2.2.0。

在线搜索引发了以下链接: http://balanceandbreath.blogspot.ca /2013/01/utilnativecodeloader-unable-to-load.html



然而, / native / hadoop 2.x上的目录看起来不同,所以我不知道该怎么做。



我还在<$中添加了这两个环境变量c $ c> hadoop-env.sh :


export HADOOP_OPTS =$ HADOOP_OPTS
- Djava.library.path = / usr / local / hadoop / lib /



export HADOOP_COMMON_LIB_NA TIVE_DIR =/ usr / local / hadoop / lib / native /

任何想法

解决方案

我假设您在64位CentOS上运行Hadoop。您看到该警告的原因是本地Hadoop库 $ HADOOP_HOME / lib / native / libhadoop.so.1.0.0 实际上是在32位上编译的。无论如何,这只是一个警告,并不会影响Hadoop的功能。



这里是if您希望消除此警告,请下载Hadoop的源代码并在64位系统上重新编译 libhadoop.so.1.0.0 ,然后替换32位版本。

有关如何重新编译源代码的步骤,请参阅Ubuntu:



祝你好运。

I'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error:

WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

I'm running Hadoop 2.2.0.

Doing a search online brought up this link: http://balanceandbreath.blogspot.ca/2013/01/utilnativecodeloader-unable-to-load.html

However, the contents of /native/ directory on hadoop 2.x appear to be different so I am not sure what to do.

I've also added these two environment variables in hadoop-env.sh:

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/local/hadoop/lib/"

export HADOOP_COMMON_LIB_NATIVE_DIR="/usr/local/hadoop/lib/native/"

Any ideas?

解决方案

I assume you're running Hadoop on 64bit CentOS. The reason you saw that warning is the native Hadoop library $HADOOP_HOME/lib/native/libhadoop.so.1.0.0 was actually compiled on 32 bit.

Anyway, it's just a warning, and won't impact Hadoop's functionalities.

Here is the way if you do want to eliminate this warning, download the source code of Hadoop and recompile libhadoop.so.1.0.0 on 64bit system, then replace the 32bit one.

Steps on how to recompile source code are included here for Ubuntu:

Good luck.

这篇关于Hadoop“无法为您的平台加载原生Hadoop库”警告的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆