Apache Oozie无法加载ShareLib [英] Apache Oozie failed loading ShareLib

问题描述

我得到了以下oozie.log：

  org.apache.oozie.service.ServiceException：E0104：无法完全初始化服务[org.apache.oozie.service.ShareLibService]，无法缓存sharelib。管理员需要使用oozie-setup.sh安装sharelib，并发出'oozie admin'CLI命令更新sharelib 
  

运行以下命令：

  oozie-setup.sh sharelib create -fs hdfs：// localhost： 54310 
 oozied.sh start 
 
 hdfs dfs -ls / user / hduser / share / lib 
 15/02/24 18:05:03 WARN util.NativeCodeLoader：无法为您的平台加载native-hadoop库...在适用的情况下使用builtin-java类
找到3项
 drwxr-xr-x  -  hduser supergroup 0 2015-02-24 17:19 / user / hduser / share / lib / lib_20150224171855 
 drwxr-xr-x  -  hduser supergroup 0 2015-02-24 17:19 / user / hduser / share / lib / lib_20150224171908 
 drwxr-xr-x  -  hduser supergroup 0 2015-02-24 17:29 / user / hduser / share / lib / lib_20150224172857 
  

但：

  oozie admin -shareliblist -oozie http：// localhost：11000 / oozie 
 [Available ShareLib] 

 oozie admin -sharelibupdate -oozie http：// localhost：11000 / oozie 
 null 
  

我的oozie-site.xml包含：

 < property> 
< name> oozie.service.WorkflowAppService.system.libpath< / name> 
< value> / user / $ {user.name} / share / lib /< / value> 
< / property> 
 
<属性> 
<名称> oozie.service.HadoopAccessorService.hadoop.configurations< / name> 
< value> * = hadoop-conf< /值> 
< / property> 
  

您对我的错误有任何了解吗？

解决方案

我努力修复相同的错误几天，我终于修复它。

它与在本地文件系统上寻找sharelib文件夹的sharelib服务，而不是我的hdfs。

所以要解决它：

stop oozie

编辑conf / oozie-site.xml

 <性> 
<名称> oozie.service.HadoopAccessorService.hadoop.configurations< / name> 
< value> * = / usr / local / hadoop / etc / hadoop /< /值> 
< / property> 
  

重新启动oozie。

和Voila！

默认情况下，该属性的值设置为* = hadoop-conf。我仍然不知道hadoop-conf应该指向什么，但在我的情况下，它不是配置文件夹hadoop，所以我将它改为* = / usr / local / hadoop / etc / hadoop /.

i got the following oozie.log :

org.apache.oozie.service.ServiceException: E0104: Could not fully initialize service [org.apache.oozie.service.ShareLibService], Not able to cache sharelib. An Admin needs to install the sharelib with oozie-setup.sh and issue the 'oozie admin' CLI command to update the sharelib

i run the following command:

oozie-setup.sh sharelib create -fs hdfs://localhost:54310
oozied.sh start

hdfs dfs -ls /user/hduser/share/lib
15/02/24 18:05:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Found 3 items
drwxr-xr-x   - hduser supergroup          0 2015-02-24 17:19 /user/hduser/share/lib/lib_20150224171855
drwxr-xr-x   - hduser supergroup          0 2015-02-24 17:19 /user/hduser/share/lib/lib_20150224171908
drwxr-xr-x   - hduser supergroup          0 2015-02-24 17:29 /user/hduser/share/lib/lib_20150224172857 

but :

oozie admin -shareliblist -oozie http://localhost:11000/oozie
[Available ShareLib]

oozie admin -sharelibupdate -oozie http://localhost:11000/oozie
null

my oozie-site.xml contains:

<property>
    <name>oozie.service.WorkflowAppService.system.libpath</name>
    <value>/user/${user.name}/share/lib/</value>
</property>

<property>
    <name>oozie.service.HadoopAccessorService.hadoop.configurations</name>
    <value>*=hadoop-conf</value>
</property>

Do you have any idea of my mistake ?

解决方案

I struggled to fix the same error for couple of days and I finally fix it.

It was related to the sharelib service that was looking for sharelib folder on my local file system instead of my hdfs.

So to fix it:

stop oozie

edit conf/oozie-site.xml

<property>        
      <name>oozie.service.HadoopAccessorService.hadoop.configurations</name> 
      <value>*=/usr/local/hadoop/etc/hadoop/</value>
</property>

restart oozie.

And Voila!

The value of the property was set to *=hadoop-conf by default. I still don't know yet what hadoop-conf should point to but in my case it wasn't the configuration folder hadoop so I changed it for *=/usr/local/hadoop/etc/hadoop/.

这篇关于Apache Oozie无法加载ShareLib的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！