如何解决本地snappy库不可用：SnappyCompressor尚未加载？ [英] How to solve native snappy library not available: SnappyCompressor has not been loaded?

问题描述

我使用Mapreduce运行wordcount，但发生错误。本地snappy库不可用：SnappyCompressor尚未加载。我认为活泼的图书馆没有被加载。但是，当我检查本地库时，快速库是可以的。我不知道如何解决它。

解决方案

这取决于您安装hadoop发行版的操作系统。通常，预构建快速压缩与Hadoop一起发布，用于Ubuntu，RHEL等某些操作系统。

https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop- common / NativeLibraries.html＃Native_Hadoop_Library

如果您使用的是其他操作系统，则需要为该操作系统安装/构建snappy并将其集成到您的hadoop群集通过配置更改。
为了能够在账户中使用snappy，您可以按照下面的url

http://www.ericlin.me/enabling-snappy%EF%BC%8Dcompression-in-hadoop -2-4-under-centos-6-3

I run wordcount by Mapreduce but occured a error . the native snappy library not available: SnappyCompressor has not been loaded. I think the snappy library not been loaded. however when I check the native library that the snappy library is ok .I don't konw how to solve it.

解决方案

It depends on what operating system your hadoop distribution is installed. Usually pre build snappy compression is shipped with Hadoop for some os like Ubuntu,RHEL etc.

https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/NativeLibraries.html#Native_Hadoop_Library

If you are using other operating system you need to install/build snappy for that os and integrate it to your hadoop cluster by making config changes. To enable snappy on cent os you can follow below url

http://www.ericlin.me/enabling-snappy%EF%BC%8Dcompression-in-hadoop-2-4-under-centos-6-3

这篇关于如何解决本地snappy库不可用：SnappyCompressor尚未加载？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！