结合使用AWS Glue Python和NumPy和Pandas Python软件包 [英] Use AWS Glue Python with NumPy and Pandas Python Packages

问题描述

在称为Glue的AWS上的新ETL工具中使用NumPy和Pandas之类的软件包的最简单方法是什么?我想在使用NumPy和Pandas的AWS Glue中运行的Python中有一个完整的脚本.

What is the easiest way to use packages such as NumPy and Pandas within the new ETL tool on AWS called Glue? I have a completed script within Python I would like to run in AWS Glue that utilizes NumPy and Pandas.

推荐答案

我认为当前的答案是您不能.根据 AWS胶水文档:

I think the current answer is you cannot. According to AWS Glue Documentation:

只能使用纯Python库.尚不支持依赖C扩展的库，例如pandas Python数据分析库.

Only pure Python libraries can be used. Libraries that rely on C extensions, such as the pandas Python Data Analysis Library, are not yet supported.

但是，即使我尝试在S3中包含普通的python编写的库，由于某些HDFS权限问题，Glue作业也失败了.如果您找到解决此问题的方法，请也告诉我.

But even when I try to include a normal python written library in S3, the Glue job failed because of some HDFS permission problem. If you find a way to solve this, please let me know as well.

这篇关于结合使用AWS Glue Python和NumPy和Pandas Python软件包的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！