在 redshift 上查询数据时出错 - 获取条带数据时出错 [英] ERROR while querying data on redshift - Error fetching stripe data

问题描述

我正在尝试对 redshift 中的外部表运行以下查询:

I'm trying to run the following query over an external table in redshift:

select * from schema.table limit 10;

然后我收到一个错误:

[2018-06-20 12:03:14] [XX000][500310] Amazon Invalid operation: S3 Query Exception (Fetch)细节:错误:S3 查询异常(获取)代码:15001上下文:由于内部错误，任务失败.从 ORC 文件中获取条带数据时出错 https://s3/XXXXXX.orc 文件大小

[2018-06-20 12:03:14] [XX000][500310] Amazon Invalid operation: S3 Query Exception (Fetch) Details: error: S3 Query Exception (Fetch) code: 15001 context: Task failed due to an internal error. Error fetching stripe data from ORC file https://s3/XXXXXX.orc File size

当我在 athena 中查询相同的文件时，它工作正常.架构中有更多的表，我可以像往常一样查询它们.

when I query the same files in athena it works fine. There are more tables in the schema and I can query them as usual.

有人可以帮忙吗?

谢谢

推荐答案

通常，这意味着其中一个文件已损坏或从 S3 获取文件时出现问题.请查看 svl_s3log 视图，看看您是否可以提取消息的最后一部分.据我所知，您可能在 ORC 文件之间有一个文本文件?

Typically, this means that either one of the files is corrupted or there is an issue fetching the file from S3. Please have a look at the svl_s3log view to see if you can extract the last part of the message. From what I can see it might be that you have a text file in between the ORC files?

这篇关于在 redshift 上查询数据时出错 - 获取条带数据时出错的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！