InternalError_:频谱扫描错误.S3到Redshift复制命令 [英] InternalError_: Spectrum Scan Error. S3 to Redshift copy command

问题描述

我正在尝试使用COPY命令将一些数据从S3存储桶复制到redshift表.该文件的格式为PARQUET.当我运行执行COPY命令查询时，出现InternalError_:Spectrum Scan Error.

I am trying to copy some data from S3 bucket to redshift table by using the COPY command. The format of the file is PARQUET. When I run the execute the COPY command query, I get InternalError_: Spectrum Scan Error.

这是我第一次尝试从实木复合地板文件中复制.

This is the first time I tried copying from a parquet file.

如果有解决方案，请帮助我.我在python中使用boto3.

Please help me if there is a solution for this. I am using boto3 in python.

推荐答案

通常由于以下原因而发生这种情况:

This generally happens for below reasons:

1. 如果表和文件之间的列数不匹配.
2. 如果文件模式的列类型与目标表列类型不兼容.

尝试进入错误日志.您可能会在Cloud Watch中找到部分日志.从您赞扬的屏幕快照中，您还可以找到已运行的查询编号.

Try going into the error logs. You might find partial log in cloud watch. From the screen shot you have uplaoded, you can also find a query number you have run.

转到aws redshift查询编辑器并在查询下面运行以获取完整日志:

Got to aws redshift query editor and run below query to get the full log:

select message 
from svl_s3log 
where query = '<<your query number>>'
order by query,segment,slice; 

希望这会有所帮助！

这篇关于InternalError_:频谱扫描错误.S3到Redshift复制命令的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！